感谢您的帮助。
我使用ambari部署spring-cloud-dataflow-server-yarn。但是当我启动流jdbc-source-kafka和hdfs-sink-kafka时。流部署未运行。 流配置
jdbc-source-kafka --max-rows-per-poll=10
--query='select t.* from clear_order_report t'
--password=******
--driver-class-name=oracle.jdbc.OracleDriver
--username=****** --url=jdbc:oracle:thin:@10.48.171.21:1521:******
| hdfs-sink-kafka
--fs-uri=hdfs://master.99wuxian.com:8020
--file-name=clear_order_report
--directory=/dataflows/apps/top
我重新打包jdbc-source-kafka-10-1.1.1.RELEASE.jar并添加oracle jdbc驱动程序。
纱线日志低于
Application Overview
User: scdf
Name: scdstream:app:oracle2hdfs
Application Type: DATAFLOW
Application Tags:
Application Priority: 0 (Higher Integer value indicates higher priority)
YarnApplicationState: ACCEPTED: waiting for AM container to be allocated, launched and register with RM.
Queue: default
FinalStatus Reported by AM: Application has not completed yet.
Started: 星期四 二月 09 17:38:33 +0800 2017
Elapsed: 21hrs, 18mins, 27sec
Tracking URL: ApplicationMaster
Log Aggregation Status NOT_START
Diagnostics: [星期四 二月 09 17:38:34 +0800 2017] Application is added to the scheduler and is not yet activated. Queue's AM resource limit exceeded. Details : AM Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:1024, vCores:1>; Queue Resource Limit for AM = <memory:1280, vCores:1>; User AM Resource Limit of the queue = <memory:1280, vCores:1>; Queue AM Resource Usage = <memory:1024, vCores:1>;
Unmanaged Application: false
Application Node Label expression: <Not set>
AM container Node Label expression: <DEFAULT_PARTITION>