我使用this guide在Ubuntu 14.04上安装了Cygnus,当我继续启动cygnus(正确填充)时:
nohup APACHE_FLUME_HOME/bin/cygnus-flume-ng agent --conf APACHE_FLUME_HOME/conf -f APACHE_FLUME_HOME/conf/cygnus.conf -n cygnusagent -Dflume.root.logger=INFO,LOGFILE [-p <mgmt-if-port>] [-t <polling-interval>] &
我得到了这个输出:
Warning: JAVA_HOME is not set!
+ exec /usr/bin/java -Xmx20m -cp '/etc/flume/apache-flume-1.4.0-bin/conf:/etc/flume/apache-flume-1.4.0-bin/lib/*:/etc/flume/apache-flume-1.4.0-bin/plugins.d/cygnus/lib/*'
-Djava.library.path= com.telefonica.iot.cygnus.nodes.CygnusApplication -f /usr/cygnus/conf/agent_1.conf -n cygnusagent
Starting an ordered shutdown of Cygnus
Stopping sources
All the channels are empty
Stopping channels Stopping sinks
问题出在哪里?
版本:0.8.0
CONF。文件:
cygnusagent.channel = mysql-channel
cygnusagent.sinks = mysql-sink
cygnusagent.sources = http-source
cygnusagent.sources.http-source.channels = mysql-channel
cygnusagent.sources.http-source.type = org.apache.flume.source.http.HTTPSource
cygnusagent.sources.http-source.port = 5050
cygnusagent.sources.http-source.handler = es.tid.fiware.fiwareconnectors.cygnus.handlers.OrionRestHandler
cygnusagent.sources.http-source.handler.notification_target = /notify
cygnusagent.sources.http-source.handler.default_service = def_serv
cygnusagent.sources.http-source.handler.default_service_path = def_servpath
cygnusagent.sources.http-source.handler.events_ttl = 10
cygnusagent.sources.http-source.interceptors = ts de
cygnusagent.sources.http-source.interceptors.ts.type = timestamp
cygnusagent.sources.http-source.interceptors.de.type = es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor$Builder
cygnusagent.sources.http-source.interceptors.de.matching_table = /usr/cygnus/conf/matching_table.conf
cygnusagent.sinks.mysql-sink.channel = mysql-channel
cygnusagent.sinks.mysql-sink.type = es.tid.fiware.fiwareconnectors.cygnus.sinks.OrionMySQLSink
cygnusagent.sinks.mysql-sink.mysql_host = 127.0.0.1
cygnusagent.sinks.mysql-sink.mysql_port = 3306
cygnusagent.sinks.mysql-sink.mysql_username = root
cygnusagent.sinks.mysql-sink.mysql_password = root
cygnusagent.sinks.mysql-sink.attr_persistence = row
cygnusagent.channels.mysql-channel.type = memory
cygnusagent.channels.mysql-channel.capacity = 1000
cygnusagent.channels.mysql-channel.transactionCapacity = 100
LOG:
2015-05-20 18:51:59,475(主要)[INFO - com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:235)] 启动侦听端口8081(管理接口)的Jetty服务器
2015-05-20 18:51:59,519(主要)[信息 - org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)]登录到 org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)来自 org.mortbay.log.Slf4jLog
2015-05-20 18:51:59,519(主要)[信息 - com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:238)] 启动Cygnus应用程序
2015-05-20 18:51:59,528(Thread-1)[INFO - org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)] jetty-6.1.26
2015-05-20 18:51:59,544(lifecycleSupervisor-1-0)[信息 - org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:61)] 配置提供程序启动
2015-05-20 18:51:59,559(conf-file-poller-0)[信息 - org.apache.flume.node.PollingPropertiesFileConfigurationProvider $ FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:133)] 重新加载配置 文件:/etc/flume/apache-flume-1.4.0-bin/conf/cygnus.conf
2015-05-20 18:51:59,575(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:MySQL的汇
2015-05-20 18:51:59,588(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:MySQL的汇
2015-05-20 18:51:59,588(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:MySQL的汇
2015-05-20 18:51:59,589(conf-file-poller-0)[警告 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1046)] 指定的属性无效:频道
2015-05-20 18:51:59,592(conf-file-poller-0)[警告 - org.apache.flume.conf.FlumeConfiguration。(FlumeConfiguration.java:101)] 忽略配置属性:cygnusagent.channel = mysql-channel
2015-05-20 18:51:59,593(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:MySQL的汇
2015-05-20 18:51:59,593(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:930)] 添加了接收器:mysql-sink代理:cygnusagent
2015-05-20 18:51:59,594(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:MySQL的汇
2015-05-20 18:51:59,594(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:MySQL的汇
2015-05-20 18:51:59,594(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:MySQL的汇
2015-05-20 18:51:59,621(conf-file-poller-0)[警告 - org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.isValid(FlumeConfiguration.java:319)] 代理配置&#39; cygnusagent&#39;不包含任何渠道。 将其标记为无效。
2015-05-20 18:51:59,621(conf-file-poller-0)[警告 - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:127)] 代理配置对代理&#39; cygnusagent&#39;无效。这将是 除去。
2015-05-20 18:51:59,622(conf-file-poller-0)[信息 - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:140)] 验证后水槽配置包含代理的配置: []
2015-05-20 18:51:59,622(conf-file-poller-0)[警告 - org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:138)] 未找到该主机的配置:cygnusagent
2015-05-20 18:51:59,640(Thread-1)[警告 - org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)]失败 SocketConnector@0.0.0.0:8081:java.net.BindException:已经是地址 在使用中
2015-05-20 18:51:59,652(Thread-1)[警告 - org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)]失败 Server @ 62526d1d:java.net.BindException:地址已在使用中
2015-05-20 18:51:59,652(Thread-1)[致命 - com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)] 运行管理界面时发生致命错误。详情=地址已经 在使用中
2015-05-20 18:51:59,669(conf-file-poller-0)[INFO - org.apache.flume.node.Application.startAllComponents(Application.java:138)] 开始新配置:{sourceRunners:{} sinkRunners:{} 频道:{}}
2015-05-20 18:51:59,723(conf-file-poller-0)[INFO - org.apache.flume.node.Application.stopAllComponents(Application.java:101)] 关闭配置:{sourceRunners:{} sinkRunners:{} 频道:{}}
2015-05-20 18:51:59,724(conf-file-poller-0)[INFO - org.apache.flume.node.Application.startAllComponents(Application.java:138)] 开始新配置:{sourceRunners:{} sinkRunners:{} 频道:{}}
答案 0 :(得分:1)
正如您在此日志中看到的那样:
2015-05-20 18:51:59,589 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1046)] Invalid property specified: channel
由于属性channel
无效,因此未配置频道。而不是那样,你必须使用channels
:
cygnusagent.channels = mysql-channel
请考虑使用Cygnus template创建您的配置(还有一个section in the README)。
答案 1 :(得分:0)
日志的一个问题是:
2015-05-20 18:51:59,652(Thread-1)[FATAL - com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)]运行管理界面时发生致命错误。详细信息=已在使用的地址
这是由于在一次运行天鹅座的试验中产生的垃圾处理过程。解决了这个过程。
还在其他响应中建议的更改清除所有警告。