当我尝试通过数据摄取和标准摄取模板摄取json数据时,我遇到了一个问题。 初始化Feed后,它将进入故障Feed。我能够看到创建了json属性的hive表,但没有看到hdfs中的文件夹结构。
请在此处找到kylo attachment.enter图片说明的日志和屏幕截图
2017-09-03 08:21:33,205 INFO [Timer-Driven Process Thread-1] 2017-09-07 00:00:01,724 ERROR [Timer-Driven Process Thread-8] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask[id=17ff8df2-015d-1000-7741-d474a8a3404d] Error checking to see if Kylo is available. Please ensure Kylo is up and running.
2017-09-07 00:00:01,725 INFO [计时器驱动的进程线程-8] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d] Kylo尚无法处理请求。此任务将退出并等待其下一个计划间隔。 2017-09-07 00:00:01,725 INFO [计时器驱动的进程线程-8] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]报告任务已中止。记录的最后一次事件是:6269977 2017-09-07 00:00:06,730 ERROR [计时器驱动的进程线程-3] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]检查Kylo是否可用时出错。请确保Kylo正常运行。 2017-09-07 00:00:06,731 INFO [计时器驱动的进程线程-3] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d] Kylo尚无法处理请求。此任务将退出并等待其下一个计划间隔。 2017-09-07 00:00:06,731 INFO [计时器驱动的进程线程-3] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]报告任务已中止。记录的最后一次事件是:6269977 2017-09-07 00:00:07,004 INFO [预写本地状态提供商维护] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@8f5565c检查点有14020条记录和0转换文件207毫秒(世界时间停止) = 2毫秒,清除编辑日志时间= 0毫秒),最大事务ID 76071 2017-09-07 00:00:11,735 ERROR [计时器驱动的进程线程-6] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]检查Kylo是否可用时出错。请确保Kylo正常运行。 2017-09-07 00:00:11,736 INFO [计时器驱动的进程线程-6] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d] Kylo尚无法处理请求。此任务将退出并等待其下一个计划间隔。 2017-09-07 00:00:11,736 INFO [计时器驱动的进程线程-6] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]报告任务已中止。记录的最后一次事件是:6269977 2017-09-07 00:00:16,742 ERROR [计时器驱动的进程线程-1] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]检查Kylo是否可用时出错。请确保Kylo正常运行。 2017-09-07 00:00:16,742 INFO [计时器驱动的进程线程-1] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d] Kylo尚无法处理请求。此任务将退出并等待其下一个计划间隔。 2017-09-07 00:00:16,742 INFO [计时器驱动的进程线程-1] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]报告任务已中止。记录的最后一次事件是:6269977 2017-09-07 00:00:21,749 ERROR [计时器驱动的进程线程-5] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]检查Kylo是否可用时出错。请确保Kylo正常运行。 2017-09-07 00:00:21,749 INFO [计时器驱动的进程线程-5] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d] Kylo尚无法处理请求。此任务将退出并等待其下一个计划间隔。 2017-09-07 00:00:21,749 INFO [计时器驱动的进程线程-5] c.t.n.p.r.KyloProvenanceEventReportingTask KyloProvenanceEventReportingTask [id = 17ff8df2-015d-1000-7741-d474a8a3404d]报告任务已中止。记录的最后一次事件是:6269977 2017-09-07 00:00:25,600 ERROR [计时器驱动的进程线程-7] ctnifi.v2.init.InitializeFeed InitializeFeed [id = 2b1f1ef0-4e16-1bd6-f57d-9191210e2a13] InitializeFeed [id = 2b1f1ef0-4e16- 1bd6-f57d-9191210e2a13]由于org.springframework.web.client.HttpServerErrorException而无法处理:500内部服务器错误;回滚会话:org.springframework.web.client.HttpServerErrorException:500内部服务器错误 2017-09-07 00:00:25,602 ERROR [计时器驱动的进程线程-7] c.t.nifi.v2.init.InitializeFeed org.springframework.web.client.HttpServerErrorException:500内部服务器错误 at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:94)〜[spring-web-4.2.4.RELEASE.jar:4.2.4.RELEASE] 在org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:641)〜[spring-web-4.2.4.RELEASE.jar:4.2.4.RELEASE] 在org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:597)〜[spring-web-4.2.4.RELEASE.jar:4.2.4.RELEASE] 在org.springframework.web.client.RestTemplate.execute(RestTemplate.java:572)〜[spring-web-4.2.4.RELEASE.jar:4.2.4.RELEASE] 在org.springframework.web.client.RestTemplate.getForObject(RestTemplate.java:280)〜[spring-web-4.2.4.RELEASE.jar:4.2.4.RELEASE] 在com.thinkbiganalytics.metadata.rest.client.MetadataClient.get(MetadataClient.java:700)〜[na:na] 在com.thinkbiganalytics.metadata.rest.client.MetadataClient.get(MetadataClient.java:692)〜[na:na] at com.thinkbiganalytics.metadata.rest.client.MetadataClient.lambda $ getCurrentInitStatus $ 1(MetadataClient.java:263)~ [na:na] 在com.thinkbiganalytics.metadata.rest.client.MetadataClient.nullable(MetadataClient.java:577)〜[na:na] at com.thinkbiganalytics.metadata.rest.client.MetadataClient.getCurrentInitStatus(MetadataClient.java:263)~ [na:na] at com.thinkbiganalytics.nifi.v2.core.metadata.MetadataClientRecorder.getInitializationStatus(MetadataClientRecorder.java:217)~ [na:na] at com.thinkbiganalytics.nifi.v2.init.InitializeFeed.onTrigger(InitializeFeed.java:116)~ [kylo-nifi-core-processors-0.8.1.jar:na] 在org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)〜[nifi-api-1.0.0.jar:1.0.0] 在org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1064)[nifi-framework-core-1.0.0.jar:1.0.0]