Oozie - 在Cloudera上复制到lib文件夹时截断的jar文件

时间:2015-12-25 11:03:36

标签: java hadoop cloudera oozie

我已经创建了一个Java动作并使用Hue of Cloudera进行部署。我注意到jar文件已被复制到工作区的/ lib文件夹中,但被截断为精确的64MB(发生在来自其他hdfs文件夹的jar文件和使用sharelib的两种情况)。

我按照https://community.cloudera.com/t5/Batch-Processing-and-Workflow/Oozie-Java-Action-ClassNotFoundException/td-p/4761的链接但是在将jar复制到workspace / lib文件夹后,工作流失败并出现服务器错误(500)。

/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py  111     get_response
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/decorators.py     52  decorate
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/views/editor.py   335     submit_workflow
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/views/editor.py   356     _submit_workflow
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   79  run
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   144     deploy
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   281     _do_as
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   275     _copy_files
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py   480     copyfile

我发现没有与最大文件大小相关的oozie配置,也不确定它是否与Hadoop配置有关。你见过这个案子吗?非常感谢你。

1 个答案:

答案 0 :(得分:0)

不完全确定,但可能已在hue issue

的链接中报告