与Samza一起使用S3作业文件时获取NullPointerException

时间:2015-04-22 18:37:41

标签: yarn apache-samza

将S3文件路径传递给yarn.package.path时,我收到以下异常。

Exception in thread "main" java.lang.NullPointerException
at org.apache.hadoop.fs.s3native.NativeS3FileSystem.getFileStatus(NativeS3FileSystem.java:433)
at org.apache.samza.job.yarn.ClientHelper.submitApplication(ClientHelper.scala:111)
at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:54)
at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:47)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:62)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:37)

我能够从同一个框中卷曲s3文件(导出AWS环境变量后)。 这是在我的作业属性文件中设置包路径的方式:

yarn.package.path=s3n://{ACCESS_KEY}:{SECRET_KEY}@bucketname/path1/path2/tar.gz

0 个答案:

没有答案