将S3文件路径传递给yarn.package.path时,我收到以下异常。
Exception in thread "main" java.lang.NullPointerException
at org.apache.hadoop.fs.s3native.NativeS3FileSystem.getFileStatus(NativeS3FileSystem.java:433)
at org.apache.samza.job.yarn.ClientHelper.submitApplication(ClientHelper.scala:111)
at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:54)
at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:47)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:62)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:37)
我能够从同一个框中卷曲s3文件(导出AWS环境变量后)。 这是在我的作业属性文件中设置包路径的方式:
yarn.package.path=s3n://{ACCESS_KEY}:{SECRET_KEY}@bucketname/path1/path2/tar.gz