在AWS上运行spark时获取日志文件问题和访问被拒绝

时间:2017-09-28 20:15:16

标签: amazon-web-services apache-spark

您好我正在尝试执行spark,但是当我在aws群集上运行时,我遇到了以下问题。

log4j:ERROR Could not read configuration file from URL [file:/etc/spark/conf/log4j.properties].
java.io.FileNotFoundException: /etc/spark/conf/log4j.properties (No such file or directory)
    at java.io.FileInputStream.open(Native Method)

17/09/28 19:50:16 INFO ApplicationMaster: Final app status: FAILED, exitCode: 15, (reason: User class threw exception: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 9AA4363BB8D75166), S3 Extended Request ID: UzSFXBXoJgTar68arZIr6X68gKuIVLOmUub/u5gwnZ9QYC+QpqKZhr7M848mj0OdijyKXGYTJ3I=
    at com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:1286)

0 个答案:

没有答案