Amazon EMR集群处于启动状态

时间:2020-03-21 17:00:51

标签: java scala amazon-web-services amazon-emr

我正在使用控制台和SDK在AWS EMR上创建集群。但是这些群集始终保持“启动”状态,并且永远不会启动。为什么会发生这种情况,我该如何解决?谢谢。

自举操作日志: INFO i-062fab1a95f485684:新实例已启动 错误i-062fab1a95f485684:无法启动。引导操作1失败,退出代码非零。

我的代码:

val emr = AmazonElasticMapReduceClientBuilder.standard()
  .withCredentials(new AWSStaticCredentialsProvider(awsCred))
  .withRegion(Regions.EU_WEST_1)
  .build()

val stepFactory = new StepFactory();
val enabledebugging = new StepConfig()
  .withName("Enable debugging")
  .withActionOnFailure("TERMINATE_JOB_FLOW")
  .withHadoopJarStep(stepFactory.newEnableDebuggingStep())

val spark = new Application().withName("Spark")
val hive = new Application().withName("Hive")
val ganglia = new Application().withName("Ganglia")
val zeppelin = new Application().withName("Zeppelin")

val request = new RunJobFlowRequest()
  .withName("Spark Cluster")
  .withReleaseLabel("emr-5.20.0")
  .withSteps(enabledebugging)
  .withApplications(spark)
  .withLogUri("s3://my-logs")
  .withServiceRole("EMR_DefaultRole")
  .withJobFlowRole("EMR_EC2_DefaultRole")
  .withInstances(new JobFlowInstancesConfig()
    .withEc2SubnetId("subnet-xxxxx")
    .withEc2KeyName("ec2test")
    .withInstanceCount(3)
    .withKeepJobFlowAliveWhenNoSteps(true)
    .withMasterInstanceType("m5.xlarge")
    .withSlaveInstanceType("m5.xlarge")
  );
val result = emr.runJobFlow(request);
System.out.println("The cluster ID is " + result.toString());

0 个答案:

没有答案