无法在AWS EMR中创建集群

时间:2015-11-30 14:47:36

标签: hadoop amazon-web-services emr

我试图使用Java从Eclipse创建EMR集群。我能够输出作业ID,但是当我查看EMR Web控制台时。没有创建任何集群。怎么了?

我的代码:

AWSCredentials credentials = new BasicAWSCredentials("xxx", "xxx");
         AmazonElasticMapReduceClient emr = new AmazonElasticMapReduceClient(credentials);

            StepFactory stepFactory = new StepFactory();

            StepConfig enableDebugging = new StepConfig()
                .withName("Enable Debugging")
                .withActionOnFailure("TERMINATE_JOB_FLOW")
                .withHadoopJarStep(stepFactory.newEnableDebuggingStep());

            StepConfig installHive = new StepConfig()
                .withName("Install Hive")
                .withActionOnFailure("TERMINATE_JOB_FLOW")
                .withHadoopJarStep(stepFactory.newInstallHiveStep());

            StepConfig hiveScript = new StepConfig().withName("Hive Script")
                .withActionOnFailure("TERMINATE_JOB_FLOW")
                .withHadoopJarStep(stepFactory.newRunHiveScriptStep("s3://mywordcountbuckett/binary/WordCount2.jar"));

            RunJobFlowRequest request = new RunJobFlowRequest()
                .withName("Hive Interactive")
                .withReleaseLabel("emr-4.1.0")
                .withSteps(enableDebugging, installHive)
                .withJobFlowRole("EMR_DefaultRole")
                .withServiceRole("EMR_EC2_DefaultRole")
                //.withSteps(enableDebugging, installHive)
                .withLogUri("s3://mywordcountbuckett/")
                .withInstances(new JobFlowInstancesConfig()
                    .withEc2KeyName("mykeypair")
                    .withHadoopVersion("2.4.0")            
                    .withInstanceCount(5)
                    .withKeepJobFlowAliveWhenNoSteps(true)
                    .withMasterInstanceType("m3.xlarge")
                    .withSlaveInstanceType("m1.large"));//.withAmiVersion("3.10.0");

            RunJobFlowResult result = emr.runJobFlow(request);
            System.out.println(result.toString());

我的输出是:

{JobFlowId: j-3T7H65FOSKHDQ}

我可能无法创建群集的原因是什么?

0 个答案:

没有答案