如何在更改conf设置后重新启动EMR中的Spark服务?

时间:2017-10-12 12:24:45

标签: apache-spark emr amazon-emr

我正在使用EMR-5.9.0,在更改了一些配置文件之后,我想重新启动服务以查看效果。我怎样才能做到这一点?

我尝试使用initctl列表找到服务的名称,正如我在其他答案中看到的那样,但没有运气......

2 个答案:

答案 0 :(得分:11)

由于Spark作为Hadoop Yarn上的应用程序运行,您可以尝试

 sudo stop hadoop-yarn-resourcemanager  
 sudo start hadoop-yarn-resourcemanager  

如果您的意思是Spark History Server,那么您可以使用

 sudo stop spark-history-server  
 sudo start spark-history-server  

可以使用

检查服务的状态

sudo status hadoop-yarn-resourcemanager
sudo status spark-history-server

答案 1 :(得分:0)

在5.x EMR群集中,您还可以执行以下操作:

[hadoop@ip-10-0-2-93 conf]$ initctl list | grep yarn
hadoop-yarn-timelineserver start/running, process 10632
hadoop-yarn-resourcemanager start/running, process 10771
hadoop-yarn-proxyserver start/running, process 10508

[hadoop@ip-10-0-2-93 conf]$ sudo stop hadoop-yarn-resourcemanager
hadoop-yarn-resourcemanager stop/waiting

[hadoop@ip-10-0-2-93 conf]$ sudo start hadoop-yarn-resourcemanager
hadoop-yarn-resourcemanager start/running, process 1591

[hadoop@ip-10-0-2-93 conf]$ initctl list | grep yarn
hadoop-yarn-timelineserver start/running, process 10632
hadoop-yarn-resourcemanager start/running, process 1591
hadoop-yarn-proxyserver start/running, process 10508