我正在尝试使用SPARK REST API启动pyspark作业。我输入了发帖请求,但没有收到任何回复。
我的环境如下:
这是我的尝试:
curl -X POST http://192.168.43.88:34481/v1/submissions/create \
--header "Content-Type:application/json;charset=UTF-8" \
--data '{"action":"CreateSubmissionRequest",\
"appArgs":["/home/daniel/Documents/pyfiles/spark_pi.py"],\
"appResource":"file:/home/daniel/Documents/pyfiles/spark_pi.py",\
"clientSparkVersion":"2.4.3",\
"environmentVariables":{"SPARK_ENV_LOADED":"1"},\
"mainClass":"org.apache.spark.deploy.SparkSubmit",\
"sparkProperties":{"spark.driver.supervise":"false",\
"spark.app.name":"Simple App",\
"spark.eventLog.enabled":"true",\
"spark.submit.deployMode":"cluster",\
"spark.master":"spark://daniel-K501UX:7077"}}'
即使等待10分钟以上,我也没有得到回应。我在做什么错了?