多个火花作业同时运行

时间:2017-07-28 15:15:29

标签: apache-spark

我在localhost中运行了spark,我想使用job spark从三个主题kafka读取数据,我也使用命令行参数从脚本shell执行此作业

/usr/local/spark/bin/spark-submit --class "org.apache.sparkwordcount.SparkCassandra" --master spark://ubuntu:7077 '/home/darif/TestProject/wordcounts/target/wordcounts-1.0-SNAPSHOT.jar'  test1 &

/usr/local/spark/bin/spark-submit --class "org.apache.sparkwordcount.SparkCassandra" --master spark://ubuntu:7077 '/home/darif/TestProject/wordcounts/target/wordcounts-1.0-SNAPSHOT.jar'  test2 &

/usr/local/spark/bin/spark-submit --class "org.apache.sparkwordcount.SparkCassandra" --master spark://ubuntu:7077 '/home/darif/TestProject/wordcounts/target/wordcounts-1.0-SNAPSHOT.jar'  test3 &

但其中只有一个有效,两个已经处于“WAINTING”状态的

你能告诉我这里有什么问题吗? Thansk

0 个答案:

没有答案