我打包了一个Jar并使用spark-submit在spark中运行应用程序
但是我收到了以下错误。
Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
我的cpu信息
$ free -m
total used free shared buff/cache available
Mem: 15886 12206 1984 16 1695 3251
Swap: 2047 216 1831
这是我的spark_env.sh:
export SPARK_EXECUTOR_INSTANCES=4
export SPARK_EXECUTOR_CORES=4
export SPARK_EXECUTOR_MEMORY=2G
export SPARK_UI_PORT=4040
export SPARK_MASTER_PORT=7077
export SPARK_MASTER_WEBUI_PORT=8099
export SPARK_WORKER_CORES=4
export SPARK_WORKER_INSTANCES=4
export SPARK_WORKER_MEMORY=2G
我的spark_env.sh有什么问题吗?