火花提交工作中不断出现错误

时间:2016-02-29 09:26:14

标签: apache-spark pyspark

我不断收到此错误:

16/02/29 14:49:40 WARN BlockManager: Block input-0-1456737579500 replicated to only 0 peer(s) instead of 1 peers

在运行spark-submit作业时。

./spark-submit --jars jar_names--driver-class-path --packages --executor-memory 6g --executor-cores 4 --master local[4] script.py

我一旦启动就会收到此错误:错误说:

WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 
WARN Utils: Your hostname, host_name resolves to a loopback address: 127.0.0.1; using ip instead (on interface eth0) 
WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address

我也尝试使用--master[4],但仍然收到错误。

0 个答案:

没有答案