使用spark-ec2脚本在EC2上旋转Spark(1.6)群集时出现以下错误。我尝试使用--resume选项,但错误是一致的。
packet_write_wait: Connection to
<<host>>: Broken pipe Traceback (most recent call last): File "./spark_ec2.py", line 1535, in
<module>
main() File "./spark_ec2.py", line 1527,
in main real_main() File "./spark_ec2.py", line 1363,
in real_main setup_cluster(conn, master_nodes, slave_nodes, opts, True) File "./spark_ec2.py", line 811,
in setup_cluster dot_ssh_tar = ssh_read(master, opts,
['tar', 'c', '.ssh']) File "./spark_ec2.py", line 1209,
in ssh_read ssh_command(opts) + ['%s@%s' % (opts.user, host), stringify_command(command)]) File "./spark_ec2.py", line 1203,
in _check_output raise subprocess.CalledProcessError(retcode, cmd,
output=output)