Question

我在AWS EMR上运行pyspark集群，并将Jupyter用于pyspark驱动程序。最近，脚本失败。 Jupiter无法启动服务器。我从conda install jupyter开始安装，从sudo initctl start jupyter开始。群集运行正常。这是服务器的配置值。

# jupyter configs
mkdir -p ~/.jupyter
touch ls ~/.jupyter/jupyter_notebook_config.py
HASHED_PASSWORD=$(python -c "from notebook.auth import passwd; 
print(passwd('$JUPYTER_PASSWORD'))")
echo "c.NotebookApp.password = u'$HASHED_PASSWORD'" >> ~/.jupyter/jupyter_notebook_config.py
echo "c.NotebookApp.open_browser = False" >> ~/.jupyter/jupyter_notebook_config.py
echo "c.NotebookApp.ip = '*'" >> ~/.jupyter/jupyter_notebook_config.py
echo "c.NotebookApp.notebook_dir = '/mnt/$BUCKET/$FOLDER'" >> ~/.jupyter/jupyter_notebook_config.py
echo "c.ContentsManager.checkpoints_kwargs = {'root_dir': '.checkpoints'}" >> ~/.jupyter/jupyter_notebook_config.py
echo "c.NotebookApp.port = 8080" >> ~/.jupyter/jupyter_notebook_config.py

Answer 1

我发现更新到jupyter 5.7之后。我不得不修改配置参数。更改

echo "c.NotebookApp.ip = '*'" >> ~/.jupyter/jupyter_notebook_config.py

到

echo "c.NotebookApp.ip = '0.0.0.0'" >> ~/.jupyter/jupyter_notebook_config.py

jupyter投掷错误：socket.gaierror：[Errno -2]名称或服务未知

1 个答案: