在YARN群集模式下运行Apache Toree

时间:2017-05-04 16:08:34

标签: apache-spark jupyter-notebook apache-toree

根据这个JIRA(https://issues.apache.org/jira/browse/TOREE-369),Apache Toree支持在YARN CLuster模式下运行内核。 但我无法运行它。下面是我正在使用的kernel.json,

{
  "language": "scala",
  "display_name": "Remote - Scala",
  "env": {
    "__TOREE_SPARK_OPTS__": "--master yarn --deploy-mode cluster",
    "SPARK_HOME": "/usr/hdp/latest/spark",
    "__TOREE_OPTS__": "",
    "DEFAULT_INTERPRETER": "Scala",
    "PYTHON_EXEC": "python"
  },
  "argv": [
    "/usr/local/share/jupyter/kernels/apache_toree_scala/bin/run.sh",
    "--profile",
    "{connection_file}"
  ]
}

请帮助!

0 个答案:

没有答案