Spark笔记本不支持EMR的HUE

时间:2015-06-03 18:42:56

标签: apache-spark hue

好的,我的色调3.8指向了我的EMR群集,而且它主要起作用。有一点我想念的是我在这一点上真正关心的是火花笔记本

当我尝试为代码段选择语言时,会出现错误“ # implementing context manager >>> class Person(object): def __init__(self, name): self.name = name def __enter__(self): # The value returned by this method is # assigned to the variable after ``as`` return self def __exit__(self, exc_type, exc_value, exc_traceback ): # returns either True or False # Don't raise any exceptions in this method return True >>> with Person("John Doe") as p: print p.name >>> "John Doe" ”并且日志会这样说:

No usable value for lang Did not find value which can be converted into java.lang.String (error 400)

这是软件还是我的配置问题?

这可能与试图运行[03/Jun/2015 11:38:59 -0700] decorators ERROR error running <function create_session at 0x7fe30acd1d70> Traceback (most recent call last): File "/usr/local/hue/apps/spark/src/spark/decorators.py", line 77, in decorator return func(*args, **kwargs) File "/usr/local/hue/apps/spark/src/spark/api.py", line 44, in create_session response['session'] = get_api(request.user, snippet).create_session(lang=snippet['type']) File "/usr/local/hue/apps/spark/src/spark/models.py", line 284, in create_session response = api.create_session(kind=lang) File "/usr/local/hue/apps/spark/src/spark/job_server_api.py", line 87, in create_session return self._root.post('sessions', data=json.dumps(kwargs), contenttype='application/json') File "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in post return self.invoke("POST", relpath, params, data, self._make_headers(contenttype, headers)) File "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", line 78, in invoke urlencode=self._urlencode) File "/usr/local/hue/desktop/core/src/desktop/lib/rest/http_client.py", line 161, in execute raise self._exc_class(ex) RestException: No usable value for lang Did not find value which can be converted into java.lang.String (error 400) 的事实有关:

sudo ./hue livy_server

spark-submit确实存在并且在路径中

1 个答案:

答案 0 :(得分:0)

The

spark-submit

command comes from Spark, it needs to be present on the Hue machine.