Spark没有通过Ambari正确安装HDP 2.3?

时间:2015-07-29 19:49:39

标签: apache-spark ambari

我正在尝试使用Ambari 2.1.0和HDP 2.3在本地CentOS 6.6机器群集上安装HDFS,YARN,Spark等。我已经设法从HDP 2.2进行了升级,所以我在重新开始之前删除了所有HDP 2.2软件包+ Ambari。我能够毫无问题地完成大部分群集安装向导,但是在"安装,启动和测试"阶段,我收到以下错误消息

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py", line 38, in <module>
    AfterInstallHook().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 218, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py", line 35, in hook
    link_configs(self.stroutfile)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py", line 91, in link_configs
    _link_configs(k, json_version, v)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py", line 156, in _link_configs
    conf_select.select("HDP", package, version)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/conf_select.py", line 241, in select
    shell.checked_call(get_cmd("set-conf-dir", package, version), logoutput=False, quiet=False, sudo=True)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'conf-select set-conf-dir --package spark --stack-version 2.3.0.0-2557 --conf-version 0' returned 1. spark not installed or incorrect package name

检查脚本似乎在/usr/hdp/2.3.0.0-2557中寻找火花。这是我在该目录中看到的

ls /usr/hdp/2.3.0.0-2557/
etc  hadoop  hadoop-hdfs  hadoop-mapreduce  hadoop-yarn  ranger-hdfs-plugin  ranger-yarn-plugin  usr  zookeeper

抱怨的一台奴隶机器,似乎安装了火花&#34;

# yum list installed | grep spark
spark_2_3_0_0_2557.noarch
spark_2_3_0_0_2557-master.noarch
spark_2_3_0_0_2557-python.noarch
spark_2_3_0_0_2557-worker.noarch

有关如何解决此问题的任何想法?

1 个答案:

答案 0 :(得分:0)

某些组件的级别为2.3.0.0-2557,其他组件的级别为2.3.2.0-2621。

在我的情况下,我遇到了Zookeeper的问题,所以在/usr/hdp/current我链接了

zookeeper-client -> /usr/hdp/2.3.0.0-2557/zookeeper
zookeeper-server -> /usr/hdp/2.3.0.0-2557/zookeeper

这解决了安装问题,但没有启动服务。