我想在Ubuntu实例上安装Impala。到目前为止,以下方法均无效。
如何在Ubuntu中安装稳定版的Impala?
方法失败。 1:apt-get
首先,我尝试使用
安装二进制文件sudo apt-get update
sudo apt-get install impala
sudo apt-get install impala-server
sudo apt-get install impala-state-store
但是,Impala存储库的公钥存在问题:
Err:8 https://archive.cloudera.com/impala/ubuntu/lucid/amd64/impala bionic Release
404 Not Found [IP: 151.101.192.167 443]
Err:4 http://archive.cloudera.com/impala/ubuntu/lucid/amd64/impala lucid-impala1 InRelease
The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 327574EE02A818DD
Reading package lists... Done
E: The repository 'https://archive.cloudera.com/impala/ubuntu/lucid/amd64/impala bionic Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by defau
lt.
N: See apt-secure(8) manpage for repository creation and user configuration details.
W: GPG error: http://archive.cloudera.com/impala/ubuntu/lucid/amd64/impala lucid-impala1 InRelease: The following signatures couldn't be verified because the public key is not available:
NO_PUBKEY 327574EE02A818DD
E: The repository 'http://archive.cloudera.com/impala/ubuntu/lucid/amd64/impala lucid-impala1
InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
方法失败。 2:构建它
我做了git clone https://git-wip-us.apache.org/repos/asf/impala.git
,然后又跑了bin/bootstrap_build.sh
。
但是,文件bootstrap_build.sh在最后一行./buildall.sh -notests -so
中引用了不存在的shell脚本。
更新1::运行sudo dpkg --install impala_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
时,出现以下依赖项错误:
dpkg: dependency problems prevent configuration of impala:
impala depends on bigtop-utils (>= 0.7); however:
Package bigtop-utils is not installed.
impala depends on hadoop; however:
Package hadoop is not installed.
impala depends on hadoop-hdfs; however:
Package hadoop-hdfs is not installed.
impala depends on hadoop-yarn; however:
Package hadoop-yarn is not installed.
impala depends on hadoop-mapreduce; however:
Package hadoop-mapreduce is not installed.
impala depends on hbase; however:
Package hbase is not installed.
impala depends on hive (>= 0.12.0+cdh5.1.0); however:
Package hive is not installed.
impala depends on zookeeper; however:
Package zookeeper is not installed.
impala depends on libhdfs0; however:
Package libhdfs0 is not installed.
impala depends on avro-libs; however:
Package avro-libs is not installed.
impala depends on parquet; however:
Package parquet is not installed.
impala depends on sentry (>= 1.3.0+cdh5.1.0); however:
Package sentry is not installed.
dpkg: error processing package impala (--install):
dependency problems - leaving unconfigured
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Errors were encountered while processing:
impala
更新2:根据this tutorial安装Hadoop无法解决Hadoop依赖性问题。
答案 0 :(得分:2)
如果您抓取与发行版捆绑在一起的软件包,则安装Impala会更容易,因为它们与一组软件版本绑定在一起。选择一个CDH版本(例如cdh5.14.4),然后安装适当的软件包。所以看:
http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/pool/contrib/i/impala/
您可以wget
个软件包,然后运行dpkg install
来安装它们:
wget http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/pool/contrib/i/impala/impala-catalog_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
wget http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/pool/contrib/i/impala/impala-dbg_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
wget http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/pool/contrib/i/impala/impala-server_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
wget http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/pool/contrib/i/impala/impala-shell_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
wget http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/pool/contrib/i/impala/impala-state-store_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
wget http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/pool/contrib/i/impala/impala_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
dpkg --install impal*.deb
要在Ubuntu16上设置Impala,请执行以下操作:
wget 'https://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/cloudera.list'
mv cloudera.list /etc/apt/sources.list.d/cloudera.list
wget 'https://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/archive.key'
apt-key add archive.key`
然后执行原始说明:
sudo apt-get update
sudo apt-get install impala
sudo apt-get install impala-server
sudo apt-get install impala-state-store
答案 1 :(得分:1)
我建议使用github repo但稳定的分支,即2.x
从dpkg安装不会安装所有依赖项,您有两个选择:
从错误安装所有依赖项
我已使用下面的脚本/ heredoc生成命令。通过更改heredoc中的错误消息,可以将其与其他错误一起使用。
使用apt-get install ./impala_2.11.0+cdh5.14.4+0-1.cdh5.14.4.p0.4~xenial-cdh5.14.4_amd64.deb
这是更简单的方法,因为一切都得到了照顾。
$ echo "sudo apt-get install " `grep "Package" << Devidas | awk '{print $2}' | tr '\r\n' ' ' ; echo ' '
dpkg: dependency problems prevent configuration of impala:
impala depends on bigtop-utils (>= 0.7); however:
Package bigtop-utils is not installed.
impala depends on hadoop; however:
Package hadoop is not installed.
impala depends on hadoop-hdfs; however:
Package hadoop-hdfs is not installed.
impala depends on hadoop-yarn; however:
Package hadoop-yarn is not installed.
impala depends on hadoop-mapreduce; however:
Package hadoop-mapreduce is not installed.
impala depends on hbase; however:
Package hbase is not installed.
impala depends on hive (>= 0.12.0+cdh5.1.0); however:
Package hive is not installed.
impala depends on zookeeper; however:
Package zookeeper is not installed.
impala depends on libhdfs0; however:
Package libhdfs0 is not installed.
impala depends on avro-libs; however:
Package avro-libs is not installed.
impala depends on parquet; however:
Package parquet is not installed.
impala depends on sentry (>= 1.3.0+cdh5.1.0); however:
Package sentry is not installed.
dpkg: error processing package impala (--install):
dependency problems - leaving unconfigured
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Errors were encountered while processing:
impala
Devidas`
这应该导致类似以下内容:
sudo apt-get install bigtop-utils hadoop hadoop-hdfs hadoop-yarn hadoop-mapreduce \
hbase hive zookeeper libhdfs0 avro-libs parquet sentry