Question

我有一个cloudera集群版本5.3.x以及使用以下命令运行sqoop客户端时

sqoop import --connect jdbc:mysql://HOST/myapplication --username myuser --direct -table=mytable -m 1 --hive-import --append --hive-table myapplication.tableimp --target-dir /user/hive/warehouse/myapplication/tableimp

它循环在以下语句中。即使我们的集群上只有MRv1，它似乎也试图连接到纱线。

INFO client.RMProxy: Connecting to ResourceManager at node/<ipaddress>:8032
INFO ipc.Client: Retrying connect to server: node/<ipaddress>:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
INFO ipc.Client: Retrying connect to server: node/<ipaddress>:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

我尝试了以下内容，即cloudera上的documented，但仍然没有变化。

alternatives --set sqoop2-tomcat-conf /etc/sqoop2/tomcat-conf.mr1

我可能应该提一下，我在该VM上的/ etc / sqoop2位置没有看到tomcat-conf.mr1文件。

Answer 1

hadoop-conf指向纱线配置。使用下面的命令将其更改为mapreduce配置修复它。

[root@node01 bin]# alternatives --config hadoop-conf

There are 4 programs which provide 'hadoop-conf'.

  Selection    Command

-----------------------------------------------

*+ 1           /etc/hadoop/conf.cloudera.yarn

   2           /etc/hadoop/conf.cloudera.hdfs

   3           /etc/hadoop/conf.cloudera.mapreduce

   4           /opt/cloudera/parcels/CDH-5.1.3-1.cdh5.1.3.p0.12/etc/hadoop/conf.empty


Enter to keep the current selection[+], or type selection number: 3

即使在MRv1上运行，sqoop也试图连接到纱线

1 个答案: