Question

我使用HDP3.1。我Ambari部署了hadoop集群和配置单元。我只想使用一个用户（hdfs）来运行所有程序（例如hadoop，hive，sqoop，yarn ...）。因此，当在ambari中部署hadoop集群时，我在set ACCOUNTS步骤中将所有用户都更改为hdfs。部署后，我运行sqoop将数据从mysql导入到hive。我有以下问题。

19/02/20 18:44:13 INFO hive.HiveImport: ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. org.apache.hadoop.hive.ql.metadata.HiveException: Load Data failed for hdfs://datacenter1:8020/user/hdfs/person/part-m-00000 as the file is not owned by hive and load data is also not ran as hive
19/02/20 18:44:13 INFO hive.HiveImport: INFO  : Completed executing command(queryId=hdfs_20190220184412_d61d8591-04fc-41a7-b412-d64935ddd046); Time taken: 0.235 seconds
19/02/20 18:44:13 INFO hive.HiveImport: Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. org.apache.hadoop.hive.ql.metadata.HiveException: Load Data failed for hdfs://datacenter1:8020/user/hdfs/person/part-m-00000 as the file is not owned by hive and load data is also not ran as hive (state=08S01,code=1)
19/02/20 18:44:13 INFO hive.HiveImport: Closing: 0: jdbc:hive2://datacenter2:2181,datacenter1:2181,datacenter3:2181/default;password=hdfs;serviceDiscoveryMode=zooKeeper;user=hdfs;zooKeeperNamespace=hiveserver2
19/02/20 18:44:13 ERROR tool.ImportTool: Import failed: java.io.IOException: Hive exited with status 2
    at org.apache.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:299)
    at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:234)
    at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:558)
    at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:656)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:150)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:186)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:240)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:249)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:258)

此问题发生在减少步骤中。我不为什么它需要蜂巢用户。有人知道如何解决吗？

Answer 1

更改 hive-site.xml 中的 hive 配置。更改值：hive.load.data.owner 从 hive 到 nifi。重新启动所有配置单元服务并再次检查。 Duonghb

该文件不属于配置单元，并且加载数据也不作为配置单元运行

1 个答案: