使用sqoop

时间:2018-06-11 14:45:57

标签: oracle hadoop hive bigdata sqoop

我需要一些帮助...

每天,我都使用sqoop将数据从oracle加载到hive表(hadoop)。有时,有些用户手动插入数据,并且它会取消每日进程,因为它会锁定配置单元表。

在导入过程中是否存在解锁hive表的标志?

Bellow my sqoop命令和错误消息..

  

sqoop import -D mapred.child.java.opts =" -Djava.security.egd = file:/ dev /../ dev / urandom" --compress --compression-codec lzop --mapreduce-job-name interaction_sqoop_cartoes_20180609_030307 --connection-manager org.apache.sqoop.manager.OracleManager --con +   nect" jdbc:Oracle:thin:@(DESCRIPTION =(ADDRESS_LIST =(ADDRESS =(PROTOCOL = TCP)(HOST = VCBXP0024CTO)(PORT = 1531)))(CONNECT_DATA =(SERVICE_NAME = OLPRC146)))&# 34; --username yyyyyyyy --password yyyyyxy $ \    - 表格GACCUCSM.interaction - 列ID,ENTITYTYPEID,MEDIATYPEID,SUBTYPEID,OWNERID,CONTACTID,PARENTID,STARTDATE,ENDDATE,THREADID,SUBJECT,TEXT,STRUCTUREDTEXT,STRUCTTEXTMIMETYPE,THECOMMENT,TENANTID,CANBEPARENT,QUEUENAME,STRATTRIBUTE1,STRATTRIBUTE2,ST +   RATTRIBUTE3,STRATTRIBUTE6,STRATTRIBUTE7,STRATTRIBUTE9,STRATTRIBUTE10,STOPPEDREASON - 其中" mediatypeid in(' sms',' chat',' email')和TO_CHAR (ENDDATE,' YYYYMMDD')=' 20180607'" \   --null-string'' --null-non-string'' --fields-terminated-by' |' --map-column-java TEXT = String,STRUCTUREDTEXT = String,THECOMMENT = String \    - 由 - 终止 - 由' \ n' --warehouse-dir / dados / prod / rt2_wrk / RT2_AI6_L1_INTERACTION_CARTOES_001 --delete-target-dir \   --hive-import --hive-drop-import-delims --hive-partition-key" anomesdia" --hive-partition-value 20180607 --hive-overwrite --verbose -m 4 --split-by id --hive-table RT2.RT2_AI6_L1_INTERACTION_CARTOES_001

Unable to acquire IMPLICIT, EXCLUSIVE lock rt2@rt2_ai6_l1_interaction_cartoes_001 after 100 attempts.

失败:获取锁定时出错:无法获取基础对象上的锁定。一段时间后重试

抱歉我的英语不好,感谢巴西!

0 个答案:

没有答案