AWS EMR-使用Cloudera Teradata连接器的Sqoop导入无法以AVRO格式加载数据

时间:2018-09-10 13:37:04

标签: teradata sqoop cloudera amazon-emr connector

我在EMR群集上安装了cloudera sqoop teradata连接器,并尝试以avro格式导入数据。但是我的sqoop工作失败并出现以下错误。在这个问题上我需要您的帮助。我正在使用Sqoop 1.4.6版本和Teradata驱动程序14.0版本。通过引用复制到avro jar下方的一些博客到/ usr / lib / sqoop / lib /

  • avro-mapred-1.7.7-hadoop2.jar
  • avro-1.7.7.jar
  

10/09/10 13:31:31信息common.ConnectorPlugin:将插件加载到jar中:文件:/usr/lib/SQOOP_TERADATA_CONNECTOR-1.5c5/sqoop-connector-teradata-1.5c5.jar!/teradata.connector .plugins.xml   线程“主”中的异常java.lang.NoSuchMethodError:org.apache.sqoop.orm.AvroSchemaGenerator.generate()Lorg / apache / avro / Schema;           在com.cloudera.connector.teradata.imports.BaseImportJob.configureInputFormat(BaseImportJob.java:165)           在com.cloudera.connector.teradata.imports.TableImportJob.configureInputFormat(TableImportJob.java:32)           在org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:258)           在com.cloudera.connector.teradata.TeradataManager.importTable(TeradataManager.java:274)           在org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)           在org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)           在org.apache.sqoop.Sqoop.run(Sqoop.java:143)           在org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)           在org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)           在org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)           在org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)           在org.apache.sqoop.Sqoop.main(Sqoop.java:236)

0 个答案:

没有答案