我正在尝试运行sqoop从mssql中提取数据并将其加载到s3。我试图在AWS EMR中使用Hue UI来做这个,我的sqoop版本是1.4.6。
这是命令,
import --connect jdbc:sqlserver://xxx.xxx.xx.xx/DataWarehouse --username **** --password *** --table ****_20120101 --target-dir s3://<bucket-name> --hive-drop-import-delims --escaped-by "\\"
我已经将sql jdbc驱动程序放在/ usr / lib / sqoop / lib /中,并将相同的jar文件sqljdbc4.jar放在&#39; / user / oozie / share / lib / lib _ $ {timestamp} /中sqoop&#39 ;.一切似乎都很好,但我不知道为什么,我运行上面的命令,工作说成功但没有数据加载到s3,当我查看日志,这是我看到的错误,
Feb 02, 2018 2:20:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class
Feb 02, 2018 2:20:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Feb 02, 2018 2:20:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class
Feb 02, 2018 2:20:47 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Feb 02, 2018 2:20:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Feb 02, 2018 2:20:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Feb 02, 2018 2:20:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.