Question

我正在关注本教程http://hadooped.blogspot.fr/2013/05/apache-sqoop-for-data-integration.html。我已经使用cloudera manager安装了hadoop服务（hdfs，hive，sqoop，hue，...）。我正在使用Ubuntu 12.04 TLS。当尝试将数据从Mysql导入HDFS时，mapreduce作业需要无限时间而不会返回任何错误。知道导入的表有4列10行。

这就是我的所作所为：

    sqoop import --connect jdbc:mysql://localhost/employees --username hadoop --password password --table departments -m 1 --target-dir /user/sqoop2/sqoop-mysql/department

    Warning: /opt/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p0.4/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
    Please set $ACCUMULO_HOME to the root of your Accumulo installation.
    16/02/23 17:49:09 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.5.2
    16/02/23 17:49:09 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
    16/02/23 17:49:10 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
    16/02/23 17:49:10 INFO tool.CodeGenTool: Beginning code generation
    16/02/23 17:49:11 INFO manager.SqlManager: Executing SQL statement:  SELECT t.* FROM `departments` AS t LIMIT 1
    16/02/23 17:49:11 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `departments` AS t LIMIT 1
    16/02/23 17:49:11 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
    Note: /tmp/sqoop-root/compile/6bdeb198a0c249392703e3fc0070cb64/departments.java uses or overrides a deprecated API.
    Note: Recompile with -Xlint:deprecation for details.
    16/02/23 17:49:19 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/6bdeb198a0c249392703e3fc0070cb64/departments.jar
    16/02/23 17:49:19 WARN manager.MySQLManager: It looks like you are importing from mysql.
    16/02/23 17:49:19 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
    16/02/23 17:49:19 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
    16/02/23 17:49:19 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
    16/02/23 17:49:19 INFO mapreduce.ImportJobBase: Beginning import of departments
    16/02/23 17:49:20 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
    16/02/23 17:49:24 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
    16/02/23 17:49:24 INFO client.RMProxy: Connecting to ResourceManager at hadoopUser/10.0.2.15:8032
    16/02/23 17:49:31 INFO db.DBInputFormat: Using read commited transaction isolation
    16/02/23 17:49:31 INFO mapreduce.JobSubmitter: number of splits:1
    16/02/23 17:49:33 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1456236806433_0004
    16/02/23 17:49:34 INFO impl.YarnClientImpl: Submitted application application_1456236806433_0004
    16/02/23 17:49:34 INFO mapreduce.Job: The url to track the job: http://hadoopUser:8088/proxy/application_1456236806433_0004/
    16/02/23 17:49:34 INFO mapreduce.Job: Running job: job_1456236806433_0004

Job_image

的问候，

Answer 1

MapReduce作业未启动。您需要在群集上运行测试wordcount作业。

使用HDFS中的sqoop导入数据

1 个答案: