sqoop导出失败-导出作业失败

时间:2020-06-26 10:11:08

标签: mysql hadoop sqoop

嗨,我正在尝试运行sqoop export命令。在mysql中,有一个名为empolyee的空表,用户名为newuser,数据库为db。我已经通过处理mysql中表employee的数据类型创建了一个csv文件。我已将该文件放在名为/sqoop/export/emp.csv的hdfs目录中。我已经在hdfs中检查了文件。它存在于该目录中。然后我将导出命令运行为

sqoop export --connect jdbc:mysql://localhost:3306/db --username newuser --table employee --export-dir /sqoop/export/emp.csv --driver com.mysql.jdbc.Driver

它正在映射100%,然后由于导出作业失败而出现错误

20/06/26 15:18:37 INFO mapreduce.Job:  map 100% reduce 0%
20/06/26 15:18:38 INFO mapreduce.Job: Job job_1593163228066_0003 failed with state FAILED due to: Task failed task_1593163228066_0003_m_000003
Job failed as tasks failed. failedMaps:1 failedReduces:0

20/06/26 15:18:38 INFO mapreduce.Job: Counters: 12
    Job Counters 
        Failed map tasks=1
        Killed map tasks=3
        Launched map tasks=4
        Data-local map tasks=4
        Total time spent by all maps in occupied slots (ms)=23002
        Total time spent by all reduces in occupied slots (ms)=0
        Total time spent by all map tasks (ms)=23002
        Total vcore-milliseconds taken by all map tasks=23002
        Total megabyte-milliseconds taken by all map tasks=23554048
    Map-Reduce Framework
        CPU time spent (ms)=0
        Physical memory (bytes) snapshot=0
        Virtual memory (bytes) snapshot=0
20/06/26 15:18:38 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
20/06/26 15:18:38 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 22.6316 seconds (0 bytes/sec)
20/06/26 15:18:38 INFO mapreduce.ExportJobBase: Exported 0 records.
20/06/26 15:18:38 ERROR mapreduce.ExportJobBase: Export job failed!
20/06/26 15:18:38 ERROR tool.ExportTool: Error during export: 
Export job failed!
    at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:445)
    at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
    at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80)
    at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

那么,可能是什么问题,我该如何解决?谢谢

0 个答案:

没有答案