当表在不同的模式中时,如何从SQL Server导入所有带sqoop的表?

时间:2015-09-13 12:08:03

标签: sql-server hadoop hive sqoop

当我尝试使用sqoop从hive中的SQL Server导入所有表时,它只能在表处于默认架构(dbo)时工作。

当表位于不同的模式中(并且有多个模式)时,导入失败并显示错误:

 15/09/12 16:47:50 ERROR manager.SqlManager: Error executing statement: com.microsoft.sqlserver.jdbc.SQLServerException:
Invalid object name 'Carveout'.
 com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Carveout'.
         at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216)
         at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515)
         at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:404)
         at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:350)
         at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696)
         at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715)
         at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180)
         at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155)
         at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:285)
         at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:674)
         at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:683)
         at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:240)
         at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:223)
         at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:347)
         at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1277)
         at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1089)
         at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96)
         at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:396)
         at org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:105)
         at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
         at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
         at org.apache.sqoop.Sqoop.main(Sqoop.java:238)

2 个答案:

答案 0 :(得分:0)

您可以导入特定架构的所有表。

尝试 - 最后使用-schema schemaName。

如果你正在创造一份工作,我无法保证这一点。

答案 1 :(得分:0)

您可以在sqoop导入时将表列表作为schemaname.dbo.tablename..iterate传递,并在--query select * from schemaname.dbo.tablename

中使用它