我创建了一个使用Copy活动将数据从Blob移动到SQL Datawarehouse的管道。
Azure Blob Dataset:
"name": "TradeData",
"properties": {
"type": "AzureBlob",
"linkedServiceName": "HDInsightStorageLinkedService",
"structure": [],
"typeProperties": {
"folderPath": "hdinsight/hive/warehouse/tradesummary/",
"format": {
"type": "OrcFormat"
}
},
SQL DW Dataset:
"name": "TradeDataRepository",
"properties": {
"type": "AzureSqlDWTable",
"linkedServiceName": "AzureSQLDataWarehouseLinkedService",
"typeProperties": {
"tableName": "tradesummary"
},
Pipeline:
"activities": [
{
"name": "CopyActivityTemplate",
"type": "Copy",
"inputs": [
{
"name": "TradeData"
}
],
"outputs": [
{
"name": "TradeDataRepository"
}
],
"typeProperties": {
"source": {
"type": "BlobSource",
"skipHeaderLineCount": 0
},
"sink": {
"type": "SqlDWSink",
"allowPolyBase": false
}
当我执行管道时,我收到以下错误:
数据库操作失败 来自数据库执行的错误消息: ErrorCode = FailedDbOperation,'Type = Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message =将数据加载到SQL数据仓库时发生错误。,Source = Microsoft.DataTransfer.ClientLibrary ,''Type = System.Data.SqlClient.SqlException,Message = 110802;发生导致此操作失败的内部DMS错误。详细信息:异常:Microsoft.SqlServer.DataWarehouse.DataMovement.Common.ExternalAccess.HdfsAccessException,消息:调用HdfsBridge_CreateRecordReader时出现Java异常:访问外部文件时出现错误[HdfsBridge :: CreateRecordReader - 创建记录读取器时遇到意外错误。] /hive/warehouse/tradesummary/000000_0][0].,Source=.Net SqlClient数据提供程序,SqlErrorNumber = 110802,Class = 16,ErrorCode = -2146232060,State = 1,Errors = [{Class = 16,Number = 110802 ,State = 1,Message = 110802;发生内部DMS错误,导致此操作失败。详细信息:异常:Microsoft.SqlServer.DataWarehouse.DataMovement.Common.ExternalAccess.HdfsAccessException,消息:调用HdfsBridge_CreateRecordReader时出现Java异常:访问外部文件时出现错误[HdfsBridge :: CreateRecordReader - 创建记录读取器时遇到意外错误。] /蜂巢/仓库/ tradesummary / 000000_0] [0]。,},],'。
任何指针都会受到赞赏。