当我尝试使用DataFactory将数据从Azure Blob复制到SQL Datawarehouse时出现异常

时间:2016-10-17 08:45:19

标签: azure-data-factory azure-sqldw

我创建了一个使用Copy活动将数据从Blob移动到SQL Datawarehouse的管道。

Azure Blob Dataset:
"name": "TradeData",
  "properties": {
    "type": "AzureBlob",
    "linkedServiceName": "HDInsightStorageLinkedService",
    "structure": [],
    "typeProperties": {
      "folderPath": "hdinsight/hive/warehouse/tradesummary/",
      "format": {
        "type": "OrcFormat"
      }
    },
SQL DW Dataset:
 "name": "TradeDataRepository",
  "properties": {
    "type": "AzureSqlDWTable",
    "linkedServiceName": "AzureSQLDataWarehouseLinkedService",
    "typeProperties": {
      "tableName": "tradesummary"
    },

Pipeline:
"activities": [
      {
        "name": "CopyActivityTemplate",
        "type": "Copy",
        "inputs": [
          {
            "name": "TradeData"
          }
        ],
        "outputs": [
          {
            "name": "TradeDataRepository"
          }
        ],
        "typeProperties": {
          "source": {
            "type": "BlobSource",
            "skipHeaderLineCount": 0
          },
          "sink": {
            "type": "SqlDWSink",
            "allowPolyBase": false
        }

当我执行管道时,我收到以下错误:

  

数据库操作失败   来自数据库执行的错误消息: ErrorCode = FailedDbOperation,'Type = Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message =将数据加载到SQL数据仓库时发生错误。,Source = Microsoft.DataTransfer.ClientLibrary ,''Type = System.Data.SqlClient.SqlException,Message = 110802;发生导致此操作失败的内部DMS错误。详细信息:异常:Microsoft.SqlServer.DataWarehouse.DataMovement.Common.ExternalAccess.HdfsAccessException,消息:调用HdfsBridge_CreateRecordReader时出现Java异常:访问外部文件时出现错误[HdfsBridge :: CreateRecordReader - 创建记录读取器时遇到意外错误。] /hive/warehouse/tradesummary/000000_0][0].,Source=.Net SqlClient数据提供程序,SqlErrorNumber = 110802,Class = 16,ErrorCode = -2146232060,State = 1,Errors = [{Class = 16,Number = 110802 ,State = 1,Message = 110802;发生内部DMS错误,导致此操作失败。详细信息:异常:Microsoft.SqlServer.DataWarehouse.DataMovement.Common.ExternalAccess.HdfsAccessException,消息:调用HdfsBridge_CreateRecordReader时出现Java异常:访问外部文件时出现错误[HdfsBridge :: CreateRecordReader - 创建记录读取器时遇到意外错误。] /蜂巢/仓库/ tradesummary / 000000_0] [0]。,},],'。

任何指针都会受到赞赏。

0 个答案:

没有答案