使用datastage将压缩数据从Amazon S3加载到Postgres

时间:2018-10-23 13:04:24

标签: amazon-s3 etl datastage ibm-infosphere

我正在尝试使用Datastage将S3中以.gz格式存储的数据加载到PostgreSQL服务器。我在目标(数据库)端使用ODBC连接器。我能够将未压缩的数据从S3加载到PostgreSQL,但是到目前为止,压缩数据还算不错。我已经尝试过Expand Stage,但是它没有帮助,或者我做的事情不正确。如果没有“扩展”数据,它将尝试读取压缩数据,但这样做会失败并引发错误:

Amazon_S3_0,1: com.ascential.e2.common.CC_Exception: Failed to initialize the parser: The row delimiter was not found within the first 132 bytes of the file. Ensure that the Row delimiter property matches the row delimiter of the file.
at com.ibm.iis.cc.cloud.CloudLogger.createCCException (CloudLogger.java: 196)
at com.ibm.iis.cc.cloud.CloudStage.processReadAndParse (CloudStage.java: 1591)
at com.ibm.iis.cc.cloud.CloudStage.process (CloudStage.java: 680)
at com.ibm.is.cc.javastage.connector.CC_JavaAdapter.run (CC_JavaAdapter.java: 443)


Amazon_S3_0,1: Failed to initialize the parser: The row delimiter was not found within the first 132 bytes of the file. Ensure that the Row delimiter property matches the row delimiter of the file. (com.ibm.iis.cc.cloud.CloudLogger::createCCException, file CloudLogger.java, line 196)

如果有人遇到此问题,请分享您的宝贵意见。

0 个答案:

没有答案