Question

我有这种关系：

S10 = FOREACH E1EEFRE GENERATE  

CD_SI AS CD_SI,
IDT_ETT_CTR AS IDT_ETT_CTR,
CD_EFS AS CD_EFS,
(BigDecimal) null AS MT_DSP,
(BigDecimal) null AS MT_NAL,
(BigDecimal) null AS MT_ENC_MOY,
(BigDecimal) null AS MT_UTI,
(BigDecimal) null AS MT_ITT_M,
 MT_ENMO  AS MT_ENMO;

和

S5 = FOREACH E1EEFAU  GENERATE  
    CD_SI             AS CD_SI,
    IDT_ETT_CTR       AS IDT_ETT_CTR,
    CD_EFS            AS CD_EFS,
    MT_DSP AS MT_DSP,
    MT_NAL AS MT_NAL,
    MT_ENC_MOY  AS MT_ENC_MOY,
    MT_ENC_FIN_PER AS MT_UTI,
   'EEFAU' AS CD_ETT_ORI,
   MT_DSP AS MT_DSP_CVE,
   MT_NAL AS MT_NAL_CVE,
  (BigDecimal) null AS MT_ENC_MOY_CVE,
   MT_IMP AS MT_IMP,
   MT_PROR AS MT_PROR,
   MT_DEM AS MT_DEM,
  (BigDecimal) null AS MT_ITT_M;

现在，我要生成最终实体，其中 MT_ENC_EFF 和 MT_NAL_LIG 取决于 S5 和 S10 ： / p>

S26 = UNION S19, S22, S21;

S27 = FOREACH S26 GENERATE 

    '$CD_TY_TT'                 AS CD_TY_TT,
    '$DA_TT'                    AS DA_TT,
    '$A_ARR'                    AS A_ARR,
    '$M_ARR'                    AS M_ARR,
    '$CD_ETS'                   AS CD_ETS,
        $0                                       AS CD_SI,  
        $1                                  AS IDT_ETT_CTR,
        $2                                       AS CD_EFS,
        $3                                       AS MT_DSP,
        $4                                       AS MT_NAL,
        $5                                       AS MT_ENC_MOY,
        S10::MT_ENMO + S5::MT_ENC_MOY              AS MT_ENC_EFF,
        $6                                      AS MT_IMP,
        $7                                      AS MT_PROR,
        $8                                      AS MT_DEM,
        $9                                      AS MT_ITT_M,
        (S6::IDT_ETT_CTR_LIG == '' ? (S6::MT_NAL_BIL + S6::MT_AUT) :99) AS MT_NAL_LIG;


STORE S27 INTO '$PathDataWorkingFile' USING CSVExcelStorage(',', 'YES_MULTILINE');

显示的错误是：

无效的场投影。投影字段[S10 :: MT_ENMO]不存在。

但是 MT_ENMO 实际上存在！

当我更改了 S10.MT_ENMO 而不是 S10 :: MT_ENMO

我在Hadoop应用程序管理器中遇到了错误：

xecException：错误0：标量在输出中具有多个行。第一：（001,1708104234,01 ,,,,,,,,,,,,,,,,,,,,,,,, 0.0），第二个：（001,1715803812,01 ,,,,,,,,,,,,,, 0.0）（常见原因：在“ JOIN”然后“ FOREACH ... GENERATE foo.bar”应该是“ foo :: bar”） org.apache.pig.impl.builtin.ReadScalars.exec（ReadScalars.java:122）在 org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext（POUserFunc.java:326）

编辑：这是 S26

的输出

001,DQ0017751107,29,0.0,246327.35,0.0,,162234.16,0.0,0.0,0.0,,ECRFI,0.0,246327.35,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067947801,29,0.0,25217.33,0.0,,20433.19,0.0,0.0,0.0,,ECRFI,0.0,25217.33,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067947802,29,0.0,16666.67,0.0,,13496.64,0.0,0.0,0.0,,ECRFI,0.0,16666.67,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067947803,29,0.0,-16666.67,0.0,,-13496.64,0.0,0.0,0.0,,ECRFI,0.0,-16666.67,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067947804,29,0.0,25217.33,0.0,,21156.29,0.0,0.0,0.0,,ECRFI,0.0,25217.33,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067947805,29,0.0,16666.67,0.0,,13638.92,0.0,0.0,0.0,,ECRFI,0.0,16666.67,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067947806,29,0.0,-16666.67,0.0,,-13638.92,0.0,0.0,0.0,,ECRFI,0.0,-16666.67,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067947901,29,0.0,961900.0,0.0,,667228.77,0.0,0.0,0.0,,ECRFI,0.0,961900.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067948001,29,0.0,6250000.0,0.0,,4669082.64,0.0,0.0,0.0,,ECRFI,0.0,6250000.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,
001,DQ0067948101,29,0.0,1730000.0,0.0,,1314314.02,0.0,0.0,0.0,,ECRFI,0.0,1730000.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,,,,

注意

The full Pig script is here:

请问该如何解决？

Answer 1

问题在于，除了S10和您的最终关系S27之外，其他任何关系都没有投影MT_ENMO。

S16正在从S10投影数据，因此您应该在此处添加MT_ENMO。然后在S27中，应该可以通过投影S16::MT_ENMO来获取字段。

示例：

S16 = FOREACH S16_JOIN_LEFT GENERATE
    S10::CD_SI                      AS CD_SI,
    S10::IDT_ETT_CTR                AS IDT_ETT_CTR,
    S10::CD_EFS                     AS CD_EFS,
    S10::MT_DSP                     AS MT_DSP,
    S10::MT_NAL                     AS MT_NAL,
    S10::MT_ENC_MOY                 AS MT_ENC_MOY,
    S10::MT_UTI                     AS MT_UTI,
    S10::MT_CAP_RST_DU              AS MT_CAP_RST_DU,
    S10::MT_ITT_CRU                 AS MT_ITT_CRU,
    S10::MT_CAP_ECN_IMP             AS MT_CAP_ECN_IMP,
    S10::MT_ITT_IMP                 AS MT_ITT_IMP,
    S10::MT_DNR_ECN                 AS MT_DNR_ECN,
    S10::CD_ETT_ORI                 AS CD_ETT_ORI,
    S10::MT_DSP_CVE                 AS MT_DSP_CVE,
    S10::MT_NAL_CVE                 AS MT_NAL_CVE,
    S10::MT_ENC_MOY_CVE             AS MT_ENC_MOY_CVE,
    S10::MT_CAP_IMP_CVE             AS MT_CAP_IMP_CVE,
    S10::MT_ITT_IMP_CVE             AS MT_ITT_IMP_CVE,
    S10::MT_GLB_IMP                 AS MT_GLB_IMP,
    S10::MT_GLB_IMP_CVE             AS MT_GLB_IMP_CVE,
    S10::MT_BN_INST                 AS MT_BN_INST,
    S10::MT_BN_INST_CVE             AS MT_BN_INST_CVE,
    S10::MT_BN_NV                   AS MT_BN_NV,
    S10::MT_BN_NV_CVE               AS MT_BN_NV_CVE,
    S10::MT_IMP                     AS MT_IMP,
    S10::MT_PROR                    AS MT_PROR,
    S10::MT_DEM                     AS MT_DEM,
    S10::MT_ITT_M                   AS MT_ITT_M,
    S10::MT_ENMO                    AS MT_ENMO;

为什么除非存在原始关系，否则无法从原始关系的别名中找到列

1 个答案: