Pig脚本由于过滤器中的无效字段投影而失败

时间:2018-09-12 17:58:52

标签: hadoop bigdata apache-pig

下面是我正在尝试运行的代码段,并且遇到了无效字段的问题。

LIT__CALL_lt_CALL_segment_data = LOAD '/work/call/idrpnpc/lit/call/lt_call_segment' USING PigStorage('\u0001') AS (load_ts:chararray, source_location_id:chararray, destination_location_id:chararray, transportation_mode_cd:chararray, nifty_division_nbr:chararray, effective_dt:chararray, discontinue_dt:chararray, nifty_item_id:chararray, override_ind:chararray, planning_default_ind:chararray, order_duns_nbr:chararray, review_qty:int, contract_sopt_qty:int, calculated_sopt_qty:int, planning_sopt_qty:int, override_sopt_qty:int, transit_qty:int, put_away_qty:int, lead_time_variability_amt:chararray, customer_promise_factor_qty:int, customer_promise_day_qty:int, pick_up_day_nm:chararray,
arrival_day_nm:chararray, managed_vendor_ind:chararray, total_lead_time_qty:int, order_pattern_nm:chararray, order_interval_nm:chararray, order_policy_nm:chararray, source_location_level_cd:chararray, destination_location_level_cd:chararray, eligibility_status_cd:chararray, order_interval_qty:int, vendor_lead_time_qty:int, reporting_source_location_id:chararray, reporting_source_location_lead_time_qty:chararray, batchid:chararray);

LIT__CALL_lt_CALL_segment = foreach LIT__CALL_lt_CALL_segment_data generate
                                                                        source_location_id,
                                                                        destination_location_id,
                                                                        effective_dt,
                                                                        discontinue_dt,
                                                                        nifty_item_id,
                                                                        override_ind,
                                                                        planning_default_ind,
                                                                        total_lead_time_qty,
                                                                        order_interval_qty,
                                                                        destination_location_level_cd;


/*****************************filter LIT__CALL_lt_segment table***************************************************************/

LIT__CALL_lt_CALL_segment_warehouse_filter = FILTER LIT__CALL_lt_CALL_segment BY destination_location_level_cd == 'WAREHOUSE';

得到以下无效字段投影的错误。

  

无效的场投影。投影场   [lit__call_lt_call_segment :: destination_location_level_cd]不   存在于模式中:   source_location_id:字符数组,目标位置ID:字符数组,有效dt:字符数组,discontinue_dt:字符数组,nifty_item_id:字符数组,override_ind:字符数组,planning_default_ind:字符数组,总计Lead_time_qty:int,order_interval_qty:int,cd>目标位置。

有人可以帮我解决这个问题吗?

非常感谢

0 个答案:

没有答案