一旦发生错误,csv到bean对象的UNIVOCITY-PARSERS就会停止

时间:2016-07-31 02:42:44

标签: java csv parsing univocity

我正在使用UNIVOCITY-PARSERS将csv文件行转换为java对象。

在处理文件时,如果遇到行中任何列的任何问题,则解析在该行中停止并抛出异常。但我需要一些东西,只要跳过有错误的行,就会一直持续到文件末尾。但我在api中没有任何实用程序类。

MY Bean课程

public class ItemcodeBean {

@Trim
@NullString(nulls = { " ", "" }) 
@Parsed(field = "ItemCode")
 private String itemCode;

@Trim 
@NullString(nulls = { " ", "" })
@Parsed(field = "PartNumber") 
private String partNumber;

@Trim 
@NullString(nulls = { " ", "" }) 
@Parsed(field = "ModelNumber") 
private String modelNumber;

}

我的主要课程

公共类TestClass {

private  BeanListProcessor<ItemcodeBean>
        rowProcessor = null;
private CsvParser parser = null;
public static void main(String[] args) {
    TestClass testClass = new TestClass();
    testClass.init();
    try{
        ItemcodeBean itemcodeBean;
        while ((itemcodeBean = testClass.getRowData()) != null){
            System.out.println(itemcodeBean.toString());
        }
    }catch (Throwable ex){
        System.out.println(ex.getLocalizedMessage());
    }

}

private BeanListProcessor<ItemcodeBean> init() {
    // BeanListProcessor converts each parsed row to an instance of a given class, then stores each instance into a list.
          this.rowProcessor =
            new BeanListProcessor<ItemcodeBean>(ItemcodeBean.class);

    CsvParserSettings parserSettings = new CsvParserSettings();
    parserSettings.setProcessor(rowProcessor);
    parserSettings.setHeaderExtractionEnabled(true);
    // skip leading whitespaces
    parserSettings.setIgnoreLeadingWhitespaces(true);

    //skip trailing whitespaces
    parserSettings.setIgnoreTrailingWhitespaces(true);
    //skip empty lines
    parserSettings.setSkipEmptyLines(true);

    File file = new File("C:\\Users\\abhishyam.c\\Downloads\\Itemcode_Template.csv");
    this.parser = new CsvParser(parserSettings);
    //parser.parse(file);
    parser.beginParsing(file);
    return rowProcessor;
}

private ItemcodeBean getRowData() throws Throwable {
    String[] row;
    try {
        while ((row = parser.parseNext()) != null){
            return rowProcessor.createBean(row, parser.getContext());
        }
    }catch (DataProcessingException e){
        throw new DataProcessingException(e.getColumnName(),e);
    }
   // parser.stopParsing();
    return null;
}

}

1 个答案:

答案 0 :(得分:3)

只需使用错误处理程序,它将继续运行,除非您自己抛出异常:

    //Let's set a RowProcessorErrorHandler to log the error. The parser will keep running.
    settings.setProcessorErrorHandler(new RowProcessorErrorHandler() {
        @Override
        public void handleError(DataProcessingException error, Object[] inputRow, ParsingContext context) {
            println(out, "Error processing row: " + Arrays.toString(inputRow));
            println(out, "Error details: column '" + error.getColumnName() + "' (index " + error.getColumnIndex() + ") has value '" + inputRow[error.getColumnIndex()] + "'");
        }
    });

更新:您可以使用RetryableErrorHandler来阻止该行被丢弃。这是添加到版本2.3.0的特殊实现,允许用户调用方法setDefaultValue()为有问题的列分配值,并keepRecord以防止丢弃记录。

示例:

settings.setProcessorErrorHandler(new RetryableErrorHandler<ParsingContext>() {
    @Override
    public void handleError(DataProcessingException error, Object[] inputRow, ParsingContext context) {
        //if there's an error in the first column, assign 50 and proceed with the record.
        if(error.getColumnIndex() == 0){ 
            setDefaultValue(50);
        } else { //else keep the record anyway. Null will be used instead.
            keepRecord();
        }
    }
});

请注意,如果error.getColumnIndex()返回-1,则无法保存记录,无论如何都会跳过它。您可以使用它来记录错误详细信息。