Question

我有CSV文件，我想使用Logstash将其导入Elasticsearch 5.0.0。

这是CSV文件的前两行：

Id,CameraId,ZoneId,Latitude,Longitude,Number,OriginalNumber,Country,OriginalCountry,CapturedOn,Status,Direction,Speed,Confidence,AvgDigitsHeight,MultiplateRate,ProcessingTimeOCR,Signaled,OcrImageId,EnvImageIds,CapturerId,CapturerType,IsAlarm,AlarmListIds,ReplicationId,ImagesUploaded
111,24,1,42.8,3.5,XXDFR,XXDFR,DE,DE,2017-03-04 12:06:20.0,0,1,0,99,21.0,3,16.0193003809306,0,0,[],null,null,0,[],0,0

我运行这个Logstash脚本：

input {
    file {
        path => ["/usr/develop/test.csv"]
        type => "core2"
        start_position => "beginning"
    }
}

filter {
    csv {
        columns => [
"Id","CameraId","ZoneId","Latitude","Longitude,"Number","OriginalNumber","Country","OriginalCountry","CapturedOn","Status","Direction","Speed","Confidence","AvgDigitsHeight","MultiplateRate","ProcessingTimeOCR","Signaled","OcrImageId","EnvImageIds","CapturerId","CapturerType","IsAlarm","AlarmListIds","ReplicationId","ImagesUploaded"
        ]
    }
}

output {
    stdout { codec => rubydebug }
    elasticsearch {
        action => "index"
        hosts => ["127.0.0.1:9200"]
        index => "mytest"
        document_type => "doc"
        document_id => "%{Id}"
        workers => 1
    }
}

我收到此错误：

logstash.agent]获取了无效的配置{：config =＆gt;＆＃34;输入 {\ nfile {\ npath =＆gt; [\＆＃34; /usr/develop/test.csv \＆＃34;] \ ntype =＆gt; \＆＃34; core2 \＆＃34; \ nstart_position =＆gt; \＆＃34;开始\＆＃34; \ n} \ n} \ nfilter {\ ncsv {\ nseparator =＆gt; \＆＃34;，\＆＃34; \ ncolumns =＆gt; [\＆＃34;标识\＆＃34; \＆＃34; CameraId \＆＃34; \＆＃34;了zoneid \＆＃34; \＆＃34;纬度\＆＃34; \ ＆＃34;经度，\＆＃34;数\＆＃34; \＆＃34; OriginalNumber \＆＃34; \＆＃34;国家\＆＃34; \＆＃34; OriginalCountry \＆＃34; \＆＃34; CapturedOn \＆＃34;] \ N} \ N} \ noutput {\ nelasticsearch {\ naction =＆gt; \＆＃34; index \＆＃34; \ nhosts =＆gt; [\＆＃34; localhost：9200 \＆＃34;] \ nindex =＆gt; \＆＃34; test \＆＃34; \ ndocument_type =＆gt; \＆＃34; doc \＆＃34; \ ndocument_id =＆gt; \＆＃34;％{Id} \＆＃34; \ n \ nworkers =＆gt; 1 \ n} \ nstdout {codec =＆gt; rubydebug} \ n} \ n \ n＆＃34;，：reason =＆gt;＆＃34;第11行的＃，{，,,]之一过滤后的第61列（字节225）{\ ncsv {\ nseparator =＆gt; \＆＃34;，\＆＃34; \ ncolumns =＆gt; [\＆＃34;标识\＆＃34; \＆＃34; CameraId \＆＃34; \＆＃34;了zoneid \＆＃34; \＆＃34;纬度\＆＃34; \ ＆＃34;经度，\＆＃34;＆＃34;}

Answer 1

不确定你是否抓住了这个，但是因为你错过了一个＆＃34;列名称＆＃34;经度＆＃34;

用于将CSV文件内容上载到Elasticsearch的Logstash代码

1 个答案: