使用elasticsearch和php curl的批量索引

时间:2016-10-08 14:55:49

标签: php curl elasticsearch

我正在尝试向ElasticSearch执行一个php CURL请求,一次索引多个条目(使用_bulk),但我总是根据请求正文得到不同的错误

>         $posted = '';
>         for ($i = 0; $i < 10; $i++) {
>             $posted .= json_encode(array(
>                 'index' => new stdClass(),
>             )) .'\n';
> 
>             $posted .= json_encode(array(
>                 'id' => $i,
>                 'name' => 'XX' . $i,
>             ));
>             
>             if($i < 9){
>                 $posted .'\n';
>             }
>         }
> 
>         $fullURL = 'http://127.0.0.1:9200/myindex/mytype/_bulk';
>         $conn = curl_init($fullURL);
> 
>         curl_setopt($conn, CURLOPT_RETURNTRANSFER, true);
>         curl_setopt($conn, CURLOPT_SSL_VERIFYPEER, false);
>         curl_setopt($conn, CURLOPT_SSL_VERIFYHOST, false);
>         curl_setopt($conn, CURLOPT_FAILONERROR, false);
>         curl_setopt($conn, CURLOPT_CUSTOMREQUEST, 'POST');
>         curl_setopt($conn, CURLOPT_POSTFIELDS, $posted);
>         $res = curl_exec($conn);
>         echo $res;

使用上面的param字符串我收到此错误:

  

“error”:{“root_cause”:[{“type”:“action_request_validation_exception”,“reason”:“验证失败:1:未添加任何请求;”}],“type”:“action_request_validation_exception”,“reason” “:”验证失败:1:未添加任何请求;“},”状态“:400}

我已经使用JSON编码的单个请求对其进行了测试,并且工作正常 那么,如何使用php curl执行_bulk索引?

编辑: ---为了更具可读性而编辑,请参阅下面的答案。我尝试了在网络上发现的所有内容,为期2天,希望它可以帮助其他人。

1 个答案:

答案 0 :(得分:1)

我终于有了工作!!!

>         $b = array();
>         $sets = array();
> 
>         $params = array(
>             '_id' => null,
>             '_index' => 'myindex',
>             '_type' => 'mytype'
>         );
> 
>         for ($i = 0; $i < 10; $i++) {
>             $doc = array(
>                 'id' => $i,
>                 'name' => 'name ' . $i,
>             );
>             $set = array(
>                 array('index' => $params),
>                 $doc
>             );
>             $sets[] = $set;
>         }
> 
>         foreach ($sets as $set) {
>             foreach ($set as $s) {
>                 $b[] = json_encode($s);
>             }
>         }
>         $body =  join("\n", $b) . "\n";
>         
>         $conn = curl_init();
>         $requestURL = 'http://127.0.0.1:9200/myindex/mytype/_bulk';
>         curl_setopt($conn, CURLOPT_URL, $requestURL);
>         curl_setopt($conn, CURLOPT_TIMEOUT, 5);
>         curl_setopt($conn, CURLOPT_SSL_VERIFYPEER, FALSE);
>         curl_setopt($conn, CURLOPT_SSL_VERIFYHOST, FALSE);
>         curl_setopt($conn, CURLOPT_RETURNTRANSFER, TRUE);
>         curl_setopt($conn, CURLOPT_FAILONERROR, FALSE);
>         curl_setopt($conn, CURLOPT_CUSTOMREQUEST, strtoupper('POST'));
>         curl_setopt($conn, CURLOPT_FORBID_REUSE, 0);
> 
>         if (is_array($body) && count($body) > 0) {
>             curl_setopt($conn, CURLOPT_POSTFIELDS, json_encode($body));
>         } else {
>             curl_setopt($conn, CURLOPT_POSTFIELDS, $body);
>         }
>         
>         $response = curl_exec($conn);
>         echo $response;