ElasticSearch解析错误

时间:2016-04-07 14:31:29

标签: python elasticsearch

我正在尝试从网络端口扫描中读取JSON数据,并将这些结果作为文档存储在ElasticSearch索引中。但是,每当我尝试执行此操作时,MapperParsingException结果都会出现scan output错误。在我的映射中,我甚至尝试将分析更改为not_analyzedno,但错误并没有消失。然后,我认为ES可能会尝试将某些值解释为date值,并尝试将date_format设置为0none。这导致了一个死胡同,映射抛出Unsupported选项异常。

我在这里转储了我想在ElasticSearch中索引的值:

{
    "protocol": "tcp",
    "service": "ssh",
    "state": "open",
    "script_out": [
        {
            "output": "\n  1024 de:4e:50:33:cd:f6:8a:d0:c4:5a:e9:7d:1e:7b:13:12 (DSA)\nssh-dss AAAAB3NzaC1kc3MAAACBANkPx1nphZwsN1SVPPQHwz93abIHuEC4wMEeZiXdBC8RoSUUeCmdgPfIh4or0LvZ1pqaZP/k0qzCLyVxFt/eI7n36Lb9sZdVMf1Ao7E9TSc7lj9wg5ffY58WbWob/GQs1llGZ2K9Gp7oWuwCjKP164MsxMvahoJAAaWfap48ZiXpAAAAFQCnRMwRp8wBzzQU6lia8NegIb5rswAAAIEAxvN66VMDxE5aU8SvwwVmcUNwtVQWZ6pxn2W0gzF6H7JL1BhcnbCwQ3J/S6WdtqL2Dscw8drdAvsrN4XC8RT6Jowsir4q4HSQCybll6fSpNEdlv/nLIlYsH5ZuZZUIMxbTQ9vT0oYvzpDHejIQ/Zl1inYnJ+6XJmOc0LPUsu5PEsAAACAQO+Tsd3inLGskrqyrWSDO0VDD3cApYW7C+uTWXBfIoh/sVw+X9+OPa833w/PQkpacm68kYPXKS7GK8lqhg93dwbUNYFKz9MMNY6WVOjeAX9HtUAbglgLyRIt0CBqmL4snoZeKab22Nlmaf4aU5cHFlG9gnFEcK0vVIwIWp2EM/I=\n  2048 94:5f:86:77:81:39:2e:03:e0:42:d8:7d:10:a5:60:f0 (RSA)\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV9BKj+QSavAr4UcDaCoHADVIaMOpcI5/hx/X9CRLDTxmB/WvEiL42tziMZEx7ipHT28/hl4HOwK64eXZuK75JMrMDutCZ2gmvRmvFKl6mAVbUEOlVkMGZeNJxATCZyWQyrZ6wA9E2ns5+id6l9C8we+bdq39cIR/e+yR8Ht8sfaigDi0gcW67GrHDI/oIgTQ79l+T/xAqCVrtQxqn/6pCuaCWQUVCxgOPXmJPbsd+g+oqZtm0aEjIJvcDJocMkZ2qMMlgMPeJBN27FCTKB80UUbV57iHXHzZF+cD7v+Jlw0fmyMapMkkPH+aabOUy7Kkbty1mucrFxaisLsckEf47",
            "elements": {
                "null": [
                    {
                        "type": "ssh-dss",
                        "bits": "1024",
                        "key": "AAAAB3NzaC1kc3MAAACBANkPx1nphZwsN1SVPPQHwz93abIHuEC4wMEeZiXdBC8RoSUUeCmdgPfIh4or0LvZ1pqaZP/k0qzCLyVxFt/eI7n36Lb9sZdVMf1Ao7E9TSc7lj9wg5ffY58WbWob/GQs1llGZ2K9Gp7oWuwCjKP164MsxMvahoJAAaWfap48ZiXpAAAAFQCnRMwRp8wBzzQU6lia8NegIb5rswAAAIEAxvN66VMDxE5aU8SvwwVmcUNwtVQWZ6pxn2W0gzF6H7JL1BhcnbCwQ3J/S6WdtqL2Dscw8drdAvsrN4XC8RT6Jowsir4q4HSQCybll6fSpNEdlv/nLIlYsH5ZuZZUIMxbTQ9vT0oYvzpDHejIQ/Zl1inYnJ+6XJmOc0LPUsu5PEsAAACAQO+Tsd3inLGskrqyrWSDO0VDD3cApYW7C+uTWXBfIoh/sVw+X9+OPa833w/PQkpacm68kYPXKS7GK8lqhg93dwbUNYFKz9MMNY6WVOjeAX9HtUAbglgLyRIt0CBqmL4snoZeKab22Nlmaf4aU5cHFlG9gnFEcK0vVIwIWp2EM/I=",
                        "fingerprint": "de4e5033cdf68ad0c45ae97d1e7b1312"
                    },
                    {
                        "type": "ssh-rsa",
                        "bits": "2048",
                        "key": "AAAAB3NzaC1yc2EAAAADAQABAAABAQDV9BKj+QSavAr4UcDaCoHADVIaMOpcI5/hx/X9CRLDTxmB/WvEiL42tziMZEx7ipHT28/hl4HOwK64eXZuK75JMrMDutCZ2gmvRmvFKl6mAVbUEOlVkMGZeNJxATCZyWQyrZ6wA9E2ns5+id6l9C8we+bdq39cIR/e+yR8Ht8sfaigDi0gcW67GrHDI/oIgTQ79l+T/xAqCVrtQxqn/6pCuaCWQUVCxgOPXmJPbsd+g+oqZtm0aEjIJvcDJocMkZ2qMMlgMPeJBN27FCTKB80UUbV57iHXHzZF+cD7v+Jlw0fmyMapMkkPH+aabOUy7Kkbty1mucrFxaisLsckEf47",
                        "fingerprint": "945f867781392e03e042d87d10a560f0"
                    }
                ]
            },
            "id": "ssh-hostkey"
        }
    ],
    "banner": "product: OpenSSH version: 6.2 extrainfo: protocol 2.0",
    "port": "22"
},

更新 我能够对"输出"中的内容编制索引。键。但是,当我尝试索引"元素"中的内容时,会出现错误。键

更新2 我的映射可能存在问题。这是我用于映射的python代码。

"scan_info": {
                        "properties": {
                            "protocol": {
                                "type": "string",
                                "index": "analyzed"
                                },
                            "service": {
                                "type": "string",
                                "index": "analyzed"
                                },
                            "state": {
                                "type": "string",
                                "index": "not_analyzed"
                                },
                            "banner": {
                                "type": "string",
                                "index": "analyzed"
                                },
                            "port": {
                                "type": "string",
                                "index": "not_analyzed"
                                },
                            "script_out": { #is this the problem??
                                "type": "object",
                                "dynamic": True                                    
                            }

                        }
              }

我在这里画一个空白。我需要做什么?

0 个答案:

没有答案