Solr BlockJoin索引Solr 4.10.1

时间：2014-11-05 14:15:26

标签： solr solrj solr4 solr-schema solr4j

我试图将嵌套结构索引如下，并且难以使用SOlrJ和DIH索引。我已经与此争吵了一段时间，并且非常感谢对此的一些帮助。

如何使用SolrJ或DIH解决此问题。 感谢

我希望我的数据看起来像我的索引：

  

＆＃34; docs＆＃34;：[

     
{
    "name": "MR INCREDIBLE ",
    "id": 101,
    "job": "super hero",
    "_version_": "1483934897344086016"
    "children": [
            {
                "c_name":"Violet"  
                "c_age":10
                "c_gender":"female"
            },
            {
                "c_name":"Dash"  
                "c_age":8
                "c_gender":"male"
            }
    ]
}
         

  

我的schema.xml 

<schema name="datasearch" version="1.5">
<uniqueKey>id</uniqueKey>
<fields>
    <field name="_version_" type="long" indexed="true" stored="true" />
    <field name="_root_" type="string" indexed="true" stored="false"/>

    <field name="id" type="string" indexed="true" stored="true" />
    <field name="name" type="text" indexed="true" stored="true" />
    <field name="job" type="string" indexed="true" stored="true"/>

    <!-- I want to add children here -->
    <!-- <field name="children" indexed="true" stored="true"/> -->
    <field name="c_name" type="string" indexed="true" stored="true"/>
    <field name="c_age" type="int" indexed="true" stored="true"/>
    <field name="c_sex" type="string" indexed="true" stored="true"/>
</fields>

<types>
    <fieldType name="string" class="solr.TrieLongField" />
    <fieldType name="int" class="solr.TrieIntField" />
    <fieldType name="date" class="solr.TrieDateField" omitNorms="true" />
    <fieldType name="long" class="solr.StrField" sortMissingLast="true"/>
    <fieldType name="text" class="solr.TextField" positionIncrementGap="100">
        <analyzer>
            <tokenizer class="solr.StandardTokenizerFactory"/>
            <filter class="solr.LowerCaseFilterFactory"/>
            <filter class="solr.PorterStemFilterFactory"/>
        </analyzer>
    </fieldType>
</types>

<defaultSearchField>name</defaultSearchField>

</schema>

SolrJ Attempt 

val serverUrl = current.configuration.getString("solr.server.url").get
val solr = new HttpSolrServer(serverUrl)

def testAddChildDoc={
val doc = {
  new SolrInputDocument(){
    addField("id", "101")
    addField("name", "Mr Incredible")
  }
}
val c1 = new SolrInputDocument(){
    addField("c_name", "violet")
    addField("c_age", 10)
}
val c2 = new SolrInputDocument(){
    addField("c_name", "dash")
    addField("c_age", 8)
}

doc.addChildDocument(c1)
doc.addChildDocument(c2)

solr.deleteByQuery("*:*")
solr.add(doc)
solr.commit(true, true)
}

响应

=>ERROR org.apache.solr.core.SolrCore  – org.apache.solr.common.SolrException: [doc=null] missing required field: id
[RemoteSolrException: [doc=null] missing required field: id]

所以我继续向childDocs添加id以进行上述

...    
val c1 = new SolrInputDocument(){
    addField("id", "101")
    addField("c_name", "violet")
    addField("c_age", 10)
}
val c2 = new SolrInputDocument(){
    addField("id", "101")
    addField("c_name", "dash")
    addField("c_age", 8)
}
.....

然后重新运行get-all查询，现在我得到以下结果

SolrJ Attempt 2加上全部查询

{
  "responseHeader": {
    "status": 0,
    "QTime": 0,
    "params": {
      "indent": "true",
      "q": "*:*",
      "_": "1415194092582",
      "wt": "json"
    }
  },
  "response": {
    "numFound": 3,
    "start": 0,
    "docs": [
      {
        "id": 101,
        "c_name": violet,
        "c_age": "10",
      },
      {
        "id": 101,
        "c_name": dash,
        "c_age": "8"
      },
      {
        "id": 101,
        "name": "Mr Incredible",
        "_version_": "1483938552238571520"
      }
    ]
  }
}

所以我放弃了，尝试下面的DIH

DB-dataconfig.xml 

<dataConfig>
    <dataSource type="JdbcDataSource"
                driver="org.postgresql.Driver"
                url="jdbc:postgresql://xxx:5432/xxxx"
                user="xx" password="xx"
                readOnly="true" autoCommit="false" transactionIsolation="TRANSACTION_READ_COMMITTED" holdability="CLOSE_CURSORS_AT_COMMIT" />
    <document>
        <entity name="parent" query="select id,name, job from PARENTS LIMIT 1" >
            <field column="name"/>
            <field column="id"/>
            <field column="job"/>

                <entity child="true" name="children" query="select c_name, c_gender, c_age from CHILDREN" where="pid = ${parent.id}" processor="CachedSqlEntityProcessor">
                    <field column="c_age" />
                    <field column="c_gender" />
                    <field column="c_name"/>
                </entity>
        </entity>
    </document>
</dataConfig>

使用上面的DIH完全导入后查询get-all，并且没有子索引

{
  "responseHeader": {
    "status": 0,
    "QTime": 0,
    "params": {
      "indent": "true",
      "q": "*:*",
      "_": "1415195060664",
      "wt": "json"
    }
  },
  "response": {
    "numFound": 1,
    "start": 0,
    "docs": [
      {
        "name": "Mr Incredible",
        "id": 101,
        "_version_": "1483939357483073536"
      }
    ]
  }
}

2 个答案:

答案 0 :(得分：0)

为了能够在DIH中使用child="true"，请应用https://issues.apache.org/jira/browse/SOLR-5147中的补丁（我认为它与solr-3076中的DIH补丁相同）。

补丁本身似乎与当前主干的可忽略细节不兼容。

答案 1 :(得分：0)

为了从Solr 4.10.1得到以下回应

{
    "name": "MR INCREDIBLE ",
    "id": 101,
    "job": "super hero",
    "type": "parent",
    "_root_":"101"
    "_version_": "1483934897344086016"
    "childDocuments": [
        {
            "c_name":"Violet",
            "c_age":10,
            "c_gender":"female",
            "id":"101_Violet",
            "_root_":"101"
        },
        {
            "c_name":"Dash",
            "c_age":8,
            "c_gender":"male",
            "id":"101Dash",
            "_root_":"101"
        }
    ]
}
需要在模式中定义

“type”字段以区分父文档和子文档：

<fields>
    <field name="_version_" type="long" indexed="true" stored="true" />
    <field name="_root_" type="string" indexed="true" stored="false"/>

    <field name="id" type="string" indexed="true" stored="true" />
    <field name="name" type="text" indexed="true" stored="true" />
    <field name="job" type="string" indexed="true" stored="true"/>

    <field name="c_name" type="string" indexed="true" stored="true"/>
    <field name="c_age" type="int" indexed="true" stored="true"/>
    <field name="c_gender" type="string" indexed="true" stored="true"/>

    <field name="type" type="string" indexed="true" stored="true" />
</fields>

子文档也需要具有唯一的“id”，就像任何其他文档一样。 索引中的所有文档都应该是父/子关系，否则查询可能会返回意外结果。如果您需要既不是父母也不是孩子的文件，请为他们指定假父母。

<强> SolrJ

要使用子/父文档，需要solrj.jar 4.5或更高版本。

SolrServer solr = new HttpSolrServer(serverUrl);

SolrInputDocument doc = new SolrInputDocument();
String id = "101";
doc.addField("id", id);
doc.addField("name", "Mr Incredible");
doc.addField("job", "super hero");
doc.addField("type", "parent");

SolrInputDocument childDoc1 = new SolrInputDocument();
String name1 = "Violet";
childDoc1.addField("id", id + "_" + name1);
childDoc1.addField("c_name", name1);
childDoc1.addField("c_age", 10);
childDoc1.addField("c_gender", "female");
doc.addChildDocument(childDoc1);

SolrInputDocument childDoc2 = new SolrInputDocument();
String name2 = "Dash";
childDoc2.addField("id", id + "_" + name2);
childDoc2.addField("c_name", name2);
childDoc2.addField("c_age", 8);
childDoc2.addField("c_gender", "male");
doc.addChildDocument(childDoc2);

solr.add(doc);
solr.commit();

最后，查询如下所示：

http://localhost/solr/core/select?q={!parent which='type:parent'}&fl=*,[child parentFilter=type:parent]&wt=json&indent=true

仅获得女性的结果：

http://localhost/solr/core/select?q={!parent which='type:parent'}c_gender:female&fl=*,[child parentFilter=type:parent childFilter=c_gender:female]&wt=json&indent=true
相关问题
最新问题