无法使用Firebase和ElasticSearch(使用Flashlight)进行正确的路径监控或查询

时间:2016-10-24 16:56:32

标签: json node.js heroku elasticsearch firebase

我正在尝试将ElasticSearch与Firebase集成。我正在使用Firebase中的Flashlight integration设置全部。我已将代码部署到Heroku,如上面链接的Github repo中所述。

它的工作原理是,当我向/search/request/插入查询对象时,我得到/search/response结果。但结果有点乱,不正确。但我无法弄清楚出了什么问题。

这是config.js中定义的,我定义了要监控的路径:

/** Paths to Monitor
 *
 * Each path can have these keys:
 * {string}   path:    [required] the Firebase path to be monitored, for example, `users/profiles`
 *                     would monitor https://<instance>.firebaseio.com/users/profiles
 * {string}   index:   [required] the name of the ES index to write data into
 * {string}   type:    [required] name of the ES object type this document will be stored as
 * {Array}    fields:  list of fields to be monitored and indexed (defaults to all fields, ignored if "parser" is specified)
 * {Array}    omit:    list of fields that should not be indexed in ES (ignored if "parser" is specified)
 * {Function} filter:  if provided, only records that return true are indexed
 * {Function} parser:  if provided, the results of this function are passed to ES, rather than the raw data (fields is ignored if this is used)
 *
 * To store your paths dynamically, rather than specifying them all here, you can store them in Firebase.
 * Format each path object with the same keys described above, and store the array of paths at whatever
 * location you specified in the FB_PATHS variable. Be sure to restrict that data in your Security Rules.
 ****************************************************/

exports.paths = [{
    path: "users",
    index: "firebase",
    type: "user"
}, {
    path: "messages",
    index: "firebase",
    type: "message",
    fields: ['msg', 'name'],
    filter: function(data) {
        return data.name !== 'system';
    }
}];

这是Firebase中用户节点的结构(它位于根目录中)。

"users" : {
    "userid123" : {
      "friends" : {
        "userid42" : 1
      },
      "recs" : {
        "-recid1234" : 0
      },
      "user_info" : {
        "createdAt" : 1475157596,
        "email" : "e@male.org",
        "name" : "Firstname Lastname Johnson",
        "profilePicture" : "png.jpg",
        "pushId" : {
        },
        "username" : "userLooser"
      }
    },
    "userid42" : {
      "friends" : {
        "userid123" : 1,
        "test1" : 1
      },
      "recs" : {
        "-recid5678" : 0
      },
      "user_info" : {
        "email" : "email@icloud.com",
        "name" : "Firstname Lastname",
        "phoneNumber" : "",
        "profilePicture" : "jpg.png",
        "pushId" : {

        },
        "username" : "userName"
      }
    }
  }
}

我想要实现的是搜索用户名,并返回最佳结果。我真正需要的只是用户名和用户ID。

Image of firebase search query

但是当我用上图中的对象查询时,我得到下面的响应:

  "search" : {
    "response" : {
      "index" : {
        ".priority" : 1.477326417519E12,
        "hits" : [ {
          "_id" : "test1",
          "_index" : "firebase",
          "_score" : 1,
          "_source" : {
            "friends" : {
              "test1" : 1
            },
            "recs" : {
            },
            "user_info" : {
              "createdAt" : 1475157596,
              "name" : "Testbruker 1",
              "username" : "testuzer"
            }
          },
          "_type" : "user"
        }, {
          "_id" : "userid123",
          "_index" : "firebase",
          "_score" : 1,
          "_source" : {
            "friends" : {
            },
            "recs" : {

            },
            "user_info" : {
              "email" : "",
              "name" : "Firstname Lastname",
              "phoneNumber" : "",
              "profilePicture" : "",
              "pushId" : {
              },
              "username" : "profileName"
            }
          },
          "_type" : "user"
        }, {
          "_id" : "userid42",
          "_index" : "firebase",
          "_score" : 1,
          "_source" : {
            "friends" : {
            },
            "recs" : {

            },
            "user_info" : {
              "createdAt" : 1475157596,
              "email" : "e@male.org",
              "name" : "Firstname Lastname Johnson",
              "profilePicture" : "",
              "pushId" : {
              },
              "username" : "userLooser"
            }
          },
          "_type" : "user"
        } ],
        "max_score" : 1,
        "total" : 3
      },
      "query" : {
        ".priority" : 1.477326417484E12,
        "hits" : [ {
          "_id" : "test1",
          "_index" : "firebase",
          "_score" : 1,
          "_source" : {
            "friends" : {
              "test1" : 1
            },
            "recs" : {
            },
            "user_info" : {
              "createdAt" : 1475157596,
              "name" : "Testbruker 1",
              "username" : "testuzer"
            }
          },
          "_type" : "user"
        }, {
          "_id" : "userid42",
          "_index" : "firebase",
          "_score" : 1,
          "_source" : {
            "friends" : {

            },
            "recs" : {

            },
            "user_info" : {
              "email" : "",
              "name" : "Firstname Lastname",
              "phoneNumber" : "",
              "profilePicture" : "",
              "pushId" : {

              },
              "username" : "profileName"
            }
          },
          "_type" : "user"
        }, {
          "_id" : "userid123",
          "_index" : "firebase",
          "_score" : 1,
          "_source" : {
            "friends" : {
            },
            "recs" : {

            },
            "user_info" : {
              "createdAt" : 1475157596,
              "email" : "e@male.org",
              "name" : "Firstname Lastname Johnson",
              "profilePicture" : "",
              "pushId" : {

              },
              "username" : "userLooser"
            }
          },
          "_type" : "user"
        } ],
        "max_score" : 1,
        "total" : 3
      },
      "type" : {
        ".priority" : 1.477326417503E12,
        "hits" : [ {
          "_id" : "test1",
          "_index" : "firebase",
          "_score" : 1,
          "_source" : {
            "friends" : {
              "test1" : 1
            },
            "recs" : {
            },
            "user_info" : {
              "createdAt" : 1475157596,
              "name" : "Testbruker 1",
              "username" : "testuzer"
            }
          },
          "_type" : "user"
        }, {
          "_id" : "userid42",
          // Same content as above
        }, {
          "_id" : "userid123",
          // Same content as above
        } ],
        "max_score" : 1,
        "total" : 3
      }
    }
  }

其中:

  • A)不返回正确的排序。第一个结果与我的搜索查询完全不匹配,它看起来像是以随机顺序返回所有用户。
  • B)响应非常混乱。在/response下,有三个节点querytypeindex都包含很多点击数。

那么,谁知道什么是错的?如何创建查询或制作路径监视器以使搜索起作用?也许得到一个更简单的回应?

2 个答案:

答案 0 :(得分:5)

Flashlight实际上会在search / requests / $ key中查找请求,其中应包含具有字段类型,索引,查询的文档。它在搜索/响应/ $键的响应中显示结果。如果您想通过手动添加密钥进行测试,请尝试将请求放在另一个节点下,例如搜索/请求/ testkey123。

答案 1 :(得分:0)

我尝试了一下,经过几个小时的努力,我发现了:

在我的Flashlight项目文件 $(document).ready(function () { $('#myTable').DataTable({ "ajax": { "url": "/WaterLevel/getSMS", "type": "GET", "datatype": "json" }, "columns" : [ { "data": "updtd_date", "autoWidth": true }, { "data": "id", "autoWidth": true }, { "data": "sms", "autoWidth": true } ] }); }); </script> 中,我设置了:

.config

现在,您需要为Firebase exports.paths = [ { path : "albuns", index: "firebase", type : "album", fields: ['nome'] } ]; 发送呼叫http PUT(使用应用程序/ json),您可以使用Postman Extension测试它,正文

<URL_PROJECT>/search/request/<ID_CREATED_FOR_YOU>.json