Question

我有一个由以下文件表示的图表：

VertexLabel.txt - ＆gt;每行包含每个顶点的属性。
EdgeLabel.txt - ＆gt;每行包含每个边的属性。
EdgeID.txt - ＆gt;每行包含3个分隔的整数，它们对应于标签文件中的索引： source_index target_index edge_index。

大约有44K个顶点，边长为240K。我尝试使用neo4j.Writebatch批量插入图表数据。

from py2neo import Graph, neo4j, node, rel

graph_db = Graph()
nodes = {}
batchNodes = {}
edges = {}
edgeList = []

# Read vertex label file into nodes, where node[i] is indexed according to the order the nodes appear in the file.
# Each entry is of type node, e.g. node("FILM", title = "Star Trek"), node("CAST", name = "William Shatner")
...  

# Read edge label file into edges, where edges[i] is indexed according to the order the edges appear in the file.
# Each entry is a tuple (edge_type, edge_task), e.g. ("STAFF", "Director")
...  

# Read edge id file into edgeList
# Each entry is the tuple (source_index, target_index, edge_index), e.g. (1, 4, 8)
...  

# Iterate nodes, store in graph
# Note, store result of batch.create into batchNodes
batch = neo4j.WriteBatch(graph_db)
count = 0
for n in nodes:
    batchNodes[n] = batch.create(nodes[n])
    count += 1

    # Submit every 500 steps
    if count % 500 == 0:
        count = 0
        batch.submit()
        batch = neo4j.WriteBatch(graph_db)

# Submit remaining batch
batch.submit()

# Iterate edgeList, store in graph
batch = neo4j.WriteBatch(graph_db)
count = 0
for i, j, k in edgeList:
    # Lookup reference in batchNodes
    source = batchNodes[i]
    target = batchNodes[j]
    edge = edges[k]
    batch.create(rel(source, edge[0], target, {"task": edge[1]}))
    count += 1

    # Submit every 500 steps
    if count % 500 == 0:
        count = 0
        batch.submit()
        batch = neo4j.WriteBatch(graph_db)

# Submit remaining batch
batch.submit()

我收到以下错误：

Traceback (most recent call last):   File "test4.py", line 87, in <module>
    batch.create(rel(source, edge[0], target, {"task": edge[1]}))   File "C:\Python34\lib\site-packages\py2neo\batch\write.py", line 181, in create
    start_node = self.resolve(entity.start_node)   File "C:\Python34\lib\site-packages\py2neo\batch\core.py", line 374, in resolve
    return NodePointer(self.find(node))   File "C:\Python34\lib\site-packages\py2neo\batch\core.py", line 394, in find
    raise ValueError("Job not found in batch") ValueError: Job not found in batch

我认为batchNodes实际上并不包含对我想要查找的节点的正确引用以添加关系（可能重新初始化批处理对象会使引用无效）。在这种情况下，我该如何执行此任务？

我正在使用Neo4j 2.1.7（Community Edition）和py2neo 2.0.4。

Answer 1

为了导入您的CSV，我推荐自Neo4j 2.1 LOAD CSV

以来的数据

load csv with headers from "file://...VertexLabel.txt" as row
where has(row.name)
create (:Actor {row.name})

同样可以加载你的关系

创建索引：Actor（name）; 创建索引：电影（标题）;

load csv with headers from "file://...EdgeID.txt" as row
match (a:Actor {row.name})
match (m:Movie {row.title})
create (a)-[:ACTED_IN]->(m)

自Neo4j 2.2以来你也可以使用neo4j-import一个超快工具来导入csv数据，这些数据也支持id-groups，在csv等中提供标签和类型。

见：http://neo4j.com/developer/guide-importing-data-and-etl/ 并且：http://neo4j.com/developer/guide-import-csv/

使用py2neo WriteBatch将大图形数据插入到Neo4j中

1 个答案: