neo4j - Mazerunner工作没有回复

时间:2016-11-29 10:42:36

标签: apache-spark graph neo4j neo4j-mazerunner bigdata

我正在使用kbastani/spark-neo4jdocker-compose来分析我的图表的中间性中心性。

我的节点是这样构建的:

(n1:Node {id:1})-[r:NEXT {count:100}]->(n2:Node {id:2})

我忽略了日志异常(因为我不知道如何处理它):

mazerunner_1  | 16/11/29 08:27:51 INFO FileInputFormat: Total input paths to process : 1
mazerunner_1  | Exception in thread "main" org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Zero blocklocations for /neo4j/mazerunner/jobs/edgeList.txt. Name node is in safe mode.
mazerunner_1  | The reported blocks 0 needs additional 28 blocks to reach the threshold 0.9990 of total blocks 28.
mazerunner_1  | The number of live datanodes 0 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1678)
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1651)
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1625)
mazerunner_1  |     at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:497)
mazerunner_1  |     at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:322)
mazerunner_1  |     at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
mazerunner_1  |     at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
mazerunner_1  |     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
mazerunner_1  |     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
mazerunner_1  |     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
mazerunner_1  |     at java.security.AccessController.doPrivileged(Native Method)
mazerunner_1  |     at javax.security.auth.Subject.doAs(Subject.java:415)
mazerunner_1  |     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
mazerunner_1  |     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)

我正在从Neo4J浏览器中运行我的工作:

:GET /service/mazerunner/analysis/betweenness_centrality/NEXT

我可以在迷宫跑步者日志中看到:

graphdb_1     | /var/lib/neo4j-community-2.2.3/..
graphdb_1     |  [*] Waiting for messages. To exit press CTRL+C
graphdb_1     | 08:50:31.608 [qtp198725683-33] WARN  o.a.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
graphdb_1     | Records exported: 20000
graphdb_1     | Records exported: 40000
graphdb_1     | Records exported: 60000
graphdb_1     | Records exported: 80000
graphdb_1     | Mazerunner Export Status: 100%
graphdb_1     |  [x] Sent '{"path":"hdfs://hdfs:9000/neo4j/mazerunner/jobs/edgeList.txt","analysis":"betweenness_centrality","mode":"Unpartitioned"}'

然后什么都没有......很长一段时间 问:如何让它运行?

1 个答案:

答案 0 :(得分:0)

在我的日志中

  

16/11/29 08:27:51 INFO FileInputFormat:要处理的总输入路径:1

这是一个古老的工作。 我不得不删除hdfs图像,然后重新运行docker-compose。它解决了我的问题