Question

我正在处理neo4j图，尝试导入一些数据，但是发生一些导入错误，这是日志：

Import error: Weird input data, no newline character in the whole buffer 4194304, not supported a.t.m.
Caused by:Weird input data, no newline character in the whole buffer 4194304, not supported a.t.m.
java.lang.IllegalStateException: Weird input data, no newline character in the whole buffer 4194304, not supported a.t.m.
        at org.neo4j.csv.reader.ClosestNewLineChunker.nextChunk(ClosestNewLineChunker.java:65)
        at org.neo4j.unsafe.impl.batchimport.input.csv.LazyCsvInputChunk.fillFrom(LazyCsvInputChunk.java:70)
        at org.neo4j.unsafe.impl.batchimport.input.csv.CsvInputChunkProxy.fillFrom(CsvInputChunkProxy.java:69)
        at org.neo4j.unsafe.impl.batchimport.input.csv.CsvInputIterator.next(CsvInputIterator.java:103)
        at org.neo4j.unsafe.impl.batchimport.input.csv.CsvInput.sample(CsvInput.java:238)
        at org.neo4j.unsafe.impl.batchimport.input.csv.CsvInput.calculateEstimates(CsvInput.java:199)
        at org.neo4j.unsafe.impl.batchimport.ImportLogic.initialize(ImportLogic.java:202)
        at org.neo4j.unsafe.impl.batchimport.ParallelBatchImporter.doImport(ParallelBatchImporter.java:88)
        at org.neo4j.tooling.ImportTool.doImport(ImportTool.java:585)
        at org.neo4j.commandline.dbms.CsvImporter.doImport(CsvImporter.java:128)
        at org.neo4j.commandline.dbms.ImportCommand.execute(ImportCommand.java:236)
        at org.neo4j.commandline.admin.AdminTool.execute(AdminTool.java:127)
        at org.neo4j.commandline.admin.AdminTool.main(AdminTool.java:51)
        Suppressed: java.lang.IllegalStateException: VM pause monitor is not started
                at org.neo4j.util.Preconditions.checkState(Preconditions.java:142)
                at org.neo4j.kernel.monitoring.VmPauseMonitor.stop(VmPauseMonitor.java:71)
                at org.neo4j.unsafe.impl.batchimport.staging.OnDemandDetailsExecutionMonitor.done(OnDemandDetailsExecutionMonitor.java:128)
                at org.neo4j.unsafe.impl.batchimport.staging.MultiExecutionMonitor.done(MultiExecutionMonitor.java:82)
                at org.neo4j.unsafe.impl.batchimport.staging.MultiExecutionMonitor.done(MultiExecutionMonitor.java:82)
                at org.neo4j.unsafe.impl.batchimport.ImportLogic.close(ImportLogic.java:520)
                at org.neo4j.unsafe.impl.batchimport.ParallelBatchImporter.doImport(ParallelBatchImporter.java:99)
                ... 5 more

WARNING Import failed. The store files in /data/databases/npm_0607.db are left as they are, although they are likely in an unusable state. Starting a database on these store files will likely fail or observe inconsistent records so start at your own risk or delete the store manually
unexpected error: Weird input data, no newline character in the whole buffer 4194304, not supported a.t.m.

我正在研究neo4j的docker容器当我尝试使用较小规模的数据时，一切正常，但是当我尝试使用6倍的数据大小时，会发生此错误，csv文件的大小总计几乎为14GB 起初，我认为这是因为文件大小而引起的，但我尝试将其分成较小的文件，但仍然是相同的错误。

我正在使用bin/neo4j-admin import进行导入

任何人都知道此错误的原因是什么？

Answer 1

Neo4j的批处理导入逻辑试图将大型输入数据分解为较小的块，以便多个解析器可以同时处理它们。该逻辑寻找换行符，以确定将块分开的位置。如果您的数据很少或没有换行符，则分块失败并显示错误。

您可能需要重新格式化输入数据，以使其包含更频繁的换行符。

输入数据奇怪，整个缓冲区4194304中没有换行符，不支持a.t.m

1 个答案: