OrientDB边缘导入

时间:2018-10-29 04:04:30

标签: import etl orientdb edges

我有两种类型的顶点:纸张和实体。

纸张具有paper_id,而实体具有entity_id。已经使用ETL工具从csv文件正确导入了它们。现在,我试图将纸张的边缘添加到结构如下的csv的实体中:

paper_id,entity_id
1,102030
1,203040
1,304050
2,304050
2,405060

我正在使用ETL工具运行以下文件:

{
  "source": { "file": { "path": "/Users/Desktop/orientdb-3.0.6/bin/temp/files/small_con.csv" } },
  "extractor": { "csv": {} },
  "transformers": [
    {
    "command" : {
            "command" : "CREATE EDGE References from (SELECT from Paper where paper_id = ${input.paper_id}) to (select from Entity where entity_id = ${input.entity_id})",
            "output" : "edge"
        }
    }
   ],
  "loader": {
    "orientdb": {
        "dbURL": 
"plocal:/Users/reagantifft/Desktop/Fall2018/SeniorProject/orientdb-3.0.6/databases/bv",
       "dbType": "graph",
       "classes": [

         {"name": "References", "extends": "E"}
       ]
    }
  }
 }

但是我的终端输出如下...注意错误。

OrientDB etl v.3.0.6 - Veloce (build b63614ab180ff02b75d65054b2a77116c16c0a3c, branch 3.0.x) https://www.orientdb.com

2018-10-28 20:05:02:492 INFO  Default limit of open files (512) will be used. [ONative]
2018-10-28 20:05:02:592 INFO  8589934592 B/8192 MB/8 GB of physical memory were detected on machine [ONative]
2018-10-28 20:05:02:593 INFO  Detected memory limit for current process is 8589934592 B/8192 MB/8 GB [ONative]
2018-10-28 20:05:02:595 INFO  JVM can use maximum 1963MB of heap memory [OMemoryAndLocalPaginatedEnginesInitializer]
2018-10-28 20:05:02:596 INFO  Because OrientDB is running outside a container 2g of memory will be left unallocated according to the setting 'memory.leftToOS' not taking into account heap memory [OMemoryAndLocalPaginatedEnginesInitializer]
2018-10-28 20:05:02:597 INFO  OrientDB auto-config DISKCACHE=4,181MB (heap=1,963MB os=8,192MB) [orientechnologies]
2018-10-28 20:05:02:598 INFO  System is started under an effective user : `reagantifft` [OEngineLocalPaginated]
2018-10-28 20:05:02:640 INFO  BEGIN ETL PROCESSOR [OETLProcessor]
2018-10-28 20:05:02:642 INFO  [file] Reading from file /Users/reagantifft/Desktop/orientdb-3.0.6/bin/temp/files/small_con.csv with encoding UTF-8 [OETLFileSource]
2018-10-28 20:05:02:642 INFO  Started execution with 1 worker threads [OETLProcessor]
2018-10-28 20:05:02:994 INFO  Storage 'plocal:/Users/reagantifft/Desktop/Fall2018/SeniorProject/orientdb-3.0.6/databases//bv' is opened under OrientDB distribution : 3.0.6 - Veloce (build b63614ab180ff02b75d65054b2a77116c16c0a3c, branch 3.0.x) [OLocalPaginatedStorage]
2018-10-28 20:05:03:646 INFO  + extracted 174 rows (0 rows/sec) - 174 rows -> loaded 0 vertices (0 vertices/sec) Total time: 1004ms [0 warnings, 0 errors] [OETLProcessor]
2018-10-28 20:05:03:672 SEVER {db=bv} Error in Pipeline execution: [OETLPipeline]
2018-10-28 20:05:03:680 SEVER ETL process has problem:  [OETLProcessor]
2018-10-28 20:05:03:690 INFO  END ETL PROCESSOR [OETLProcessor]
2018-10-28 20:05:03:691 INFO  + extracted 368 rows (4,311 rows/sec) - 368 rows -> loaded 0 vertices (0 vertices/sec) Total time: 1049ms [0 warnings, 1 errors] [OETLProcessor]

有什么想法我要去哪里吗? OrientDB和ETL工具的新功能。

0 个答案:

没有答案