我正在AWS Databricks中运行作业,并且在标准输出日志中得到以下信息:
2020-07-09T02:04:08.699+0000: [GC (Metadata GC Threshold) [PSYoungGen: 381952K->19341K(445440K)] 381952K->19357K(1464320K), 0.0238219 secs] [Times: user=0.02 sys=0.02, real=0.03 secs]
2020-07-09T02:04:08.723+0000: [Full GC (Metadata GC Threshold) [PSYoungGen: 19341K->0K(445440K)] [ParOldGen: 16K->18491K(1018880K)] 19357K->18491K(1464320K), [Metaspace: 20960K->20960K(1067008K)], 0.0757994 secs] [Times: user=0.08 sys=0.01, real=0.07 secs]
2020-07-09T02:04:12.951+0000: [GC (Allocation Failure) [PSYoungGen: 381952K->18051K(445440K)] 400443K->36551K(1464320K), 0.0270836 secs] [Times: user=0.04 sys=0.01, real=0.03 secs]
2020-07-09T02:04:13.002+0000: [GC (Metadata GC Threshold) [PSYoungGen: 28461K->8534K(445440K)] 46961K->27042K(1464320K), 0.0106388 secs] [Times: user=0.02 sys=0.00, real=0.01 secs]
2020-07-09T02:04:13.013+0000: [Full GC (Metadata GC Threshold) [PSYoungGen: 8534K->0K(445440K)] [ParOldGen: 18507K->13785K(1018880K)] 27042K->13785K(1464320K), [Metaspace: 34947K->34947K(1079296K)], 0.0625828 secs] [Times: user=0.10 sys=0.00, real=0.06 secs]
2020-07-09T02:04:16.110+0000: [GC (Allocation Failure) [PSYoungGen: 381952K->49226K(445440K)] 395737K->63083K(1464320K), 0.0785562 secs] [Times: user=0.12 sys=0.01, real=0.08 secs]
2020-07-09T02:04:17.977+0000: [GC (Allocation Failure) [PSYoungGen: 431178K->63477K(445440K)] 445035K->171636K(1464320K), 0.2444557 secs] [Times: user=0.40 sys=0.05, real=0.25 secs]
2020-07-09T02:04:18.867+0000: [GC (Metadata GC Threshold) [PSYoungGen: 158405K->63485K(311296K)] 266564K->174930K(1330176K), 0.1172015 secs] [Times: user=0.14 sys=0.00, real=0.12 secs]
2020-07-09T02:04:18.985+0000: [Full GC (Metadata GC Threshold) [PSYoungGen: 63485K->0K(311296K)] [ParOldGen: 111444K->167355K(1018880K)] 174930K->167355K(1330176K), [Metaspace: 58244K->58244K(1099776K)], 0.8953685 secs] [Times: user=1.54 sys=0.03, real=0.89 secs]
2020-07-09T02:04:21.353+0000: [GC (Allocation Failure) [PSYoungGen: 247808K->58633K(378368K)] 415163K->225996K(1397248K), 0.0211078 secs] [Times: user=0.04 sys=0.00, real=0.02 secs]
2020-07-09T02:04:23.202+0000: [GC (Allocation Failure) [PSYoungGen: 306441K->65506K(389632K)] 473804K->232877K(1408512K), 0.0556361 secs] [Times: user=0.06 sys=0.00, real=0.05 secs]
2020-07-09T02:04:24.855+0000: [GC (Allocation Failure) [PSYoungGen: 332770K->69989K(386560K)] 500141K->237369K(1405440K), 0.0332068 secs] [Times: user=0.06 sys=0.00, real=0.03 secs]
2020-07-09T02:04:27.092+0000: [GC (Allocation Failure) [PSYoungGen: 337253K->20610K(390656K)] 504633K->239741K(1409536K), 0.0554514 secs] [Times: user=0.06 sys=0.03, real=0.06 secs]
2020-07-09T02:04:29.852+0000: [GC (Metadata GC Threshold) [PSYoungGen: 282511K->20119K(390656K)] 501642K->246322K(1409536K), 0.0499257 secs] [Times: user=0.10 sys=0.00, real=0.06 secs]
2020-07-09T02:04:29.902+0000: [Full GC (Metadata GC Threshold) [PSYoungGen: 20119K->0K(390656K)] [ParOldGen: 226202K->241638K(1018880K)] 246322K->241638K(1409536K), [Metaspace: 97214K->97214K(1134592K)], 0.6315881 secs] [Times: user=0.90 sys=0.01, real=0.63 secs]
2020-07-09T02:04:34.198+0000: [GC (Allocation Failure) [PSYoungGen: 272384K->16722K(392704K)] 514022K->258369K(1411584K), 0.0283074 secs] [Times: user=0.05 sys=0.00, real=0.03 secs]
2020-07-09T02:04:36.595+0000: [GC (Allocation Failure) [PSYoungGen: 292178K->17414K(391680K)] 533825K->259060K(1410560K), 0.0258740 secs] [Times: user=0.04 sys=0.00, real=0.03 secs]
2020-07-09T02:04:37.669+0000: [GC (Allocation Failure) [PSYoungGen: 292870K->12813K(396288K)] 534516K->254467K(1415168K), 0.0419345 secs] [Times: user=0.04 sys=0.00, real=0.04 secs]
2020-07-09T02:04:42.874+0000: [GC (Allocation Failure) [PSYoungGen: 294925K->26314K(394752K)] 536579K->267977K(1413632K), 0.0897447 secs] [Times: user=0.10 sys=0.00, real=0.09 secs]
Thu Jul 9 02:05:13 UTC 2020 Starting R processing from BASH
Thu Jul 9 02:05:13 UTC 2020 R script: /local_disk0/tmp/_rServeScript.r2840437838180224371resource.r
Thu Jul 9 02:05:13 UTC 2020 Port number: 1100
Thu Jul 9 02:05:13 UTC 2020 cgroup: None
2020-07-09 02:05:14 R process started with pid 2585
-- running Rserve in this R session (pid=2585), 1 server(s) --
(This session will block until Rserve is shut down)
Spark package found in SPARK_HOME: /databricks/spark
DATABRICKS_STDOUT_END-3052c25e-c50d-4bc3-ba0c-941027fa1f3b-1594260317200
2020-07-09T02:05:55.553+0000: [GC (Allocation Failure) [PSYoungGen: 308426K->30225K(406528K)] 550089K->271911K(1425408K), 0.0397460 secs] [Times: user=0.04 sys=0.00, real=0.04 secs]
2020-07-09T02:06:19.002+0000: [GC (Allocation Failure) [PSYoungGen: 328721K->36159K(400896K)] 570407K->277853K(1419776K), 0.0750315 secs] [Times: user=0.15 sys=0.00, real=0.07 secs]
2020-07-09T02:06:21.759+0000: [GC (Allocation Failure) [PSYoungGen: 334655K->40798K(417280K)] 576349K->282500K(1436160K), 0.0381269 secs] [Times: user=0.07 sys=0.00, real=0.04 secs]
2020-07-09T02:06:23.329+0000: [GC (Allocation Failure) [PSYoungGen: 361310K->91631K(412160K)] 603012K->358112K(1431040K), 0.3041028 secs] [Times: user=0.31 sys=0.00, real=0.31 secs]
2020-07-09T02:06:25.824+0000: [GC (Allocation Failure) [PSYoungGen: 412143K->96766K(289280K)] 678624K->447440K(1308160K), 0.2528710 secs] [Times: user=0.40 sys=0.05, real=0.25 secs]
2020-07-09T02:06:28.885+0000: [GC (Allocation Failure) [PSYoungGen: 289278K->103940K(296960K)] 639952K->461322K(1315840K), 0.2587232 secs] [Times: user=0.33 sys=0.01, real=0.26 secs]
Executing command, time = 1594260382277.
2020-07-09T02:06:41.092+0000: [GC (Metadata GC Threshold) [PSYoungGen: 235565K->100191K(337920K)] 592947K->461908K(1356800K), 0.1179345 secs] [Times: user=0.22 sys=0.00, real=0.12 secs]
2020-07-09T02:06:41.210+0000: [Full GC (Metadata GC Threshold) [PSYoungGen: 100191K->0K(337920K)] [ParOldGen: 361716K->286734K(1018880K)] 461908K->286734K(1356800K), [Metaspace: 159599K->158432K(1189888K)], 1.2890584 secs] [Times: user=2.34 sys=0.00, real=1.29 secs]
/local_disk0/tmp/1594260397479-0/PythonShell.py:804: DeprecationWarning: The `use_readline` parameter is deprecated and ignored since IPython 6.0.
parent=self,
2020-07-09T02:06:48.211+0000: [GC (Allocation Failure) [PSYoungGen: 173056K->6068K(179200K)] 459790K->292811K(1198080K), 0.0164138 secs] [Times: user=0.02 sys=0.00, real=0.02 secs]
2020-07-09T02:07:04.366+0000: [GC (Allocation Failure) [PSYoungGen: 179124K->22946K(344576K)] 465867K->309697K(1363456K), 0.0173491 secs] [Times: user=0.03 sys=0.00, real=0.02 secs]
2020-07-09T02:07:05.828+0000: [GC (Allocation Failure) [PSYoungGen: 199074K->25890K(340480K)] 485825K->312649K(1359360K), 0.0222723 secs] [Times: user=0.04 sys=0.00, real=0.02 secs]
2020-07-09T02:07:24.563+0000: [GC (Allocation Failure) [PSYoungGen: 202018K->43673K(358400K)] 488777K->330440K(1377280K), 0.0284651 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
2020-07-09T02:07:27.659+0000: [GC (Allocation Failure) [PSYoungGen: 242259K->46329K(349696K)] 529026K->333104K(1368576K), 0.0287840 secs] [Times: user=0.06 sys=0.00, real=0.03 secs]
2020-07-09T02:08:10.197+0000: [GC (Allocation Failure) [PSYoungGen: 245497K->43724K(374272K)] 532272K->330507K(1393152K), 0.0289006 secs] [Times: user=0.06 sys=0.00, real=0.03 secs]
2020-07-09T02:10:07.450+0000: [GC (Allocation Failure) [PSYoungGen: 275660K->45844K(366592K)] 562443K->332635K(1385472K), 0.0395308 secs] [Times: user=0.08 sys=0.00, real=0.04 secs]
2020-07-09T02:12:10.690+0000: [GC (Allocation Failure) [PSYoungGen: 277662K->46421K(388096K)] 564453K->333211K(1406976K), 0.0426113 secs] [Times: user=0.06 sys=0.00, real=0.04 secs]
2020-07-09T02:14:24.760+0000: [GC (Allocation Failure) [PSYoungGen: 307029K->47366K(381440K)] 593819K->334157K(1400320K), 0.0328251 secs] [Times: user=0.06 sys=0.00, real=0.04 secs]
2020-07-09T02:16:35.186+0000: [GC (Allocation Failure) [PSYoungGen: 307974K->48196K(400384K)] 594765K->334987K(1419264K), 0.0445376 secs] [Times: user=0.04 sys=0.00, real=0.04 secs]
2020-07-09T02:19:10.760+0000: [GC (Allocation Failure) [PSYoungGen: 334404K->48403K(394752K)] 621195K->335202K(1413632K), 0.0356755 secs] [Times: user=0.05 sys=0.00, real=0.04 secs]
2020-07-09T02:21:31.314+0000: [GC (Allocation Failure) [PSYoungGen: 334611K->49820K(411136K)] 621410K->336627K(1430016K), 0.0351145 secs] [Times: user=0.06 sys=0.00, real=0.03 secs]
2020-07-09T02:24:22.012+0000: [GC (Allocation Failure) [PSYoungGen: 358044K->49386K(406016K)] 644851K->336193K(1424896K), 0.0428413 secs] [Times: user=0.05 sys=0.00, real=0.05 secs]
2020-07-09T02:28:31.524+0000: [GC (Allocation Failure) [PSYoungGen: 357533K->49322K(420352K)] 644340K->336129K(1439232K), 0.0344738 secs] [Times: user=0.06 sys=0.00, real=0.03 secs]
这是我的标准错误:
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
/databricks/python/lib/python3.7/site-packages/IPython/config.py:13: ShimWarning: The `IPython.config` package has been deprecated since IPython 4.0. You should import from traitlets.config instead.
"You should import from traitlets.config instead.", ShimWarning)
/databricks/python/lib/python3.7/site-packages/IPython/nbconvert.py:13: ShimWarning: The `IPython.nbconvert` package has been deprecated since IPython 4.0. You should import from nbconvert instead.
"You should import from nbconvert instead.", ShimWarning)
Thu Jul 9 02:06:40 2020 py4j imported
Thu Jul 9 02:06:41 2020 Python shell started with PID 2642 and guid ba246cdf30994a25b7a1e78a92a55fb6
Thu Jul 9 02:06:41 2020 Initialized gateway on port 41997
Thu Jul 9 02:06:43 2020 Python shell executor start
Dropped logging in PythonShell:
b'/local_disk0/tmp/1594260397479-0/PythonShell.py:804: DeprecationWarning: The `use_readline` parameter is deprecated and ignored since IPython 6.0.\n parent=self,\n'
当作业状态仍为Running
时,我一遍又一遍地看到“分配失败”行。有人知道这意味着什么吗?乍一看,这似乎是内存问题,但是单独运行该作业的笔记本可以正常工作。