Question

所以这可能很奇怪，但H2O似乎并没有访问我的集群中可用的内存。它应该使用24核和512GB总RAM，但只能看到26.67 Gb的RAM（但所有24核）。我在R中运行H2o。

h2o.init(nthreads=-1,max_mem_size = "500g")

H2O is not running yet, starting it now...

Note:  In case of errors look at the following log files:
/tmp/Rtmpx9ndSU/h2o_ra2816_started_from_r.out
/tmp/Rtmpx9ndSU/h2o_ra2816_started_from_r.err

openjdk version "1.8.0_121"
OpenJDK Runtime Environment (build 1.8.0_121-b13)
OpenJDK 64-Bit Server VM (build 25.121-b13, mixed mode)

Starting H2O JVM and connecting: . Connection successful!

R is connected to the H2O cluster: 
H2O cluster uptime:         1 seconds 304 milliseconds 
H2O cluster version:        3.10.5.2 
H2O cluster version age:    4 days  
H2O cluster name:           H2O_started_from_R_ra2816_qpf255 
H2O cluster total nodes:    1 
H2O cluster total memory:   26.67 GB 
H2O cluster total cores:    24 
H2O cluster allowed cores:  24 
H2O cluster healthy:        TRUE 
H2O Connection ip:          localhost 
H2O Connection port:        54321 
H2O Connection proxy:       NA 
H2O Internal Security:      FALSE 
R Version:                  R version 3.3.2 (2016-10-31)

我很感激有关此问题的任何帮助或想法。

Answer 1

我已经解决了这个问题。在初始化H2O之前加入以下内容：

options(java.parameters = "-Xmx500000m")

H2o无法完全访问群集上的内存

1 个答案: