在服务器UI

时间:2017-08-21 12:15:28

标签: r apache-spark sparklyr

由于本地的SparklyR,我正在尝试连接到我的Spark服务器。 实际上,在我的服务器上,我打开一个R会话并执行

library(sparklyr)
library(dplyr)
sc <- spark_connect(master = "local")

我没有收到任何错误消息,但是当我在

上打开服务器UI时
  

http://my.server.local:8080/

我没有看到任何正在运行的应用程序。所以我猜有问题吗?

当我直接打开SparkR控制台时,我能够看到正在运行的应用程序。 我真的很想和SparklyR一起工作,我该怎么办?

1 个答案:

答案 0 :(得分:0)

启动本地服务器时,例如:

Fokkos-MacBook-Pro:~ fokkodriesprong$ sparkR

R version 3.4.1 (2017-06-30) -- "Single Candle"
Copyright (C) 2017 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin16.7.0 (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

  Natural language support but running in an English locale

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

Launching java with spark-submit command /usr/local/Cellar/apache-spark/2.2.0/libexec/bin/spark-submit   "sparkr-shell" /var/folders/dm/5qvjnrpx4m92318vwt4svfsh0000gn/T//Rtmpgtr1tn/backend_port1227e57d8a425 
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
17/08/21 15:16:09 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/08/21 15:16:13 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException

 Welcome to
    ____              __ 
   / __/__  ___ _____/ /__ 
  _\ \/ _ \/ _ `/ __/  '_/ 
 /___/ .__/\_,_/_/ /_/\_\   version  2.2.0 
    /_/ 


 SparkSession available as 'spark'.
During startup - Warning messages:
1: Setting LC_COLLATE failed, using "C" 
2: Setting LC_TIME failed, using "C" 
3: Setting LC_MESSAGES failed, using "C" 
4: Setting LC_MONETARY failed, using "C" 
> 

然后可以在http://localhost:4040/

处使用Spark UI