在Google Cloud上设置Storm

时间:2016-10-26 19:39:40

标签: google-compute-engine google-cloud-platform apache-storm

我想知道是否有任何关于在Google Compute Engine上设置Apache Storm的工作。我一直在使用这个博客(http://datadventures.ghost.io/2013/12/29/deploying-storm-on-gce/),但我似乎无法让我的nimbus实例设置正常工作。

该博客指出,为了检查我的nimbus实例是否正常运行,我应该看一下Nimbus Web UI。但是,我似乎无法在浏览器上显示用户界面。我已经在storm.yaml文件中进行了必要的更改。

我的storm.yaml文件如下:

storm.zookeeper.servers:
     - "test-1"
 ui.port : 8080
 nimbus.host: "nimbus"
 nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true"
 ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
 supervisor.childopts: "-Djava.net.preferIPv4Stack=true"
 worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
 storm.local.dir: "/app/storm"

我检查了我的nimbus.log文件,我看到以下内容:

2016-10-26 18:57:27 b.s.d.nimbus [INFO] Starting Nimbus with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topolo$
2016-10-26 18:57:27 b.s.d.nimbus [INFO] Using default scheduler
2016-10-26 18:57:27 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting
2016-10-26 18:57:27 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=test-1:2181 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionSt$
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Opening socket connection to server test-1/10.142.0.9:2181
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Socket connection established to test-1/10.142.0.9:2181, initiating session
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Session establishment complete on server test-1/10.142.0.9:2181, sessionid = 0x157fc2e050f0008, negotiated timeout =$
2016-10-26 18:57:27 b.s.zookeeper [INFO] Zookeeper state update: :connected:none
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] EventThread shut down
2016-10-26 18:57:27 o.a.z.ZooKeeper [INFO] Session: 0x157fc2e050f0008 closed
2016-10-26 18:57:27 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting
2016-10-26 18:57:27 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=test-1:2181/storm sessionTimeout=20000 watcher=com.netflix.curator.Connec$
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Opening socket connection to server test-1/10.142.0.9:2181
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Socket connection established to test-1/10.142.0.9:2181, initiating session
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Session establishment complete on server test-1/10.142.0.9:2181, sessionid = 0x157fc2e050f0009, negotiated timeout =$
2016-10-26 18:57:27 b.s.d.nimbus [INFO] Starting Nimbus server...

这表明我的nimbus实例与zookeeper连接。但是,我对如何访问UI感到困惑。我尝试使用以下方式访问它:

http://[Public IP of Nimbus GCP Instance]:8080

我真的很感激任何帮助。关于在谷歌计算引擎上建立风暴,我没有遇到任何事情。我是Storm的相对新人。

由于

编辑:

gcloud compute firewall-rules list | grep 8080
nimbusui  default  0.0.0.0/0  udp:8080,tcp:8080      

在nimbus实例上,我尝试了:

netstat -l 8080

    Active Internet connections (only servers)
    Proto Recv-Q Send-Q Local Address           Foreign Address         State      
    tcp        0      0 *:ssh                   *:*                     LISTEN     
    tcp6       0      0 [::]:ssh                [::]:*                  LISTEN     
    udp        0      0 *:42924                 *:*                                
    udp        0      0 *:bootpc                *:*                                
    udp        0      0 nimbus.c.ecg-sandbo:ntp *:*                                
    udp        0      0 localhost:ntp           *:*                                
    udp        0      0 *:ntp                   *:*                                
    udp6       0      0 [::]:14994              [::]:*                             
    udp6       0      0 fe80::4001:aff:fe8e:ntp [::]:*                             
    udp6       0      0 ip6-localhost:ntp       [::]:*                             
    udp6       0      0 [::]:ntp                [::]:*                             
    Active UNIX domain sockets (only servers)
    Proto RefCnt Flags       Type       State         I-Node   Path
    unix  2      [ ACC ]     STREAM     LISTENING     10687    /var/run/dbus/system_bus_socket
    unix  2      [ ACC ]     STREAM     LISTENING     11147    /var/run/acpid.socket
    unix  2      [ ACC ]     STREAM     LISTENING     8751     @/com/ubuntu/upstart
    unix  2      [ ACC ]     SEQPACKET  LISTENING     9447     /run/udev/control

我还检查了ui.log:

2016-10-27 18:14:52 o.m.log [INFO] Logging to Logger[org.mortbay.log] via org.mortbay.log.Slf4jLog
2016-10-27 18:14:52 o.m.log [INFO] jetty-6.1.26
2016-10-27 18:14:52 o.m.log [INFO] Started SocketConnector@0.0.0.0:8080

0 个答案:

没有答案