我想知道是否有任何关于在Google Compute Engine上设置Apache Storm的工作。我一直在使用这个博客(http://datadventures.ghost.io/2013/12/29/deploying-storm-on-gce/),但我似乎无法让我的nimbus实例设置正常工作。
该博客指出,为了检查我的nimbus实例是否正常运行,我应该看一下Nimbus Web UI。但是,我似乎无法在浏览器上显示用户界面。我已经在storm.yaml文件中进行了必要的更改。
我的storm.yaml文件如下:
storm.zookeeper.servers:
- "test-1"
ui.port : 8080
nimbus.host: "nimbus"
nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true"
ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
supervisor.childopts: "-Djava.net.preferIPv4Stack=true"
worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
storm.local.dir: "/app/storm"
我检查了我的nimbus.log文件,我看到以下内容:
2016-10-26 18:57:27 b.s.d.nimbus [INFO] Starting Nimbus with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topolo$
2016-10-26 18:57:27 b.s.d.nimbus [INFO] Using default scheduler
2016-10-26 18:57:27 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting
2016-10-26 18:57:27 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=test-1:2181 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionSt$
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Opening socket connection to server test-1/10.142.0.9:2181
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Socket connection established to test-1/10.142.0.9:2181, initiating session
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Session establishment complete on server test-1/10.142.0.9:2181, sessionid = 0x157fc2e050f0008, negotiated timeout =$
2016-10-26 18:57:27 b.s.zookeeper [INFO] Zookeeper state update: :connected:none
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] EventThread shut down
2016-10-26 18:57:27 o.a.z.ZooKeeper [INFO] Session: 0x157fc2e050f0008 closed
2016-10-26 18:57:27 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting
2016-10-26 18:57:27 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=test-1:2181/storm sessionTimeout=20000 watcher=com.netflix.curator.Connec$
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Opening socket connection to server test-1/10.142.0.9:2181
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Socket connection established to test-1/10.142.0.9:2181, initiating session
2016-10-26 18:57:27 o.a.z.ClientCnxn [INFO] Session establishment complete on server test-1/10.142.0.9:2181, sessionid = 0x157fc2e050f0009, negotiated timeout =$
2016-10-26 18:57:27 b.s.d.nimbus [INFO] Starting Nimbus server...
这表明我的nimbus实例与zookeeper连接。但是,我对如何访问UI感到困惑。我尝试使用以下方式访问它:
http://[Public IP of Nimbus GCP Instance]:8080
我真的很感激任何帮助。关于在谷歌计算引擎上建立风暴,我没有遇到任何事情。我是Storm的相对新人。
由于
编辑:
gcloud compute firewall-rules list | grep 8080
nimbusui default 0.0.0.0/0 udp:8080,tcp:8080
在nimbus实例上,我尝试了:
netstat -l 8080
Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State tcp 0 0 *:ssh *:* LISTEN tcp6 0 0 [::]:ssh [::]:* LISTEN udp 0 0 *:42924 *:* udp 0 0 *:bootpc *:* udp 0 0 nimbus.c.ecg-sandbo:ntp *:* udp 0 0 localhost:ntp *:* udp 0 0 *:ntp *:* udp6 0 0 [::]:14994 [::]:* udp6 0 0 fe80::4001:aff:fe8e:ntp [::]:* udp6 0 0 ip6-localhost:ntp [::]:* udp6 0 0 [::]:ntp [::]:* Active UNIX domain sockets (only servers) Proto RefCnt Flags Type State I-Node Path unix 2 [ ACC ] STREAM LISTENING 10687 /var/run/dbus/system_bus_socket unix 2 [ ACC ] STREAM LISTENING 11147 /var/run/acpid.socket unix 2 [ ACC ] STREAM LISTENING 8751 @/com/ubuntu/upstart unix 2 [ ACC ] SEQPACKET LISTENING 9447 /run/udev/control
我还检查了ui.log:
2016-10-27 18:14:52 o.m.log [INFO] Logging to Logger[org.mortbay.log] via org.mortbay.log.Slf4jLog
2016-10-27 18:14:52 o.m.log [INFO] jetty-6.1.26
2016-10-27 18:14:52 o.m.log [INFO] Started SocketConnector@0.0.0.0:8080