试图在本地风暴码头工人容器上提交streamparse wordcount示例

时间:2018-06-16 19:01:33

标签: docker docker-compose apache-storm streamparse

我正在尝试在带有docker容器的本地群集上使用streamparse

这是我的docker-compose.yml

version: '3' services: zookeeper: image: zookeeper container_name: zookeeper nimbus: image: storm:1.0.2 container_name: nimbus command: storm nimbus depends_on: - zookeeper supervisor: image: simsimy/docker-storm-supervisor-with-streamparse container_name: supervisor command: storm supervisor depends_on: - nimbus - zookeeper storm-ui: image: storm:1.0.2 container_name: storm-ui command: storm ui depends_on: - nimbus - zookeeper - supervisor

streamparse示例是开箱即用的(使用“sparse quickstart wordcount”命令创建)

我刚刚更改了wordcount quickstart示例中的一些参数以匹配我的风暴版本1.0.2(在project.clj文件中)

顺便说一句,如果你有另一个风暴版本的解决方案,我可以改变我的

这是我的config.json:

{ "serializer": "json", "topology_specs": "topologies/", "virtualenv_specs": "virtualenvs/", "envs": { "prod": { "user": "", "ssh_password": "", "nimbus": "localhost", "workers": ["localhost"], "log": { "path": "", "max_bytes": 1000000, "backup_count": 10, "level": "info" }, "use_virtualenv": true, "virtualenv_root": "/home/myhome/virtualenvs" } } }

./ wordcount / virtualenvs / wordcount.txt仅包含“steamparse”(开箱即用的配置文件)

当我运行Sparse submit时,拓扑失败并显示消息:

java.io.IOException: Cannot run program "/home/myhome/virtualenvs/wordcount/bin/streamparse_run" (in directory "/data/supervisor/stormdist/wordcount-10-1529168923/resources")

我已经检查过/ data / supervisor / stormdist / wordcount-10-1529168923 / resources目录,它只包含spout和bolt ...

仅当我设置“use_virtualenv”时,拓扑才有效:false

以下是依赖项收集的日志文件: https://pastebin.com/Tf48kpBb

非常感谢任何帮助

由于

0 个答案:

没有答案