在DCOS中安装Flink时出错

时间:2017-07-29 17:17:25

标签: digital-ocean apache-flink dcos

我已使用以下配置在DigitalOcean上部署DCOS

digitalocean_token = "***"

region = "fra1"

master_size = "4GB"

agent_size = "4GB"

boot_size = "4GB"

dcos_cluster_name = "digitalocean-dcos"

dcos_master_count = "1"

dcos_agent_count = "4"

dcos_public_agent_count = "1"

dcos_installer_url = "https://downloads.dcos.io/dcos/stable/dcos_generate_config.sh"

dcos_ssh_key_path = "./do-key"

dcos_ssh_public_key_path = "./do-key.pub"

ssh_key_fingerprint = "***"

通过GUI和DCOS CLI安装Flink都失败了。

显然错误是这样的:

2017-07-29 17:10:05,553 ERROR org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - Mesos JobManager initialization failed
java.net.UnknownHostException: digitalocean-dcos-agent-00: digitalocean-dcos-agent-00: Name or service not known
    at java.net.InetAddress.getLocalHost(InetAddress.java:1505)

从这里复制: 弗林克 - mesos-appmaster-digitalocean-DCOS剂-00.log

2017-07-29 17:10:04,930 WARN  org.apache.hadoop.util.NativeCodeLoader                       - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-07-29 17:10:05,223 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - --------------------------------------------------------------------------------
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Starting Mesos AppMaster (Version: 1.3.1, Rev:1ca6e5b, Date:20.06.2017 @ 10:08:43 PDT)
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Current user: root
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.111-b14
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Maximum heap size: 880 MiBytes
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64/jre
2017-07-29 17:10:05,229 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Hadoop version: 2.3.0
2017-07-29 17:10:05,229 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  JVM Options:
2017-07-29 17:10:05,229 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dlog.file=/mnt/mesos/sandbox/flink--mesos-appmaster-digitalocean-dcos-agent-00.log
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dlog4j.configuration=file:/flink-1.3.1/conf/log4j.properties
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dlogback.configurationFile=file:/flink-1.3.1/conf/logback.xml
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Program Arguments:
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dblob.server.port=20262
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Djobmanager.heap.mb=256
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Djobmanager.rpc.port=20261
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Djobmanager.web.port=20260
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.artifact-server.port=20263
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.initial-tasks=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.resourcemanager.tasks.cpus=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.resourcemanager.tasks.mem=1024
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dtaskmanager.heap.mb=512
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dtaskmanager.memory.preallocate=true
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dtaskmanager.numberOfTaskSlots=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dparallelism.default=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.resourcemanager.framework.role=*
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dsecurity.kerberos.login.use-ticket-cache=true
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Classpath: /flink-1.3.1/lib/flink-python_2.10-1.3.1.jar:/flink-1.3.1/lib/flink-shaded-hadoop2-uber-1.3.1.jar:/flink-1.3.1/lib/log4j-1.2.17.jar:/flink-1.3.1/lib/slf4j-log4j12-1.7.7.jar:/flink-1.3.1/lib/flink-dist_2.10-1.3.1.jar::/etc/hadoop/conf/:
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - --------------------------------------------------------------------------------
2017-07-29 17:10:05,234 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - Registered UNIX signal handlers for [TERM, HUP, INT]
2017-07-29 17:10:05,252 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.master, zk://leader.mesos:2181/mesos
2017-07-29 17:10:05,252 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.failover-timeout, 60
2017-07-29 17:10:05,254 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.initial-tasks, 1
2017-07-29 17:10:05,254 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.type, mesos
2017-07-29 17:10:05,254 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.image.name, openjdk:8-jre
2017-07-29 17:10:05,255 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.cpus, 1
2017-07-29 17:10:05,255 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.mem, 1024
2017-07-29 17:10:05,257 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.rpc.port, 6123
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.heap.mb, 256
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.heap.mb, 512
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.memory.preallocate, false
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: parallelism.default, 1
2017-07-29 17:10:05,259 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.web.port, 8081
2017-07-29 17:10:05,306 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.master, zk://leader.mesos:2181/mesos
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.failover-timeout, 60
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.initial-tasks, 1
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.type, mesos
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.image.name, openjdk:8-jre
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.cpus, 1
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.mem, 1024
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.rpc.port, 6123
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.heap.mb, 256
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.heap.mb, 512
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.memory.preallocate, false
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: parallelism.default, 1
2017-07-29 17:10:05,309 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.web.port, 8081
2017-07-29 17:10:05,402 INFO  org.apache.flink.runtime.security.modules.HadoopModule        - Hadoop user set to root (auth:SIMPLE)
2017-07-29 17:10:05,553 ERROR org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - Mesos JobManager initialization failed
java.net.UnknownHostException: digitalocean-dcos-agent-00: digitalocean-dcos-agent-00: Name or service not known
    at java.net.InetAddress.getLocalHost(InetAddress.java:1505)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner.runPrivileged(MesosApplicationMasterRunner.java:216)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner$1.call(MesosApplicationMasterRunner.java:181)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner$1.call(MesosApplicationMasterRunner.java:178)
    at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
    at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner.run(MesosApplicationMasterRunner.java:178)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner.main(MesosApplicationMasterRunner.java:139)
Caused by: java.net.UnknownHostException: digitalocean-dcos-agent-00: Name or service not known
    at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
    at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
    at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
    at java.net.InetAddress.getLocalHost(InetAddress.java:1500)
    ... 10 more

记录(这是无限循环)

+ '[' '' '!=' '' ']'
+ add_mesos_configurations
++ hostname -f
hostname: Name or service not known
+ add_if_non_empty jobmanager.rpc.address
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.role '*'
+ '[' -n '*' ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ add_if_non_empty mesos.resourcemanager.framework.principal ''
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.secret ''
+ '[' -n '' ']'
+ add_ssl_configurations
+ [[ '' == true ]]
+ add_kerberos_configurations
+ add_if_non_empty security.kerberos.login.use-ticket-cache true
+ '[' -n true ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ '[' '' '!=' '' ']'
+ add_if_non_empty security.kerberos.login.principal ''
+ '[' -n '' ']'
+ [[ '' != '' ]]
+ update_log_level
+ [[ INFO != '' ]]
+ sed -ie 's/log4j.rootLogger=INFO, file/log4j.rootLogger=INFO, file/g' /flink-1.3.1/conf/log4j.properties
+ exec /flink-1.3.1/bin/mesos-appmaster.sh -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 '-Dmesos.resourcemanager.framework.role=*' -Dsecurity.kerberos.login.use-ticket-cache=true
+ FLINK_SECURITY_DIR=/etc/security/flink
+ mkdir -p /etc/security/flink
+ export APPLICATION_WEB_PROXY_BASE=/service/flink
+ APPLICATION_WEB_PROXY_BASE=/service/flink
+ add_flink_configurations
+ export FLINK_JAVA_OPTS=
+ FLINK_JAVA_OPTS=
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1'
+ '[' '' '!=' '' ']'
+ add_mesos_configurations
++ hostname -f
hostname: Name or service not known
+ add_if_non_empty jobmanager.rpc.address
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.role '*'
+ '[' -n '*' ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ add_if_non_empty mesos.resourcemanager.framework.principal ''
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.secret ''
+ '[' -n '' ']'
+ add_ssl_configurations
+ [[ '' == true ]]
+ add_kerberos_configurations
+ add_if_non_empty security.kerberos.login.use-ticket-cache true
+ '[' -n true ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ '[' '' '!=' '' ']'
+ add_if_non_empty security.kerberos.login.principal ''
+ '[' -n '' ']'
+ [[ '' != '' ]]
+ update_log_level
+ [[ INFO != '' ]]
+ sed -ie 's/log4j.rootLogger=INFO, file/log4j.rootLogger=INFO, file/g' /flink-1.3.1/conf/log4j.properties
+ exec /flink-1.3.1/bin/mesos-appmaster.sh -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 '-Dmesos.resourcemanager.framework.role=*' -Dsecurity.kerberos.login.use-ticket-cache=true

我得到一个持续运行"部署1 of 1"状态不健康。

另一方面,安装其他软件包如Kafka和Redis也会成功。

3 个答案:

答案 0 :(得分:2)

我正在处理本地安装并遇到类似的错误。事实证明CentOS 7在安装过程中不会将其主机名添加到/ etc / hosts文件中。我只需添加行

127.0.0.1 myhostname

或者将主机名添加到该行(如果已存在)

立即开始工作

答案 1 :(得分:1)

针对AWS的疑难解答下的here解释了该问题。虽然可以适应DigitalOcean。

引用上面的链接:

  

在JobMaster无法执行的情况下可能会出现这种情况   解析其主机名。这导致TaskManager容器   启动以永远不与JobManager和群集通信   永远不会进入准备状态。在日志中将包含一些东西   类似于

2017-07-29 17:10:05,553 ERROR org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner - Mesos JobManager initialization failed
java.net.UnknownHostException: agentname: agentname: Name or service not known
at java.net.InetAddress.getLocalHost(InetAddress.java:1505)
     

可以通过enabling "DNS Hostname" support in the VPC解决此问题。

aws ec2 modify-vpc-attribute --vpc-id vpc-a01106c2 --enable-dns-hostnames "{\"Value\":true}"

答案 2 :(得分:0)

我认为这是由于几天前修复的dcos-flink软件包中的一个错误。

fix: Set jobmanger.rpc.address to current host

假设尚未将修复程序部署到您的DCOS Universe。