How to specify a user when submitting a spark job to Mesos

时间:2016-07-11 19:23:22

标签: apache-spark mesos

We need to submit a spark job to a mesos cluster to run as another user. Specifying --proxy-user doesn't seem to work

./spark-submit  --deploy-mode cluster --master mesos://XXX:7077 --proxy-user userX

Is there another way to do that?

1 个答案:

答案 0 :(得分:0)

是的,有以下链接: http://mesos.apache.org/documentation/latest/configuration/ 使用以下选项

--hostname=VALUE 

当留空时,将从IP地址解析主机名。我知道这与proxy-user相比有点不同

如果您想阻止用户使用用户界面,您可以使用ACL https://apache.googlesource.com/spark/+/master/docs/security.md