How to pass parameter in spark submit which does not start with spark

Question

We can use --conf spark.app.country=US to send parameters to source code in spark submit shell command. But for configurations like oracle.net.tns_admin and java.security.egd they do not start with spark. So, how do you send these parameters?

With out using extraJavaOptions can I send these as I do not want to send these like env parameters

Answer 1

Spark conf参数是专门为Spark配置（否则可能会放在spark-defaults.conf中的键）设计的。

不要与泛型属性一起使用（尽管可以在自定义配置中使用spark前缀，只要它不与实际的Spark配置冲突即可）。

如果您想提供通用配置，则可以使用特定于您选择的语言的Spark独立实用程序。