我试图在spark中执行我的本地java程序,它有依赖项,我尝试执行spark submit选项,如下所示:
spark-submit --class com.cerner.doc.DocumentExtractor /Users/sp054800/Downloads/Docs_lib_jar/Docs_RestAPI.jar
设置后
spark.driver.extraClassPath /Users/sp054800/Downloads/Docs_lib_jar/lib/*
spark.driver.extraLibraryPath /Users/sp054800/Downloads/Docs_lib_jar/lib/*
spark.executor.extraClassPath /Users/sp054800/Downloads/Docs_lib_jar/lib/*
spark.executor.extraLibraryPath /Users/sp054800/Downloads/Docs_lib_jar/lib/*
在spark-defaults.conf
,但仍然没有任何帮助,任何人都可以帮助我解决这个问题,我需要如何在火花中包含罐子。我使用的是spark2.2.0