如何使用spark-shell导入自己的scala包？

Question

我为spark-ml库编写了一个类，它使用了另一个类。 如果要清楚，我的类是RandomForestClassifier的包装器。 现在我希望有机会从spark-shell导入这个类。

所以问题是：如何使包含我自己的类的包能够从spark-shell导入？非常感谢！

Answer 1

如果要导入Hello.scala等未编译的文件，请在下面的spark shell中执行：

scala> :load ./src/main/scala/Hello.scala

Answer 2

阅读文档：

  

In the Spark shell, a special interpreter-aware SparkContext is already created for you, in the variable called sc. Making your own SparkContext will not work. You can set which master the context connects to using the --master argument, and you can add JARs to the classpath by passing a comma-separated list to the --jars argument. You can also add dependencies (e.g. Spark Packages) to your shell session by supplying a comma-separated list of maven coordinates to the --packages argument. Any additional repositories where dependencies might exist (e.g. SonaType) can be passed to the --repositories argument.