即使添加罐子,在EMR齐柏林飞艇上也找不到类

时间:2020-10-16 17:48:26

标签: apache-spark amazon-emr apache-zeppelin

您好,我正在尝试从EMR齐柏林飞艇笔记本计算机连接到Redshift,并且我已经添加了必要的jar,这是会话的开始,但是我仍然在笔记本中发现类未找到错误。

%spark.dep
z.reset()
z.load("https://bucket_name/dev/jars/RedshiftJDBC41-1.2.12.1017.jar")
z.load("https://bucket_name/dev/jars/spark-redshift_2.11-3.0.0-preview1.jar")
z.load("https://bucket_name/dev/jars/spark-avro_2.11-2.4.7.jar")
%spark
import org.apache.spark.sql._
import org.apache.spark.sql.DataFrame

val df: DataFrame = spark.read
  .format("com.databricks.spark.redshift")
  .option("url", "jdbc:redshift://hostname:5439/cdw?user=username&password=pass")
  .option("query", "select * from game.title t where id in (1335, 1911, 1265, 1679, 2017, 1405, 2025);")
  .option("tempdir", "s3n://bucket_name/dev")
  .load()

enter image description here

0 个答案:

没有答案