您好,我正在尝试从EMR齐柏林飞艇笔记本计算机连接到Redshift,并且我已经添加了必要的jar,这是会话的开始,但是我仍然在笔记本中发现类未找到错误。
%spark.dep
z.reset()
z.load("https://bucket_name/dev/jars/RedshiftJDBC41-1.2.12.1017.jar")
z.load("https://bucket_name/dev/jars/spark-redshift_2.11-3.0.0-preview1.jar")
z.load("https://bucket_name/dev/jars/spark-avro_2.11-2.4.7.jar")
%spark
import org.apache.spark.sql._
import org.apache.spark.sql.DataFrame
val df: DataFrame = spark.read
.format("com.databricks.spark.redshift")
.option("url", "jdbc:redshift://hostname:5439/cdw?user=username&password=pass")
.option("query", "select * from game.title t where id in (1335, 1911, 1265, 1679, 2017, 1405, 2025);")
.option("tempdir", "s3n://bucket_name/dev")
.load()