无法使用Java SocketFactory Library连接到Cloud SQL

时间:2017-07-12 10:01:06

标签: java scala maven apache-spark

我正在尝试使用我的java代码连接到Cloud SQL(Mysql)。我收到以下错误 -

com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Could not create socket factory 'com.google.cloud.sql.mysql.SocketFactory' due to underlying exception: 
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: com.google.cloud.sql.mysql.SocketFactory

这是我的代码 -

package utils
import java.sql.DriverManager
import java.sql.Connection
import scala.collection.mutable.ListBuffer
import entity.AnalyticFieldEntity
import compute.driver.AnalyticTools
import entity.ErrorHandlingEntity

object ScalaDbConnect {

    def getAnalyticBatchMap(toolId : Int, paramMap: Map[String, String]): Map[String, Int] = {
    val methodName = "getAnalyticBatchMap"
    val errorMode = paramMap.get("mode")+"("+paramMap.get("analyticSource")+")"

    val dbTuple = DbPropertiesReader.getDbProperties()


      val databaseName = dbTuple._3
      val instanceConnectionName = dbTuple._4
      val username= dbTuple._1
      val password= dbTuple._2


    var connection: Connection = null
    val analyticMap = collection.mutable.Map.empty[String, Int]
    try {
      //[START doc-example]
      val jdbcUrl = String.format(
        "jdbc:mysql://google/%s?cloudSqlInstance=%s&"
            + "socketFactory=com.google.cloud.sql.mysql.SocketFactory", databaseName, instanceConnectionName);

      println(jdbcUrl);
      //Class.forName("com.mysql.jdbc.GoogleDriver");
      val connection = DriverManager.getConnection(jdbcUrl, username, password);
      println(connection);

    //[END doc-example]

      try 
      {

        val statement = connection.createStatement()
        val resultSet = statement.executeQuery("SELECT omnitureColumnHeader.columnHeaderId, case when analyticFieldMap.isTag = 1 then concat(\"tag_\",analyticFieldMap.entityField) else  " +
        "analyticFieldMap.entityField  end as entityField FROM omnitureColumnHeader INNER JOIN analyticFieldMap ON " +
        "analyticFieldMap.analyticFieldBatch=omnitureColumnHeader.columnHeaderValue where analyticFieldMap.toolId = " + toolId);

        System.out.println("resultSet: 2" + statement);
        System.out.println("statement: 2" + resultSet);


        while (resultSet.next()) {

                    System.out.println("inside the content loop: 2");
          analyticMap += resultSet.getString("entityField") -> resultSet.getInt("columnHeaderId")


           }


        System.out.println("analyticMap: 2" + analyticMap);
    }
      catch
      {
         case _: Throwable => println("Got some other kind of exception")
      }


    } catch {
      case e: Exception =>
               val errorHandlingEntity = new ErrorHandlingEntity()
                  errorHandlingEntity.Mode=errorMode
                  errorHandlingEntity.Tool=paramMap.get("tool").toString()
                  errorHandlingEntity.Message="DB Connection Issue"
                  errorHandlingEntity.Trace=e.printStackTrace().toString()
                  errorHandlingEntity.Source = "Spark"
                  errorHandlingEntity.YarnAppId=paramMap.get("appID").toString()
                  errorHandlingEntity.MethodName=methodName
                  errorHandlingEntity.ReThrow = true
                  errorHandlingEntity.CurrentException=e

                  ErrorHandlingFramework.HandleException(errorHandlingEntity)
    }
    connection.close()

    analyticMap.toMap

  }
}

我在POM.XML中添加了以下详细信息

<dependency>
    <groupId>com.google.cloud.sql</groupId>
    <artifactId>mysql-socket-factory</artifactId>
    <version>1.0.3</version>
</dependency>

这是完整的POM.XML - https://pastebin.com/jvxSBZMX

我正在尝试使用我的scala代码连接到Google Cloud SQL,而我正在使用JAVA API(S)。 我面临的问题表明,我无法访问正确的连接类。

任何帮助将不胜感激。

期待解决方案。

谢谢,

1 个答案:

答案 0 :(得分:0)

问题在于google云如何运行maven Build。

它无法从构建中读取类,因此我使用扩展名--JARS传递了这些JAR文件。

这解决了我的问题。