CODEWITHSUNDEEP
mysqljdbcapache-spark
2shou
2shou

Reputation: 145

How to use Spark DataFrame with MySQL

OK, I have known that I could use jdbc connector to create DataFrame with this command:

val jdbcDF = sqlContext.load("jdbc", 
Map("url" -> "jdbc:mysql://localhost:3306/video_rcmd?user=root&password=123456",
"dbtable" -> "video"))

But I got this error: java.sql.SQLException: No suitable driver found for ...

And I have tried to add jdbc jar to spark_path with both commands but failed:

My Spark version is 1.3.0 while Class.forName("com.mysql.jdbc.Driver").newInstance is worked.

Upvotes: 0

Views: 2504

Answers (2)

hadoop bigdata
hadoop bigdata

Reputation: 16

You might want to try mysql-connector-java-5.1.29-bin.jar

Upvotes: 0

Prem Singh Bist
Prem Singh Bist

Reputation: 1313

It is caused because the data frame does the find the the Mysql Connector Jar in the class path. This can be resolved by adding the jar to the spark class path as below:

Edit /spark/bin/compute-classpath.sh as 

CLASSPATH="$CLASSPATH:$ASSEMBLY_JAR:yourPathToJar/mysql-connector-java-5.0.8-bin.jar"

Save the file and Restart the spark.

Upvotes: 1

Related Questions