Cloud AWS

Expand all | Collapse all

Driver error while loading to AWS RDS SQL Server

  • 1.  Driver error while loading to AWS RDS SQL Server

    Posted 06-25-2019 05:46
    We are running our spark job loading to AWS RDS SQL Server database with the following spark-submit command.
    /usr/lib/spark/bin/spark-submit --class com.abc.SimplePrint --driver-class-path s3://<path>/mssql-jdbc-7.2.2.jre8.jar --jars s3://<path>/mssql-jdbc-7.2.2.jre8.jar s3://<path>/SimplePrint.jar

    We are receiving the below error message. The same command works perfectly fine while run in AWS EMR.

    Exception in thread "main" java.sql.SQLException: No suitable driver

    We tried passing the JDBC jar as --conf "spark.driver.extraClassPath=mssql-jdbc-7.2.2.jre8.jar"  as an alternate option. But, this does not resolve the issue. 

    ------------------------------
    Selvaratna Ramasamy Pandian
    ------------------------------


  • 2.  RE: Driver error while loading to AWS RDS SQL Server

    Quboler
    Posted 06-26-2019 21:21

    Can you please share more information like CommandId and URL of the platform you have tried running the spark job.

    Thank you for posting your query in the Qubole community.



    ------------------------------
    Surya Turaga
    ------------------------------