AWS

Expand all | Collapse all

Driver error while loading to AWS RDS SQL Server

  • 1.  Driver error while loading to AWS RDS SQL Server

    Posted 24 days ago
    We are running our spark job loading to AWS RDS SQL Server database with the following spark-submit command.
    /usr/lib/spark/bin/spark-submit --class com.abc.SimplePrint --driver-class-path s3://<path>/mssql-jdbc-7.2.2.jre8.jar --jars s3://<path>/mssql-jdbc-7.2.2.jre8.jar s3://<path>/SimplePrint.jar

    We are receiving the below error message. The same command works perfectly fine while run in AWS EMR.

    Exception in thread "main" java.sql.SQLException: No suitable driver

    We tried passing the JDBC jar as --conf "spark.driver.extraClassPath=mssql-jdbc-7.2.2.jre8.jar"  as an alternate option. But, this does not resolve the issue. 

    ------------------------------
    Selvaratna Ramasamy Pandian
    ------------------------------


  • 2.  RE: Driver error while loading to AWS RDS SQL Server

    Quboler
    Posted 23 days ago

    Can you please share more information like CommandId and URL of the platform you have tried running the spark job.

    Thank you for posting your query in the Qubole community.



    ------------------------------
    Surya Turaga
    ------------------------------