Hive

Expand all | Collapse all

trying to move data out of qubole

  • 1.  trying to move data out of qubole

    Posted 11 days ago
    I am trying to move data from a hive table to a mysql database on a 6 hour cadence. The data to be moved is about an MB per cycle, and the mysql database is hosted on AWS. What is the best way to go about this?

    ------------------------------
    Abdullah Hasan
    ------------------------------


  • 2.  RE: trying to move data out of qubole

    Quboler
    Posted 11 days ago
    Hi Abdullah,

    Does the Qubole Data Export functionality work for your scenario? https://docs.qubole.com/en/latest/user-guide/handlingdata/data-export.html

    -MP


    ------------------------------
    Minesh Patel
    VP, Solutions Architecture
    Qubole
    CA
    ------------------------------



  • 3.  RE: trying to move data out of qubole

    Posted 10 days ago
    Edited by Abdullah Hasan 10 days ago
    Yes, both DBTAP and qubole data export seem to match my requirements. I wanted to know if either of those options is unsuitable for transferring to a mysql-type database, or deprecated or otherwise unfeasible, and if not then which of the 2 methods is more recommended.

    ------------------------------
    Abdullah Hasan
    ------------------------------