How to migrate data from mySQL to PostgreSQL?

What tools are available for migrating data from Cassandra to MySQL?

  • We're using Cassandra for data store, but want to migrate data out of Cassandra and into MySQL on a daily basis so that marketing/product users can query data independently using an SQL syntax.   Any advice here?

  • Answer:

    For large amounts of Data (stored in Cassandra) you might want to look into using Brisk (for Hive and Pig support or just for export) or implementing your own map-reduce style ETL layer to get your files into a format that MySQL or another relational store can read. If you don't have that much data stored in Cassandra you could extract the data a manner similar to SSTable2Json. If you go that route take a look at the code in SSTableExport.SerializeRow.

Ben Coverston at Quora Visit the source

Was this solution helpful to you?

Other answers

This is an excellent question and one I've been waiting a while to see. Having been involved in 2 migrations (one from Oracle to SimpleDB, another from SimpleDB to Cassandra), data migration is a near and dear topic. Especially data migration with zero downtime to a service, zero data loss or corruption, and for data sets getting tens of thousands of writes per second. My first 2 migrations were possible because I was able to simulate a time-sorted change stream. This was made possible by SQL + an index on a timestamp column + a trigger to update the time on all database changes. I've been wondering how such migrations will take place in the future without having such a "time-oriented log replication stream" in near-real time.

Siddharth Anand

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.