Find solution
How to dump an HBase table?

How can I transfer data from Hive (external table) to Hbase?

  • I have an external table in Hive with 3 years of data. Hive works really well for me in cases of aggregation and all but in a lot of cases I need to search for some specific rows in the data and hive is very slow in that case if I don't specify any partition.  I am new to HBase and tried bulk load using 'importtsv' but facing some issues in that. I was wondering if there is a better way for that.

  • Answer:

    This link should be able to help. http://mevivs.wordpress.com/2010/11/24/hivehbase-integration/

Afroz Mohammad at Quora Visit the source

Was this solution helpful to you?

Other answers

importtsv utility is for loading data in TSV format into Hbase. This works fine, but the issue which I faced was the preformance is very slow. Writing own Map Reduce code to bulk load works much better then importtsv though it also uses mapreduce. Coming to your problem statement, Hive-Hbase integration will be the right approach. I have worked with migrating 400 million data from Hive to Hbase and works well.

Sreejith Pillai

Related Q & A:

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.