question Re: Export HBase data to csv in Support Questions

Export HBase data to csv

sunile_manjee — Sun, 15 May 2016 08:40:10 GMT

How to export hbase data to csv? Table or entire database (table by table). I have always used/built a map/reduce job to do this. However, I understand apache Pherf has these capabilities. I have also used phoenix to create csv:

 1. !outputformat csv
>>>> 2. !record data.csv
>>>> 3. select * from mytable;
>>>> 4. !record
>>>> 5. !quit

I have also used hbase export table which create a hadoop sequence file on a target hdfs directory. I basically create a hive table on top of this sequence file and select * into another table which uses csv storage/file format. This requires a few steps and not too complicated.

How else folks? I am looking for the "easy" button here.

Re: Export HBase data to csv

pminovic — Sun, 15 May 2016 14:17:02 GMT

You can create a Hive external table mapped onto your HBase table using HBaseStorageHandler, see the example at the end of the Usage section, and then, as what you did with your Sequence file, "select *" from this table into a csv table (stored as textfile fields terminted by ',').

Re: Export HBase data to csv

TimothySpann — Sun, 15 May 2016 19:07:24 GMT

You can also use HDF or Spark if you need to do some interesting things with it

Re: Export HBase data to csv

rchoksi — Mon, 16 May 2016 02:08:00 GMT

@Sunile Manjee Try the Export utility tool that comes as part of HBase, that exports it into hdfs. Try something like following

bin/hbase org.apache.hadoop.hbase.mapreduce.Export table_name file:///tmp/db_dump/

It can also be done using happybase library. Here's an example

https://gist.github.com/srs81/5504396

Re: Export HBase data to csv

aervits — Thu, 19 May 2016 05:18:42 GMT

For easy button, read with Pig using HBaseStorageHandler and write to PigStorage or CSVExcelStorage

https://pig.apache.org/docs/r0.11.0/api/org/apache/pig/backend/hadoop/hbase/HBaseStorage.html

https://pig.apache.org/docs/r0.12.0/api/org/apache/pig/piggybank/storage/CSVExcelStorage.html

Re: Export HBase data to csv

mrizvi — Mon, 13 Jun 2016 23:34:52 GMT

Hi @Sunile Manjee,

I am following a hbase export table technique. I did an export, created a hive table stored as sequencefile but if I am loading the sequence file data into Hive table, its giving me the error:

java.lang.RuntimeException: java.io.IOException: WritableName can't load class: org.apache.hadoop.hbase.io.ImmutableBytesWritable

It would be really helpful if you let me know the solution. Thanks.

Re: Export HBase data to csv

sunile_manjee — Tue, 14 Jun 2016 02:59:20 GMT

@mrizvi

Do you mind opening a seperate HCC post on your question?

Re: Export HBase data to csv

mrizvi — Tue, 14 Jun 2016 03:28:48 GMT

Sure @Sunile Manjee, let me do it.

Re: Export HBase data to csv

shouvanik_halda — Thu, 05 Oct 2017 00:59:37 GMT

I am getting mapreduce error. It starts, but fails within a few minutes. do you have a working example?

Re: Export HBase data to csv

Aj09 — Mon, 23 Jun 2025 06:03:27 GMT

Hello @sunile_manjee Sir,

I have used above commands and I am able to export the data into csv, But it the data is enclosed in quotes, (mentioned below). Is there a way to get the data without 'quotes' and also the generated file has Header, is there a way to generate the file without Header.

Appreciate your help. Thanks

'Column1', 'Column2'

'Data1', 'Data2'