Support Questions
Find answers, ask questions, and share your expertise

Which is best method for taking backup of hbase data?

Solved Go to solution

Which is best method for taking backup of hbase data?

Hi,

Can anyone suggest me which is best method for taking backup of hbase data among distcp, copyTable, export/import, cluster replication?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Which is best method for taking backup of hbase data?

Hi @Rushikesh Deshmukh, for a list of backup options check this. CopyTable is a nice option, using multiple mappers, you can copy individual tables to the same or another cluster. You can miss a few edits but you will end up with a useful copy.

View solution in original post

12 REPLIES 12
Highlighted

Re: Which is best method for taking backup of hbase data?

You can use snapshots to take backup https://hbase.apache.org/book.html#ops.snapshots

Highlighted

Re: Which is best method for taking backup of hbase data?

@Rajeshbabu Chintaguntla, can you please explain what are advantages of using snapshots over other methods and also provide command to be used for taking snapshots?

Highlighted

Re: Which is best method for taking backup of hbase data?

@Rajeshbabu Chintaguntla, thanks for sharing this info. and link.

Highlighted

Re: Which is best method for taking backup of hbase data?

Preference wise (as Impact on running cluster will also be very less):-

cluster replication:- If requirement is to recover in realtime and new cluster can be afforded.

export snapshot:- if recovery to last taken snapshot is fine and cost of this approach is less as you can export it to any cheap storage(hdfs,s3 or anything). But with this incremental backup will not be possible, old backups will become obsolete with the new.

Highlighted

Re: Which is best method for taking backup of hbase data?

@ asinghal, thanks for sharing this useful information.

Highlighted

Re: Which is best method for taking backup of hbase data?

Contributor

Hi Rushikesh,

Suggest you to go through this article might be helpful:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_hbase_snapshots_guide/content/ch_hbase_s...

Regards,

Karthik Gopal

Highlighted

Re: Which is best method for taking backup of hbase data?

Contributor

HBase Snapshots allow you to take a snapshot of a table without much impact on Region Servers. Snapshot, clone, and restore operations don't involve data copying. In addition, exporting a snapshot to another cluster has no impact on region servers.

Highlighted

Re: Which is best method for taking backup of hbase data?

@Karthik Gopal

thanks for reply, found some useful information on given link. Does hbase_snapshots is best method for backup on live environment?

Highlighted

Re: Which is best method for taking backup of hbase data?

Hi @Rushikesh Deshmukh, for a list of backup options check this. CopyTable is a nice option, using multiple mappers, you can copy individual tables to the same or another cluster. You can miss a few edits but you will end up with a useful copy.

View solution in original post