question Re: Full HBase backup/restore to external appliance in Support Questions

Full HBase backup/restore to external appliance

gary_cameron — Fri, 16 Sep 2022 10:11:35 GMT

I would like to export HBase snapshot data to a backup appliance outside of hdfs for disaster recovery.

I can use ExportSnapshot to export the table to a non hdfs URI, no problem.

But there is no ImportSnapshot - if I try to use ExportSnapshot to bring it back from the external source outside the cluster, using --copy-from <Backup-appliance-URI>/hbase and --copy-to /hbase complains about an unexpected (non hdfs) URI.

If I use DistCp to copy it to a staging area on the hdfs cluster first then use ExportSnapshot to bring it back it works but is undesirable because I need to create a temporary staging area.

I found I was able to use DistCp directly on the exported snapshot and copy it back to hdfs://hbase and restore the table. This looks like a good solution and seems to work, but are there any unexpected problems I can run into? Is this a recommended approach?

Re: Full HBase backup/restore to external appliance

aervits — Wed, 30 Mar 2016 10:33:32 GMT

I would only want to make sure the permissions on the file would match the permissions on the appliance, i had issues with Isilon messing up my ACL going back and forth between OneFS and hdfs. Use the same user in both locations, i dont see a problem with distcp approach.

Re: Full HBase backup/restore to external appliance

gary_cameron — Fri, 22 Apr 2016 01:53:05 GMT

Sorry, one related problem, can ExportSnapshot be passed an external .jar and library files using -files and -libjars to support the external filesystem as can be done with DistCp?If not, is there any other way to make ExportSnapshot work if the DistCp operation needs an external .jar and libraries?

Re: Full HBase backup/restore to external appliance

aervits — Fri, 22 Apr 2016 15:41:25 GMT

I never had a use case where I needed to include 3rd party jars in exportsnapshot or distcp. It's a MR job so it should include, check in the options of the command and absolutely paste the command here if you get a solution.

Re: Full HBase backup/restore to external appliance

gary_cameron — Sat, 23 Apr 2016 02:23:17 GMT

Actually, I checked that ExportSnapshot includes the Tools interface, hence it does support -files and -libjars so I think the approach is still good. Sorry, false panic.