Reply
New Contributor
Posts: 5
Registered: ‎11-16-2016

hbase export issue

Hello

 

We now have a problem about hbase export.

 

We follow these process to export hbase table:

 

(1)We change the hdfs permissions  to drwxrwxr-x by executing command "sudo -u hdfs hdfs dfs -chmod 775 /".

 

(2)excute the command:"hbase org.apache.hadoop.hbase.mapreduce.Export 'test' file:///tmp/hbase123/" to export hbase table to /tmp

 

(3)back up the file on /tmp

 

The problem is the log message show the mission is successed:

"17/04/18 11:58:51 INFO mapreduce.Job: Job job_1484613653857_0370 completed successfully"

 

But the file "hbase123" on /tmp is empty!!

 

Is there any read/write permissions issue?

Highlighted
Posts: 1,483
Kudos: 241
Solutions: 225
Registered: ‎07-31-2013

Re: hbase export issue

You cannot use file:// with distributed map-reduce. The tasks run on
random* hosts so file:// would mean the write is done to some local path on
hosts where the tasks run.

Please use hdfs:// tmp path, and then download via hadoop fs -get
/hdfs-tmp-path/ /local-tmp-path/ after job.
Backline Customer Operations Engineer
Announcements