Member since
04-11-2022
1
Post
0
Kudos Received
0
Solutions
04-11-2022
01:24 PM
Hi, I am trying to export large hbase table into sequence files. Our requirement is to split the sequence files with specific size limit. We have tried multiple options but output part files are getting generated with large size like 6-7 GB. We used the below sample export command which trying to generate sequence file in a range of 100mb - 135mb, but didn't work as expected. hbase org.apache.hadoop.hbase.mapreduce.Export -D dfs.blocksize=1048576 -D mapred.min.split.size=102400 -D mapred.max.split.size=1048576 \table_name /output/hbase/ Could you please help me here to export the table into small chunks ?
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache HBase