Support Questions
Find answers, ask questions, and share your expertise

I am trying to load bulk data to hbase by using a custom input format in my configured class.But it gives me error class not found exception.

hi all, i want to bulkload data in hbase and i am doing this by using mapreduce. i use HFileOutputFormat2.configureIncrementalLoad for this and instead of using normal inputformat i am creating my own custominputformat by extending combine input format. when i am making a fat jar and trying to run this jar then i am getting classnot found exception for this custom class. may be hbase api is not able to find it. how can i fix it.please help java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.rupesh.practice.main.WholeFileInputFormat not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2208) at org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:174) at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:779) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:452) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:410) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:391) at com.abnamro.drm.hortonworks.metadataloader.BulkLoader.runforMapperExtended(BulkLoader.java:181) at com.abnamro.drm.hortonworks.metadataloader.BulkLoader.runForMapper(BulkLoader.java:152) at com.abnamro.drm.hortonworks.metadataloader.BulkLoader.run(BulkLoader.java:94) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at com.abnamro.drm.hortonworks.metadataloader.BulkLoader.loadMetadata(BulkLoader.java:72) at com.abnamro.drm.hortonworks.metadataloader.BulkLoadMain.main(BulkLoadMain.java:26) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: java.lang.ClassNotFoundException: Class com.rupesh.practice.main.WholeFileInputFormat not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2114) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2206) ... 17 more

1 REPLY 1

Can you share your Driver class code & custom input class for this MapReduce implementation ?

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.