Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

OOZIE Hbase MapReduce job scheduling

OOZIE Hbase MapReduce job scheduling

Explorer

CHD 5.4.0 

 

We have Hbase MapReduce job which scans two Hbase tables and passes the List of scan object to TableMapReduceUtil.initTableMapperJob(scans,MyMpper.class,Text.class,Text.class,job)

 

We are facing issues scheduling this job in oozie as MR action.

 

Any Help is appreciated 

 

 

3 REPLIES 3

Re: OOZIE Hbase MapReduce job scheduling

Master Guru
Have you gone over this section of the docs that talk about how to reuse
your existing driver code for an MR action?
http://archive.cloudera.com/cdh5/cdh/5/oozie/WorkflowFunctionalSpec.html#a3.2.2.2_Configuring_the_Ma...

If you're already doing that, what error do you get?

Re: OOZIE Hbase MapReduce job scheduling

Explorer

Thanks Harsh,

 

We are using below Oozie configuration which works for single table scan input, how do we provide multiple table scan input in Oozie ( using Map Reduce Action)

 

Are you saying to use Java Action with OozieActionConfigurator ?

 

 

<!-- HBASE CONFIGURATIONS -->
                <property>
                    <name>hbase.mapreduce.inputtable</name>
                    <value>${MAPPER_INPUT_TABLE}</value>
                </property>
                <property>
                    <name>hbase.mapreduce.scan</name>
                    <value>${wf:actionData('get-scanner')['scan']}</value>
                </property>
                <property>
                    <name>hbase.zookeeper.property.clientPort</name>
                    <value>${hbaseZookeeperClientPort}</value>
Highlighted

Re: OOZIE Hbase MapReduce job scheduling

Explorer

We used Java action to call MR TableMapper job whch scans two tables, there was no need to pass 

hbase.mapreduce.scan property as in MR action