Reply
Explorer
Posts: 9
Registered: ‎06-02-2016

OOZIE Hbase MapReduce job scheduling

CHD 5.4.0 

 

We have Hbase MapReduce job which scans two Hbase tables and passes the List of scan object to TableMapReduceUtil.initTableMapperJob(scans,MyMpper.class,Text.class,Text.class,job)

 

We are facing issues scheduling this job in oozie as MR action.

 

Any Help is appreciated 

 

 

Posts: 1,903
Kudos: 435
Solutions: 307
Registered: ‎07-31-2013

Re: OOZIE Hbase MapReduce job scheduling

Have you gone over this section of the docs that talk about how to reuse
your existing driver code for an MR action?
http://archive.cloudera.com/cdh5/cdh/5/oozie/WorkflowFunctionalSpec.html#a3.2.2.2_Configuring_the_Ma...

If you're already doing that, what error do you get?
Explorer
Posts: 9
Registered: ‎06-02-2016

Re: OOZIE Hbase MapReduce job scheduling

Thanks Harsh,

 

We are using below Oozie configuration which works for single table scan input, how do we provide multiple table scan input in Oozie ( using Map Reduce Action)

 

Are you saying to use Java Action with OozieActionConfigurator ?

 

 

<!-- HBASE CONFIGURATIONS -->
                <property>
                    <name>hbase.mapreduce.inputtable</name>
                    <value>${MAPPER_INPUT_TABLE}</value>
                </property>
                <property>
                    <name>hbase.mapreduce.scan</name>
                    <value>${wf:actionData('get-scanner')['scan']}</value>
                </property>
                <property>
                    <name>hbase.zookeeper.property.clientPort</name>
                    <value>${hbaseZookeeperClientPort}</value>
Highlighted
Explorer
Posts: 9
Registered: ‎06-02-2016

Re: OOZIE Hbase MapReduce job scheduling

We used Java action to call MR TableMapper job whch scans two tables, there was no need to pass 

hbase.mapreduce.scan property as in MR action