Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: The Cloudera Community will undergo maintenance on Saturday, August 17 at 12:00am PDT. See more info here.

OOZIE Hbase MapReduce job scheduling

OOZIE Hbase MapReduce job scheduling

Explorer

CHD 5.4.0 

 

We have Hbase MapReduce job which scans two Hbase tables and passes the List of scan object to TableMapReduceUtil.initTableMapperJob(scans,MyMpper.class,Text.class,Text.class,job)

 

We are facing issues scheduling this job in oozie as MR action.

 

Any Help is appreciated 

 

 

3 REPLIES 3

Re: OOZIE Hbase MapReduce job scheduling

Cloudera Employee
Have you gone over this section of the docs that talk about how to reuse
your existing driver code for an MR action?
http://archive.cloudera.com/cdh5/cdh/5/oozie/WorkflowFunctionalSpec.html#a3.2.2.2_Configuring_the_Ma...

If you're already doing that, what error do you get?
Highlighted

Re: OOZIE Hbase MapReduce job scheduling

Explorer

Thanks Harsh,

 

We are using below Oozie configuration which works for single table scan input, how do we provide multiple table scan input in Oozie ( using Map Reduce Action)

 

Are you saying to use Java Action with OozieActionConfigurator ?

 

 

<!-- HBASE CONFIGURATIONS -->
                <property>
                    <name>hbase.mapreduce.inputtable</name>
                    <value>${MAPPER_INPUT_TABLE}</value>
                </property>
                <property>
                    <name>hbase.mapreduce.scan</name>
                    <value>${wf:actionData('get-scanner')['scan']}</value>
                </property>
                <property>
                    <name>hbase.zookeeper.property.clientPort</name>
                    <value>${hbaseZookeeperClientPort}</value>

Re: OOZIE Hbase MapReduce job scheduling

Explorer

We used Java action to call MR TableMapper job whch scans two tables, there was no need to pass 

hbase.mapreduce.scan property as in MR action