Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

running hive job through oozie

Highlighted

running hive job through oozie

I am trying to run a hive job (script.q ) through oozie but It is getting killed everytime.

I tried -log oozie_job_id and got some info :

INFO WorkflowNotificationXCommand:520 - SERVER[ ] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000022-171109163814084-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000022-171109163814084-oozie-oozi-W 2017-11-14 09:12:09,761 INFO WorkflowNotificationXCommand:520 - SERVER[] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000022-171109163814084-oozie-oozi-W] ACTION[0000022-171109163814084-oozie-oozi-W@hive-node] No Notification URL is defined. Therefore nothing to notify for job 0000022-171109163814084-oozie-oozi-W@hive-node

<workflow-app xmlns="uri:oozie:workflow:0.2" name="hive-wf">
    <start to="hive-node"/>
    <action name="hive-node">
        <hive xmlns="uri:oozie:hive-action:0.2">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <prepare>
                <delete path="${nameNode}/user/${wf:user()}/${examplesRoot}/output-data/hive"/>
                <mkdir path="${nameNode}/user/${wf:user()}/${examplesRoot}/output-data"/>
            </prepare>
<job-xml>${nameNode}/user/yarn/examples/apps/hive/hive-site.xml</job-xml>
            <configuration>
                <property>
                    <name>mapred.job.queue.name</name>
                    <value>${queueName}</value>
                </property>
            </configuration>
            <script>${nameNode}/user/yarn/examples/apps/hive/script.q</script>
            <param>INPUT=/user/${wf:user()}/${examplesRoot}/input-data/table</param>
            <param>OUTPUT=/user/${wf:user()}/${examplesRoot}/output-data/hive</param>
        </hive>
        <ok to="end"/>
        <error to="fail"/>
    </action>
    <kill name="fail">
        <message>Hive failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <end name="end"/>
</workflow-app>

if there is something related to jar files pls provide details where it has to be placed to get this hive job running ?

Don't have an account?
Coming from Hortonworks? Activate your account here