Support Questions
Find answers, ask questions, and share your expertise

oozie job gets killed while storing pig output to the HIVE table

oozie job gets killed while storing pig output to the HIVE table

Expert Contributor

hello,

i am using HDInsight cluster on azure. i am trying to store pig output to the HIVE table using HCatstorer but everytime my job gets killed.

following is my PIG script:

A = LOAD '${INPUT}' USING PigStorage(',') AS (year:chararray,at:chararray,dt:chararray);

describe A;

dump A;

store A into 'testdb.tbl1' using org.apache.hive.hcatalog.pig.HCatStorer();

when i execute same script in PIG View it works perfect.

I tried another way too, i tried to store pig output to the location and in hive job i gave LOAD DATA INPATH '${OUTPUT}' OVERWRITE INTO TABLE test , the path where pig stores output.

this also worked fine when i execute this in hive view but didnt worked in oozie.