Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Hive query error on partition table file not exists

avatar

I am seeing the below issues while i am trying to count(*) (doing a full table scan on a partitioned table)

 java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1532612094367_2667_7_00, diagnostics=[Vertex vertex_1532612094367_2667_7_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: realtimepos_pump_tenders initializer failed, vertex=vertex_1532612094367_2667_7_00 [Map 1], org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022309
Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022310
Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022311
Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022312
Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022313
I am not seeing the above partitioned files on HDFS. I am not able to figure out the reason and how to fix it  
2 REPLIES 2

avatar
Rising Star

Hi Nikhil,

Can you perform any commands on that table? Perhaps try dropping the partition. It seems that the data was removed at some point on HDFS but the hive tables metadata still thinks those partitions exist

ALTER TABLE *tableName* drop if exists PARTITION(date_part="2018022313");

avatar

Yes Daniel we are deleting the process . I dropped the table and recreated , it works now Thanks.