Created 07-30-2018 02:22 PM
I am seeing the below issues while i am trying to count(*) (doing a full table scan on a partitioned table)
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1532612094367_2667_7_00, diagnostics=[Vertex vertex_1532612094367_2667_7_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: realtimepos_pump_tenders initializer failed, vertex=vertex_1532612094367_2667_7_00 [Map 1], org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022309 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022310 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022311 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022312 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022313
I am not seeing the above partitioned files on HDFS. I am not able to figure out the reason and how to fix it
Created 07-30-2018 03:59 PM
Hi Nikhil,
Can you perform any commands on that table? Perhaps try dropping the partition. It seems that the data was removed at some point on HDFS but the hive tables metadata still thinks those partitions exist
ALTER TABLE *tableName* drop if exists PARTITION(date_part="2018022313");
Created 07-30-2018 05:30 PM
Yes Daniel we are deleting the process . I dropped the table and recreated , it works now Thanks.