Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Hive query error on partition table file not exists
Labels:
- Labels:
-
Apache Hive
Explorer
Created 07-30-2018 02:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am seeing the below issues while i am trying to count(*) (doing a full table scan on a partitioned table)
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1532612094367_2667_7_00, diagnostics=[Vertex vertex_1532612094367_2667_7_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: realtimepos_pump_tenders initializer failed, vertex=vertex_1532612094367_2667_7_00 [Map 1], org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022309 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022310 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022311 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022312 Input path does not exist: hdfs://hdp01prod/prod/landing/realtime_pos/pump/tenders/date_part=2018022313
I am not seeing the above partitioned files on HDFS. I am not able to figure out the reason and how to fix it
2 REPLIES 2
Rising Star
Created 07-30-2018 03:59 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Nikhil,
Can you perform any commands on that table? Perhaps try dropping the partition. It seems that the data was removed at some point on HDFS but the hive tables metadata still thinks those partitions exist
ALTER TABLE *tableName* drop if exists PARTITION(date_part="2018022313");
Explorer
Created 07-30-2018 05:30 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes Daniel we are deleting the process . I dropped the table and recreated , it works now Thanks.