Member since
01-08-2017
2
Posts
0
Kudos Received
0
Solutions
01-29-2017
06:44 PM
Seems you are providing a different log as it is showing some different error for various partition as partition not found Partition not found (server_date = 2016-10-10) OK OK OK FAILED: SemanticException [Error 10006]: Partition not found (server_date = 2016-10-23) OK FAILED: SemanticException [Error 10006]: Partition not found (server_date = 2016-10-23) OK FAILED: SemanticException [Error 10006]: Partition not found (server_date = 2016-10-10) Below query is working fine for me hiveCtx.sql(s"ALTER TABLE spark_2_test DROP IF EXISTS PARTITION (server_date='2016-10-10')");
... View more
01-23-2017
10:15 AM
If you are using spark then use below code: sc.textFile("hdfs://...../part*).coalesce(1).saveAsTextFile("hdfs://...../filename) This will merge all part files into one and save it again into hdfs location
... View more