Member since
11-12-2016
4
Posts
1
Kudos Received
0
Solutions
11-21-2016
12:29 PM
2 Kudos
Hi Wenbin, I hope I understood well your use case. So you say that the data files are transferred to the correct HDFS location (with proper partitioning format directories, like partitionname=partitionvalue) but you want to make aware the Hive that there is a new partition on the HDFS. In this case you need the MSCK REPAIR TABLE table_name command, please see: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE) In this case you don't need to execute ALTER TABLE ADD PARTITION for each new partition, Hive will recognize it. In the newer Impala versions the same functionality exists in Impala as command: ALTER TABLE table_name RECOVER PARTITIONS Regards Miklos Szurap Customer Operations Engineer
... View more
11-18-2016
06:03 PM
We added support for --ldap_password_cmd in Impala 2.5, which I think addresses this problem. See https://issues.cloudera.org/browse/IMPALA-1934 https://www.cloudera.com/documentation/enterprise/5-8-x/topics/impala_shell_options.html
... View more