Member since 
    
	
		
		
		11-12-2016
	
	
	
	
	
	
	
	
	
	
	
	
	
	
			
      
                4
            
            
                Posts
            
        
                1
            
            
                Kudos Received
            
        
                0
            
            
                Solutions
            
        
			
    
	
		
		
		11-21-2016
	
		
		12:29 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		2 Kudos
		
	
				
		
	
		
					
							 Hi Wenbin,     I hope I understood well your use case. So you say that the data files are transferred to the correct HDFS location (with proper partitioning format directories, like partitionname=partitionvalue) but you want to make aware the Hive that there is a new partition on the HDFS.  In this case you need the     MSCK REPAIR TABLE table_name     command, please see:  https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE)  In this case you don't need to execute ALTER TABLE ADD PARTITION for each new partition, Hive will recognize it.     In the newer Impala versions the same functionality exists in Impala as command:  ALTER TABLE table_name RECOVER PARTITIONS     Regards   Miklos Szurap  Customer Operations Engineer 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		11-18-2016
	
		
		06:03 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 We added support for --ldap_password_cmd in Impala 2.5, which I think addresses this problem. See https://issues.cloudera.org/browse/IMPALA-1934     https://www.cloudera.com/documentation/enterprise/5-8-x/topics/impala_shell_options.html 
						
					
					... View more