Member since 
    
	
		
		
		04-16-2019
	
	
	
	
	
	
	
	
	
	
	
	
	
	
			
      
                373
            
            
                Posts
            
        
                7
            
            
                Kudos Received
            
        
                4
            
            
                Solutions
            
        My Accepted Solutions
| Title | Views | Posted | 
|---|---|---|
| 25470 | 10-16-2018 11:27 AM | |
| 9460 | 09-29-2018 06:59 AM | |
| 1522 | 07-17-2018 08:44 AM | |
| 8347 | 04-18-2018 08:59 AM | 
			
    
	
		
		
		05-30-2019
	
		
		06:29 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I have more than 350 regions per region server and as result it has to created one alert in ambari . There is way to increase regionsize and reduce number of regions but I am not sure about performance after the increment of size of region.  What are optimal ways to reduce number of regions per regionserver.     
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Ambari
- 
						
							
		
			Apache HBase
			
    
	
		
		
		04-16-2019
	
		
		11:09 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 kakfa leader not available I have added 1 more broker earlier kafka has 3 brokers , producer is throwing an error ; 
 WARN clients.NetworkClient: Error while fetching metadata with correlation id 5493 : {amoll=LEADER_NOT_AVAILABLE} 
   
 I have checked advertised.host.name and I see kafka broker default group and kafka broker1 group there . 
 Kind Regards 
 Amol 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Kafka
			
    
	
		
		
		04-12-2019
	
		
		11:55 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 how does sentry differ from ranger ? what are the things We can not achieve with using sentry and that is achievable from ranger and vice-versa. 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Ranger
- 
						
							
		
			Apache Sentry
			
    
	
		
		
		02-20-2019
	
		
		06:25 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I am trying to fetch results data stored in hive orc table , but when I run the query it gives results fast but When I run the with limit clause it is taking too much of time .  select * from tablename  where year="2019" and month="jan-mar" ;      - Runs perfectly  within 30-40secs  select * from tablename  limit 10;      - Gets stuck  
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Hadoop
- 
						
							
		
			Apache Hive
			
    
	
		
		
		10-23-2018
	
		
		02:00 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I want to run distcp job copying huge data from source cluster to destination cluster , how can i increase the performance or speed of the distcp job ? 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Hadoop
			
    
	
		
		
		10-16-2018
	
		
		11:27 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I am able to import  import spark.implicits._ , earlier i was using spark1 but launching spark2 solved the problem. 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		10-11-2018
	
		
		07:15 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 also I get below error too :  scala> val spark = SparkSession.builder().enableHiveSupport().getOrCreate()
<console>:30: error: not found: value SparkSession
         val spark = SparkSession.builder().enableHiveSupport().getOrCreate( 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		10-11-2018
	
		
		05:00 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I am using spark shell , my os is centos6 when i am trying to import spark.implicits._ , i get below error:  <console>:30: error: not found: value spark
         import spark.implicits._
                ^ 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Spark
			
    
	
		
		
		10-03-2018
	
		
		06:09 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I am running the spark job which is leading to failure of job with the error no space left on the device however there is enough space available in the device . i have checked with df -h and df -i command and no issue with the space I see .  Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 656 in stage 11.0 failed 4 times, most recent failure: Lost task 656.3 in stage 11.0 (TID 680, I<workernode>): java.io.IOException: No space left on device 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Spark
- 
						
							
		
			Apache YARN
			
    
	
		
		
		10-01-2018
	
		
		02:26 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Geoffrey Shelton Okot  Thanks for the reply !!!  but i was interested in knowing what password ambari use for the service like hdfs , hbase etc . Providing the admin password allows amabri to generate keytabs for the service user but internally it would be using some password at service level .     
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		 
        













