Member since 
    
	
		
		
		01-20-2014
	
	
	
	
	
	
	
	
	
	
	
	
	
	
			
      
                578
            
            
                Posts
            
        
                102
            
            
                Kudos Received
            
        
                94
            
            
                Solutions
            
        My Accepted Solutions
| Title | Views | Posted | 
|---|---|---|
| 6688 | 10-28-2015 10:28 PM | |
| 3557 | 10-10-2015 08:30 PM | |
| 5643 | 10-10-2015 08:02 PM | |
| 4100 | 10-07-2015 02:38 PM | |
| 2883 | 10-06-2015 01:24 AM | 
			
    
	
		
		
		09-02-2014
	
		
		06:46 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 http://www.cloudera.com/content/cloudera/en/products-and-services/product-comparison.html     Please refer to that link, you can have an unlimited number of nodes in the cluster with Cloudera Express. 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		06:31 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							Repeat the exercise within /var/lib. Most likely it is the event server.    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		05:12 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							The database is unable to write so shutdown is failing. Please run the du  command from earlier and see which directory is using the most space    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		03:24 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							Thank you for the feedback.    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		03:13 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		1 Kudo
		
	
				
		
	
		
					
							I have to check on that. Meanwhile another option is to create the cluster  manually and save the master and worker node images as custom AMIs. Use  those AMIs every morning to create a new cluster, then tear it down. When  you want to update CDH, just do it once manually and save new AMIs    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		02:59 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							The Cloudera Documentation refers to deploying a YARN cluster on AWS    http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_whirr_define.html    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		02:55 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Please refer to the Path B install link I provided earlier which explains how you can automate CM and CDH installation. Then refer to the CM API (http://cloudera.github.io/cm_api/apidocs/v7/rest.html) specifically the /clusters/{clusterName}/parcels mountpoints.     
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		02:42 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							Yes the rpm/deb packages have to be installed already. Alternatively you  could use a mixture of the AWS API (to provision the hosts), then use the  Cloudera Manager API to provision the cluster (using the parcel deployment)    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		02:36 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							Visit Cloudera Manager, in the drop down list next to the cluster name  you'll see "stop cluster". Run that all services will stop cleanly. Then  check disk usage as suggested earlier.    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-02-2014
	
		
		02:16 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							Please stop entire cluster and run du to figure out where the space is  being used.    # du -ks /var/* | sort -n    Once you find the culprit, let us know and we can decide how to fix it as  the solution depends on the service.    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		 
        













