Member since 
    
	
		
		
		01-15-2019
	
	
	
	
	
	
	
	
	
	
	
	
	
	
			
      
                63
            
            
                Posts
            
        
                37
            
            
                Kudos Received
            
        
                2
            
            
                Solutions
            
        My Accepted Solutions
| Title | Views | Posted | 
|---|---|---|
| 3113 | 07-20-2021 01:05 AM | |
| 16926 | 11-28-2019 06:59 AM | 
			
    
	
		
		
		01-12-2023
	
		
		02:16 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		2 Kudos
		
	
				
		
	
		
					
							 
 To install Apache NiFi on Macbook, do the following:  
 
 Download the Zip file from Apache nifi Downloads. Ensure that you download the latest version zip file Apache NiFi Binary 1.19.1 [OpenPGP] [SHA-256] [SHA-512].  
 Download it to MBP, and then unzip it:  
 chmod +x bin/nifi.sh 
   
 Run the following command for User Generate:  
 bin/nifi.sh set-single-user-credentials zzeng <my long password> 
 
 Run the following command to Start:  
 bin/nifi.sh start bin/nifi.sh status netstat -an | grep LIST 
 
 Check the  8443 port is LISTEN:  
 
 
 tcp4       0      0  127.0.0.1.8443         *.*                    LISTEN 
 
 
 
 Login from https://localhost:8443/nifi/     
 
 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
	
					
			
		
	
	
	
	
				
		
	
	
			
    
	
		
		
		11-13-2022
	
		
		08:07 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 https://lists.apache.org/thread/907n11xlvdmckp1045bspzloclthfqsh     As NiFi is a pure Java/JVM application, we use Jython rather than
    Python for ExecuteScript. This means that you can't import native
    (CPython, e.g.) modules into your Jython scripts in ExecuteScript  consider using ExecuteStreamCommand with a real Python
    interpreter and script. I'm looking at Py4J to try and bridge the gap 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		04-10-2022
	
		
		10:47 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 The latest document about Airflow in Data Engineering Experience (CDE) within Public Cloud and CDP Private Cloud Data Service is here:      CDP Public Cloud  https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-dag-pipeline.html  CDP Private Cloud Data Service  https://docs.cloudera.com/data-engineering/1.3.3/orchestrate-workflows/topics/cde-airflow-dag-pipeline.html     
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		07-20-2021
	
		
		01:05 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Sorry for my late reply.     > what AMI are you using and were there any pre-requisites for OS ?   I used the CentOS 7.8, like the matrix showed.  https://supportmatrix.cloudera.com/#Cloudera         To download the CDP, if you are not paying for CDP, you can try it from here.  https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-trial-download-information.html  The trial version has the same functions with normal CDP but can only use 60 days.     Please have a try and let me know if it works.    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		07-09-2021
	
		
		12:01 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Hi Sam,     I am also use CDP on AWS for learning.     If you don't have enough AWS credit budget, you can use 3 nodes in this way,     Use these 3 nodes as both Master and worker nodes.  Means put NameNode and DataNode in these nodes.     Put DataNode in all the 3 nodes.    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		07-08-2021
	
		
		11:57 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I met similar errors, but with different reasons.  My reason was, I created a leaf queue behind default queue.  Then after Hive restart, it will submit a query to check the health status, however as default queue is not a leaf queue any more, then it went error.     My solution was , I removed the child queue behind default queue, then the error resolved. 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		04-20-2021
	
		
		05:06 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Here is a URL, written by David W. Streever  https://www.streever.com/post/2019/filter-hive-compactions/  It's not official steps. All the ‘extras’ you create against the metastore DB can/may break with the next release. This isn’t a supported method of accessing metadata.    
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		01-26-2021
	
		
		08:51 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 https://nifi.apache.org/docs/nifi-docs/components/nifi-docs/components/org.apache.nifi/nifi-gcp-nar/1.9.0/org.apache.nifi.processors.gcp.bigquery.PutBigQueryBatch/index.html     With this processor, you can do Batch loads flow files content to a Google BigQuery table. 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		04-07-2020
	
		
		07:06 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		3 Kudos
		
	
				
		
	
		
					
							        1) Demarcator, use  ${literal('
'):unescapeXml()}  2) Delimiter Strategy = Text       
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		11-28-2019
	
		
		06:59 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		12 Kudos
		
	
				
		
	
		
					
							 If you meet this problem in new installing CM+CDP/CDH  it can be resolve in this way:  in CM, open Solr page, do the 2 actions:  Initialize Solr / Create HDFS Home Dir     
						
					
					... View more