Member since 
    
	
		
		
		09-13-2015
	
	
	
	
	
	
	
	
	
	
	
	
	
	
			
      
                59
            
            
                Posts
            
        
                18
            
            
                Kudos Received
            
        
                6
            
            
                Solutions
            
        My Accepted Solutions
| Title | Views | Posted | 
|---|---|---|
| 3255 | 12-19-2017 08:14 PM | |
| 2818 | 10-11-2017 02:21 PM | |
| 3692 | 06-12-2017 09:26 PM | |
| 5633 | 06-08-2017 01:36 PM | |
| 2143 | 11-04-2016 08:35 PM | 
			
    
	
		
		
		08-21-2018
	
		
		06:50 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		2 Kudos
		
	
				
		
	
		
					
							Restarting NiFi nodes fails with an error message such as the one below: 
 <br>File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 278, in
    Master().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
    method(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 993, in restart
    self.start(env, upgrade_type=upgrade_type)
  File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 152, in start
    nifi_cli.create_or_update_reg_client(params.nifi_registry_host, params.nifi_registry_url)
  File "/u/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_cli.py", line 175, in create_or_update_reg_client
    existing_clients = list_reg_clients()
  File "/u/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_cli.py", line 144, in list_reg_clients
    outputType="json"
  File "/u/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_cli.py", line 73, in nifi_cli
    raise Fail("Failed to execute nifi cli.sh command")
  Cause:  This occurs when the nifi.initial.admin.identity does not have permission to access the /controller API.  Workaround:  Create a local user in Ranger with the name of the initial admin idenity  Add a Ranger Policy for NiFi with Read/Write permissions for /controller 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
	
					
			
		
	
	
	
	
				
		
	
	
			
    
	
		
		
		02-28-2018
	
		
		11:02 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Unfortunately the jolt spec isn't working as intended.  Is is replacing the field names with their values.  On to Plan B... 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		02-28-2018
	
		
		10:51 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Thank you @Matt Burgess.  I will give this a shot.  My alternate strategy is to infer an avro schema, and then use @Timothy Spann 's attribute cleaner and then convert back to JSON. https://github.com/tspannhw/nifi-attributecleaner-processor 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		02-28-2018
	
		
		09:34 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I have json content streaming in, and I would like to rename the field names, specifically I need to remove "." as I am inserting into MongoDB which does not support periods in key names.  Requirements:   Only field names are modified, not content.  So {"host.ip":"192.168.1.1"} -> {"host_ip":"192.168.1.1"}  Field names are unknown, so I can't explicitly replace  I would prefer not to split the json array into individual flow files.   Has anyone tackled an issue like this before? 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
 - 
						
							
		
			Apache NiFi
 
			
    
	
		
		
		12-19-2017
	
		
		08:47 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 So if I am understanding this correctly, you want to do the following:  Windows Files Share ----> NiFi -----> Hadoop  Off the top of my head I can think of a couple ways to do it.  1) Setup the Windows directory to share via FTP.  This can be done using IIS on the Windows machine, or a 3rd party FTP server  2) Install MiNiFi or NiFi on the Windows machine to transmit data using site-to-site protocol to the NiFi Cluster    Is there a particular reason you don't want to mount the share to the NiFi host? 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		12-19-2017
	
		
		08:14 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		1 Kudo
		
	
				
		
	
		
					
							 There is no native processor to open access databases files.    You can handle it a couple ways...  Easiest would be to export the data from access into csv and ingest that.    The other method would be to connect to the server running MS Access via JDBC.  However, I believe this would require a 3rd party driver, as Microsoft only has ODBC drivers for Access (but this may no longer be the case) 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		11-21-2017
	
		
		07:58 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 I am attempting to query hive_table entities in Atlas using the Atlas webUI.  One of the queries I would like to do is filter by db.  However, db is not a filter option, and querying where db="name" throws an exception.  The only workaround I have found is filtering on the qualifiedName begins_with dbname.    Is there something I am missing 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
 - 
						
							
		
			Apache Atlas
 
			
    
	
		
		
		11-15-2017
	
		
		07:00 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 @Chad Woodhead   Yes, it was resolved. But I don't have a good explanation.  It actually resolved itself by simply restarting the NiFi process on all nodes.  After the restart they all connected and worked as expected.   
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		10-11-2017
	
		
		02:21 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		2 Kudos
		
	
				
		
	
		
					
							 I am not aware of any way to do it natively in NiFi.  You could always use a REST interface with MongoDB to allow interaction via InvokeHTTP.  https://docs.mongodb.com/ecosystem/tools/http-interfaces/#rest-interface 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		09-29-2017
	
		
		09:14 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 The existing keytab should not require a password.  The following command works, and doesn't prompt for a password.  kinit -kt /etc/security/keytabs/NiFi_App_Prod.keytab NiFi_App_Prod@<REALM>.com   Also, a similar configuration works in the dev environment without issue. 
						
					
					... View more