Member since 
    
	
		
		
		08-16-2017
	
	
	
	
	
	
	
	
	
	
	
	
	
	
			
      
                39
            
            
                Posts
            
        
                3
            
            
                Kudos Received
            
        
                1
            
            
                Solution
            
        My Accepted Solutions
| Title | Views | Posted | 
|---|---|---|
| 4967 | 07-12-2018 05:49 AM | 
			
    
	
		
		
		06-20-2019
	
		
		11:20 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Hi!  I need to execute following awk command on flow file via ExecuteStreamCommand processor  awk -F"," '{OFS=","; $4=substr($4,1,19); print $0}'  When run it throws an error: Executable command awk ended in an error: awk: fatal: cannot open file `print $0}" for reading (No such file or directory).      Flow file comes from ListFTP -> FetchFTP -> ExecuteStreamCommand       Could you please help to solve this issue!!  Thank you!!      When running the same awk command on server it works fine:  awk -F"," '{OFS=","; $4=substr($4,1,19); print $0}' myfile.csv           
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache NiFi
			
    
	
		
		
		06-13-2019
	
		
		09:05 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Hi!  How can I configure InvokeHTTP to return comma separated flow file?   At the moment it is returning file in below format (tab separated):      RELM    Satieva_microloans 6    3369    2019-06-12 11:42:00    772103971  RELM    Satieva_microloans 6    3369    2019-06-12 11:42:00    772104117  RELM    Satieva_microloans 6    3369    2019-06-12 11:42:00    772101000      Thanks in advance! 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache NiFi
			
    
	
		
		
		11-30-2018
	
		
		11:25 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Hi @Jagadeesan A S  Thank you for your response!  I have followed all the steps you have stated. After ambari-server setup I dropped the new ambari database, and recovered the database from backup.   And when trying to start ambari-server it gives following error:  ServiceNotFoundException: Service not found, clusterName=hdf_kg, serviceName=AMBARI_INFRA  # ambari-server start
Using python  /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start................
DB configs consistency check found warnings. See /var/log/ambari-server/ambari-server-check-database.log for more details.
ERROR: Exiting with exit code -1. 
REASON: Ambari Server java process has stopped. Please check the logs for more information.
[root@bi-nifi1 backup]# cat /var/log/ambari-server/ambari-server.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
Database consistency check result: DB_CHECK_WARNING
An unexpected error occured during starting Ambari Server.
org.apache.ambari.server.ServiceNotFoundException: Service not found, clusterName=hdf_kg, serviceName=AMBARI_INFRA
        at org.apache.ambari.server.state.cluster.ClusterImpl.getService(ClusterImpl.java:864)
        at org.apache.ambari.server.api.services.AmbariMetaInfo.reconcileAlertDefinitions(AmbariMetaInfo.java:1240)
        at org.apache.ambari.server.controller.AmbariServer.run(AmbariServer.java:532)
        at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1067)
[root@bi-nifi1 backup]# 
    Is it possible to manually start AMBARI_INFRA service?    Thanks in advance!   
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		11-21-2018
	
		
		02:56 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 ambari-server.zip 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		11-21-2018
	
		
		02:54 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
	
		1 Kudo
		
	
				
		
	
		
					
							 Hi @Jagadeesan A S  Thank you for your concern!  How can I identify which libraries are from older versions, there is no version on the file name?  [dmp@bi-nifi1 ~]$ cd /usr/lib/ambari-server/lib/ambari_commons
[dmp@bi-nifi1 ambari_commons]$ ls
aggregate_functions.py     ambari_service.pyc           credential_store_helper.pyo  inet_utils.py     logging_utils.pyc  os_check.pyo        os_utils.py             parallel_processing.pyc  str_utils.pyc        xml_utils.pyo
aggregate_functions.pyc    ambari_service.pyo           exceptions.py                inet_utils.pyc    logging_utils.pyo  os_family_impl.py   os_utils.pyc            parallel_processing.pyo  str_utils.pyo        yaml_utils.py
aggregate_functions.pyo    constants.py                 exceptions.pyc               inet_utils.pyo    network.py         os_family_impl.pyc  os_utils.pyo            resources                urllib_handlers.py   yaml_utils.pyc
ambari_metrics_helper.py   constants.pyc                exceptions.pyo               __init__.py       network.pyc        os_family_impl.pyo  os_windows.py           shell.py                 urllib_handlers.pyc  yaml_utils.pyo
ambari_metrics_helper.pyc  constants.pyo                firewall.py                  __init__.pyc      network.pyo        os_linux.py         os_windows.pyc          shell.pyc                urllib_handlers.pyo
ambari_metrics_helper.pyo  credential_store_helper.py   firewall.pyc                 __init__.pyo      os_check.py        os_linux.pyc        os_windows.pyo          shell.pyo                xml_utils.py
ambari_service.py          credential_store_helper.pyc  firewall.pyo                 logging_utils.py  os_check.pyc       os_linux.pyo        parallel_processing.py  str_utils.py             xml_utils.pyc
                   
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		11-20-2018
	
		
		01:29 PM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Hi, all!  Can anyone give any suggestion in configuring new Ambari server with an existing HDF cluster  Previos version of ambari fails in ambari-server start after downgrade  [root@bi-nifi1 dmp]# ambari-server start
Using python  /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start.............ERROR: Exiting with exit code -1. 
REASON: Ambari Server java process has stopped. Please check the logs for more information.
[root@bi-nifi1 dmp]# cat /var/log/ambari-server/ambari-server.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
An unexpected error occured during starting Ambari Server.
org.apache.ambari.server.AmbariException: An error occured during updating current repository versions with stack repositories.
        at org.apache.ambari.server.stack.UpdateActiveRepoVersionOnStartup.process(UpdateActiveRepoVersionOnStartup.java:99)
        at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
        at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1061)
Caused by: java.lang.NullPointerException
        at org.apache.ambari.server.stack.UpdateActiveRepoVersionOnStartup.updateRepoVersion(UpdateActiveRepoVersionOnStartup.java:106)
        at org.apache.ambari.server.stack.UpdateActiveRepoVersionOnStartup.process(UpdateActiveRepoVersionOnStartup.java:92)
        ... 2 more
Exception in thread "main" org.apache.ambari.server.AmbariException: Error stopping the server
        at org.apache.ambari.server.controller.AmbariServer.stop(AmbariServer.java:880)
        at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1075)
[root@bi-nifi1 dmp]# 
 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache Ambari
- 
						
							
		
			Cloudera DataFlow (CDF)
			
    
	
		
		
		11-15-2018
	
		
		09:57 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Hi!  While upgrading HDF - 3.0.2 to HDF-3.2.0 I'm facing the same problem.  ambari=> select cluster_id, desired_stack_id from clusters;    cluster_id | desired_stack_id 
-                2 |               51  ambari=> select * from clusterstate ;    cluster_id | current_cluster_state | current_stack_id                2 |                                    |               51  ambari=> select stack_id, version from repo_version;    stack_id |  version   2 | 2.1.4.0-5          51 | 3.0.2.0-76   101 | 3.1.2.0-7         102 | 3.2.0.0    ----------------------  My current version in 3.0.2.0-76, stack_id=51  what can be the reason of why I can't install and upgrade to 3.2.0.0  Thanks in advance!  with kind regards,  Gulshan 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		07-17-2018
	
		
		05:25 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							@Matt Clarke Thanks for your recommendation concerning running Linux commands!  Is there any processor that will output a list of all files in a specific directory? I would like to pass this list to Linux command. 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
			
    
	
		
		
		07-16-2018
	
		
		09:14 AM
	
	
	
	
	
	
	
	
	
	
	
	
	
	
		
	
				
		
			
					
				
		
	
		
					
							 Hi!!  I need to run a Linux command on list of files received from ListSFTP  (most probably it should be run on remote FTP server) and pass forward the result of this operation as flow file to putHDFS.   Linux command is: 
cat ${LIST} | xargs -n 1 -I {} stdbuf -o 5GB awk -F'\x1b' '{OFS="|"};{print $1,$2,FILENAME}' {}  Can you please advise which processor can be most suitable.   Thanks in advance! 
						
					
					... View more
				
			
			
			
			
			
			
			
			
			
		
		
			
				
						
							Labels:
						
						
		
			
	
					
			
		
	
	
	
	
				
		
	
	
- Labels:
- 
						
							
		
			Apache NiFi
 
        








