Member since
08-16-2017
39
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3910 | 07-12-2018 05:49 AM |
06-20-2019
11:20 AM
Hi! I need to execute following awk command on flow file via ExecuteStreamCommand processor awk -F"," '{OFS=","; $4=substr($4,1,19); print $0}' When run it throws an error: Executable command awk ended in an error: awk: fatal: cannot open file `print $0}" for reading (No such file or directory). Flow file comes from ListFTP -> FetchFTP -> ExecuteStreamCommand Could you please help to solve this issue!! Thank you!! When running the same awk command on server it works fine: awk -F"," '{OFS=","; $4=substr($4,1,19); print $0}' myfile.csv
... View more
Labels:
- Labels:
-
Apache NiFi
06-13-2019
09:05 AM
Hi! How can I configure InvokeHTTP to return comma separated flow file? At the moment it is returning file in below format (tab separated): RELM Satieva_microloans 6 3369 2019-06-12 11:42:00 772103971 RELM Satieva_microloans 6 3369 2019-06-12 11:42:00 772104117 RELM Satieva_microloans 6 3369 2019-06-12 11:42:00 772101000 Thanks in advance!
... View more
Labels:
- Labels:
-
Apache NiFi
11-30-2018
11:25 AM
Hi @Jagadeesan A S Thank you for your response! I have followed all the steps you have stated. After ambari-server setup I dropped the new ambari database, and recovered the database from backup. And when trying to start ambari-server it gives following error: ServiceNotFoundException: Service not found, clusterName=hdf_kg, serviceName=AMBARI_INFRA # ambari-server start
Using python /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start................
DB configs consistency check found warnings. See /var/log/ambari-server/ambari-server-check-database.log for more details.
ERROR: Exiting with exit code -1.
REASON: Ambari Server java process has stopped. Please check the logs for more information.
[root@bi-nifi1 backup]# cat /var/log/ambari-server/ambari-server.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
Database consistency check result: DB_CHECK_WARNING
An unexpected error occured during starting Ambari Server.
org.apache.ambari.server.ServiceNotFoundException: Service not found, clusterName=hdf_kg, serviceName=AMBARI_INFRA
at org.apache.ambari.server.state.cluster.ClusterImpl.getService(ClusterImpl.java:864)
at org.apache.ambari.server.api.services.AmbariMetaInfo.reconcileAlertDefinitions(AmbariMetaInfo.java:1240)
at org.apache.ambari.server.controller.AmbariServer.run(AmbariServer.java:532)
at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1067)
[root@bi-nifi1 backup]#
Is it possible to manually start AMBARI_INFRA service? Thanks in advance!
... View more
11-21-2018
02:56 AM
ambari-server.zip
... View more
11-21-2018
02:54 AM
1 Kudo
Hi @Jagadeesan A S Thank you for your concern! How can I identify which libraries are from older versions, there is no version on the file name? [dmp@bi-nifi1 ~]$ cd /usr/lib/ambari-server/lib/ambari_commons
[dmp@bi-nifi1 ambari_commons]$ ls
aggregate_functions.py ambari_service.pyc credential_store_helper.pyo inet_utils.py logging_utils.pyc os_check.pyo os_utils.py parallel_processing.pyc str_utils.pyc xml_utils.pyo
aggregate_functions.pyc ambari_service.pyo exceptions.py inet_utils.pyc logging_utils.pyo os_family_impl.py os_utils.pyc parallel_processing.pyo str_utils.pyo yaml_utils.py
aggregate_functions.pyo constants.py exceptions.pyc inet_utils.pyo network.py os_family_impl.pyc os_utils.pyo resources urllib_handlers.py yaml_utils.pyc
ambari_metrics_helper.py constants.pyc exceptions.pyo __init__.py network.pyc os_family_impl.pyo os_windows.py shell.py urllib_handlers.pyc yaml_utils.pyo
ambari_metrics_helper.pyc constants.pyo firewall.py __init__.pyc network.pyo os_linux.py os_windows.pyc shell.pyc urllib_handlers.pyo
ambari_metrics_helper.pyo credential_store_helper.py firewall.pyc __init__.pyo os_check.py os_linux.pyc os_windows.pyo shell.pyo xml_utils.py
ambari_service.py credential_store_helper.pyc firewall.pyo logging_utils.py os_check.pyc os_linux.pyo parallel_processing.py str_utils.py xml_utils.pyc
... View more
11-20-2018
01:29 PM
Hi, all! Can anyone give any suggestion in configuring new Ambari server with an existing HDF cluster Previos version of ambari fails in ambari-server start after downgrade [root@bi-nifi1 dmp]# ambari-server start
Using python /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start.............ERROR: Exiting with exit code -1.
REASON: Ambari Server java process has stopped. Please check the logs for more information.
[root@bi-nifi1 dmp]# cat /var/log/ambari-server/ambari-server.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
An unexpected error occured during starting Ambari Server.
org.apache.ambari.server.AmbariException: An error occured during updating current repository versions with stack repositories.
at org.apache.ambari.server.stack.UpdateActiveRepoVersionOnStartup.process(UpdateActiveRepoVersionOnStartup.java:99)
at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1061)
Caused by: java.lang.NullPointerException
at org.apache.ambari.server.stack.UpdateActiveRepoVersionOnStartup.updateRepoVersion(UpdateActiveRepoVersionOnStartup.java:106)
at org.apache.ambari.server.stack.UpdateActiveRepoVersionOnStartup.process(UpdateActiveRepoVersionOnStartup.java:92)
... 2 more
Exception in thread "main" org.apache.ambari.server.AmbariException: Error stopping the server
at org.apache.ambari.server.controller.AmbariServer.stop(AmbariServer.java:880)
at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1075)
[root@bi-nifi1 dmp]#
... View more
Labels:
- Labels:
-
Apache Ambari
-
Cloudera DataFlow (CDF)
11-15-2018
09:57 AM
Hi! While upgrading HDF - 3.0.2 to HDF-3.2.0 I'm facing the same problem. ambari=> select cluster_id, desired_stack_id from clusters; cluster_id | desired_stack_id
- 2 | 51 ambari=> select * from clusterstate ; cluster_id | current_cluster_state | current_stack_id 2 | | 51 ambari=> select stack_id, version from repo_version; stack_id | version 2 | 2.1.4.0-5 51 | 3.0.2.0-76 101 | 3.1.2.0-7 102 | 3.2.0.0 ---------------------- My current version in 3.0.2.0-76, stack_id=51 what can be the reason of why I can't install and upgrade to 3.2.0.0 Thanks in advance! with kind regards, Gulshan
... View more
07-17-2018
05:25 AM
@Matt Clarke Thanks for your recommendation concerning running Linux commands! Is there any processor that will output a list of all files in a specific directory? I would like to pass this list to Linux command.
... View more
07-16-2018
09:14 AM
Hi!! I need to run a Linux command on list of files received from ListSFTP (most probably it should be run on remote FTP server) and pass forward the result of this operation as flow file to putHDFS. Linux command is:
cat ${LIST} | xargs -n 1 -I {} stdbuf -o 5GB awk -F'\x1b' '{OFS="|"};{print $1,$2,FILENAME}' {} Can you please advise which processor can be most suitable. Thanks in advance!
... View more
Labels:
- Labels:
-
Apache NiFi