Used tool versions: Latest Metron-0.7.1 supported tools: HDP-2.5.3.0, ambari-2.6.2.2, HDP-UTILS-1.1.0.21 and metron-0.7.1.0/HCP 1.9.1.0-6 Error Messages/Callstack: Metron Client Install stderr: /var/lib/ambari-agent/data/errors-1758.txt Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1/package/scripts/metron_client.py", line 70, in <module> MetronClient().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1/package/scripts/metron_client.py", line 35, in install self.install_packages(env) File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 821, in install_packages retry_count=agent_stack_retry_count) File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action provider_action() ... File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install metron-common' returned 1. Error: Nothing to do The advice from these pages was taken into account and did not help: - https://community.hortonworks.com/questions/167304/metron-hcp-cybersecurity-installation-fails-using.html -> yum install -y epel-release - https://community.hortonworks.com/questions/169952/error-in-installing-clients-for-any-service.html -> yum remove problem_package Any hints how to avoid/fix this problem? ... View more

Used tool versions: Latest Metron-0.7.1 supported tools: HDP-2.5, ambari-2.6.2.2, HDP-2.5.3.0, HDP-UTILS-1.1.0.21 and metron-0.7.1.0/HCP 1.9.1.0-6 Error Messages/Callstack: stderr: /var/lib/ambari-agent/data/errors-2339.txt Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py", line 37, in <module> AfterInstallHook().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py", line 31, in hook setup_stack_symlinks(self.stroutfile) File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py", line 62, in setup_stack_symlinks stack_select.select(package, json_version) File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 313, in select Execute(command, sudo=True) File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 262, in action_run tries=self.resource.tries, try_sleep=self.resource.try_sleep) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner result = function(command, **kwargs) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of 'ambari-python-wrap /usr/bin/hdp-select set oozie-client 2.5.3.0-37' returned 1. symlink target /usr/hdp/current/oozie-client for oozie already exists and it is not a symlink. stdout: /var/lib/ambari-agent/data/output-2339.txt 2019-08-08 13:46:45,292 - Using hadoop conf dir: /usr/hdp/2.5.3.0-37/hadoop/conf 2019-08-08 13:46:45,318 - Execute[('ambari-python-wrap', u'/usr/bin/hdp-select', 'set', u'oozie-client', u'2.5.3.0-37')] {'sudo': True} 2019-08-08 13:46:45,341 - The repository with version 2.5.3.0-37 for this command has been marked as resolved. It will be used to report the version of the component which was installed Any hints how to avoid/fix this problem? ... View more

Used tool versions: Latest Metron-0.7.1 supported tools: HDP-2.5, ambari-2.6.2.2, HDP-2.5.3.0, HDP-UTILS-1.1.0.21 and metron-0.7.1.0/HCP 1.9.1.0-6 Error Messages/Callstack: Metron Alerts UI Install: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1/package/scripts/alerts_ui_master.py", line 92, in <module> AlertsUIMaster().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/METRON/0.7.1/package/scripts/alerts_ui_master.py", line 41, in install self.install_packages(env) File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 821, in install_packages retry_count=agent_stack_retry_count) File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/ambari-agent/lib/resource_management/core/providers/package/__init__.py", line 53, in action_install ... File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install metron-common' returned 1. Error: Nothing to do The advice from these pages was taken into account and did not help: - https://community.hortonworks.com/questions/167304/metron-hcp-cybersecurity-installation-fails-using.html -> yum install -y epel-release - https://community.hortonworks.com/questions/169952/error-in-installing-clients-for-any-service.html -> yum remove problem_package Any hints how to avoid/fix this problem? ... View more

I get the following error condition: 2019-07-31 15:40:46,158 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=None -> 3.1 Using openjdk version "1.8.0_212", Hortonworks 3.1 I have checked all solution aspects in com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure and https://community.hortonworks.com/content/supportkb/196253/commysqljdbcexceptionsjdbc4communicationsexception.html . They all don't help with my problem. Command aborted. Reason: 'Server considered task failed and automatically aborted it' 2019-07-31 17:00:22,742 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=None -> 3.1 2019-07-31 17:00:22,746 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf 2019-07-31 17:00:23,140 - Setting up Ranger KMS DB and DB User 2019-07-31 17:00:23,141 - Execute['ambari-python-wrap /usr/hdp/current/ranger-kms/dba_script.py -q'] {'logoutput': True, 'environment': {'RANGER_KMS_HOME': u'/usr/hdp/current/ranger-kms', 'JAVA_HOME': u'/usr/lib/jvm/java-8-openjdk-amd64/'}, 'tries': 5, 'user': 'kms', 'try_sleep': 10} 2019-07-31 17:00:23,173 [I] Running DBA setup script. QuiteMode:True 2019-07-31 17:00:23,173 [I] Using Java:/usr/lib/jvm/java-8-openjdk-amd64/bin/java 2019-07-31 17:00:23,173 [I] DB FLAVOR:MYSQL 2019-07-31 17:00:23,173 [I] DB Host:<FQDN_of_servername> 2019-07-31 17:00:23,173 [I] ---------- Verifing DB root password ---------- 2019-07-31 17:00:23,174 [I] DBA root user password validated 2019-07-31 17:00:23,174 [I] ---------- Verifing Ranger KMS db user password ---------- 2019-07-31 17:00:23,174 [I] KMS user password validated 2019-07-31 17:00:23,174 [I] ---------- Creating Ranger KMS db user ---------- 2019-07-31 17:00:23,174 [JISQL] /usr/lib/jvm/java-8-openjdk-amd64/bin/java -cp /usr/hdp/current/ranger-kms/ews/webapp/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://<FQDN_of_servername>/mysql -u root -p '********' -noheader -trim -c \; -query "SELECT version();" SQLException : SQL state: 08S01 com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server. ErrorCode: 0 2019-07-31 17:00:23,402 [E] Can't establish db connection.. Exiting.. 2019-07-31 17:00:23,407 - Retrying after 10 seconds. Reason: Execution of 'ambari-python-wrap /usr/hdp/current/ranger-kms/dba_script.py -q' returned 1. 2019-07-31 17:00:23,173 [I] Running DBA setup script. QuiteMode:True 2019-07-31 17:00:23,173 [I] Using Java:/usr/lib/jvm/java-8-openjdk-amd64/bin/java 2019-07-31 17:00:23,173 [I] DB FLAVOR:MYSQL 2019-07-31 17:00:23,173 [I] DB Host:<FQDN_of_servername> 2019-07-31 17:00:23,173 [I] ---------- Verifing DB root password ---------- 2019-07-31 17:00:23,174 [I] DBA root user password validated 2019-07-31 17:00:23,174 [I] ---------- Verifing Ranger KMS db user password ---------- 2019-07-31 17:00:23,174 [I] KMS user password validated 2019-07-31 17:00:23,174 [I] ---------- Creating Ranger KMS db user ---------- 2019-07-31 17:00:23,174 [JISQL] /usr/lib/jvm/java-8-openjdk-amd64/bin/java -cp /usr/hdp/current/ranger-kms/ews/webapp/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://<FQDN_of_servername>/mysql -u root -p '********' -noheader -trim -c \; -query "SELECT version();" SQLException : SQL state: 08S01 com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server. ErrorCode: 0 2019-07-31 17:00:23,402 [E] Can't establish db connection.. Exiting.. Later in Ambari: Error: 500 status code received on DELETE method for API: /api/v1/clusters/myclustername Error message: org.apache.ambari.server.controller.spi.SystemException: An internal system exception occurred: Could not delete cluster, clusterName=myclustername ... View more

ERROR: HST Server Start Error: Command aborted. Reason: 'Server considered task failed and automatically aborted it', Command failed after 1 tries 2019-07-31 15:40:46,158 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=None -> 3.1 Using openjdk version "1.8.0_212", Hortonworks 3.1 Description: After configuring Ambari to use PostgreSQL where-ever possible and configuring/testing the DBs, users, connections successfully, I'm getting the following "warning" which leads to the failure of all successive install jobs - only with "warning" but the Hadoop cluster doesn't work afterwards: "... Writing configs to : /etc/hst/conf/hst-agent.ini Command: chmod 644 /etc/hst/conf/hst-agent.ini Exit code: 0 Std Out: None Std Err: None fileOwner for config files: 2019-07-31 15:40:46,158 - File['/etc/hst/conf/anonymization_rules.json'] {'content': InlineTemplate(...), 'owner': '', 'mode': 0644} 2019-07-31 15:40:46,160 - File['/etc/hst/conf/productinfo.json'] {'content': InlineTemplate(...), 'owner': '', 'mode': 0644} 2019-07-31 15:40:46,162 - File['/etc/hst/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': '', 'mode': 0644} 2019-07-31 15:40:46,165 - Directory['/usr/lib/ambari-logsearch-logfeeder/conf'] {'create_parents': True, 'mode': 0755, 'cd_access': 'a'} 2019-07-31 15:40:46,166 - Generate Log Feeder config file: /usr/lib/ambari-logsearch-logfeeder/conf/input.config-smartsense.json 2019-07-31 15:40:46,166 - File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-smartsense.json'] {'content': Template('input.config-smartsense.json.j2'), 'mode': 0644} Writing configs to : /etc/hst/conf/hst-server.ini Command: chmod 644 /etc/hst/conf/hst-server.ini Exit code: 0 Std Out: None Std Err: None fileOwner for config files: 2019-07-31 15:40:46,173 - File['/etc/hst/conf/anonymization_rules.json'] {'content': InlineTemplate(...), 'owner': '', 'mode': 0644} 2019-07-31 15:40:46,174 - File['/etc/hst/conf/productinfo.json'] {'content': InlineTemplate(...), 'owner': '', 'mode': 0644} 2019-07-31 15:40:46,176 - File['/etc/hst/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': '', 'mode': 0644} 2019-07-31 15:40:46,178 - Directory['/usr/lib/ambari-logsearch-logfeeder/conf'] {'create_parents': True, 'mode': 0755, 'cd_access': 'a'} 2019-07-31 15:40:46,178 - Generate Log Feeder config file: /usr/lib/ambari-logsearch-logfeeder/conf/input.config-smartsense.json 2019-07-31 15:40:46,178 - File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-smartsense.json'] {'content': Template('input.config-smartsense.json.j2'), 'mode': 0644} Command aborted. Reason: 'Server considered task failed and automatically aborted it' Command failed after 1 tries" Any hints what is causing this? ... View more