Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

hdp 2.7 new install error java.net.BindException: java.net.BindException [hostname:53] Address already in use

Highlighted

hdp 2.7 new install error java.net.BindException: java.net.BindException [hostname:53] Address already in use

New Contributor

Currently installing the latest build of HDP 3.0 or 2.7.x on a 12 node virtual environment. After several retries on installation of components I am stuck on YARN REGISTRY DNS START portion of the installation process.

I have attempted several times and have been unable to continue the installation. Once I get to this point, I am unable to retry the installation and I am able to get to the Ambari admin page but everything except Zookeeper is broken.

My environment is as follows:

CENTOS 7 with all current updates

Oracle Virtualbox VMs with 32 GB on Admin/Name Nodes 1 & 2

16 GB on all 9 Data Nodes. 16 cores on each vm

All preliminary settings are completed as per documentation including ulimit

Some help would be greatly appreciated.

Error logs:

stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/YARN/package/scripts/yarn_registry_dns.py", line 93, in <module> RegistryDNS().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/YARN/package/scripts/yarn_registry_dns.py", line 53, in start service('registrydns',action='start') File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 89, in thunk return fn(*args, **kwargs) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/YARN/package/scripts/service.py", line 92, in service Execute(daemon_cmd, user = usr, not_if = check_process) File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run returns=self.resource.returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner result = function(command, **kwargs) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of 'ulimit -c unlimited; export HADOOP_LIBEXEC_DIR=/usr/hdp/3.0.0.0-1634/hadoop/libexec && /usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/yarn --config /usr/hdp/3.0.0.0-1634/hadoop/conf --daemon start registrydns' returned 1. ERROR: Cannot set priority of registrydns process 5623 stdout: 2018-08-20 12:41:20,484 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634 -> 3.0.0.0-1634 2018-08-20 12:41:20,515 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf 2018-08-20 12:41:20,825 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634 -> 3.0.0.0-1634 2018-08-20 12:41:20,832 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf 2018-08-20 12:41:20,834 - Group['kms'] {} 2018-08-20 12:41:20,835 - Group['livy'] {} 2018-08-20 12:41:20,836 - Group['spark'] {} 2018-08-20 12:41:20,836 - Group['ranger'] {} 2018-08-20 12:41:20,836 - Group['hdfs'] {} 2018-08-20 12:41:20,836 - Group['hadoop'] {} 2018-08-20 12:41:20,836 - Group['users'] {} 2018-08-20 12:41:20,837 - Group['knox'] {} 2018-08-20 12:41:20,837 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,839 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,841 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,842 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,844 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,847 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-08-20 12:41:20,849 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,851 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,853 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger', 'hadoop'], 'uid': None} 2018-08-20 12:41:20,855 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-08-20 12:41:20,858 - User['kms'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['kms', 'hadoop'], 'uid': None} 2018-08-20 12:41:20,860 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['livy', 'hadoop'], 'uid': None} 2018-08-20 12:41:20,862 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['spark', 'hadoop'], 'uid': None} 2018-08-20 12:41:20,865 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-08-20 12:41:20,867 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,869 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None} 2018-08-20 12:41:20,871 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,874 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,875 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,877 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-20 12:41:20,878 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'knox'], 'uid': None} 2018-08-20 12:41:20,879 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-08-20 12:41:20,881 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2018-08-20 12:41:20,891 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2018-08-20 12:41:20,892 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'} 2018-08-20 12:41:20,893 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-08-20 12:41:20,895 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-08-20 12:41:20,896 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {} 2018-08-20 12:41:20,912 - call returned (0, '1020') 2018-08-20 12:41:20,913 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1020'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'} 2018-08-20 12:41:20,922 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1020'] due to not_if 2018-08-20 12:41:20,922 - Group['hdfs'] {} 2018-08-20 12:41:20,923 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', u'hdfs']} 2018-08-20 12:41:20,924 - FS Type: HDFS 2018-08-20 12:41:20,924 - Directory['/etc/hadoop'] {'mode': 0755} 2018-08-20 12:41:20,941 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2018-08-20 12:41:20,942 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2018-08-20 12:41:20,967 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'} 2018-08-20 12:41:20,978 - Skipping Execute[('setenforce', '0')] due to not_if 2018-08-20 12:41:20,978 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'} 2018-08-20 12:41:20,982 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'} 2018-08-20 12:41:20,983 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs', 'cd_access': 'a'} 2018-08-20 12:41:20,983 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'} 2018-08-20 12:41:20,988 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'} 2018-08-20 12:41:20,990 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'} 2018-08-20 12:41:20,997 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644} 2018-08-20 12:41:21,011 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2018-08-20 12:41:21,013 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755} 2018-08-20 12:41:21,014 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'} 2018-08-20 12:41:21,021 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644} 2018-08-20 12:41:21,030 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755} 2018-08-20 12:41:21,036 - Skipping unlimited key JCE policy check and setup since it is not required 2018-08-20 12:41:21,439 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf 2018-08-20 12:41:21,440 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634 -> 3.0.0.0-1634 2018-08-20 12:41:21,465 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf 2018-08-20 12:41:21,479 - Directory['/var/log/hadoop-yarn'] {'group': 'hadoop', 'cd_access': 'a', 'create_parents': True, 'ignore_failures': True, 'mode': 0775, 'owner': 'yarn'} 2018-08-20 12:41:21,482 - Directory['/var/run/hadoop-yarn'] {'owner': 'yarn', 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'} 2018-08-20 12:41:21,482 - Directory['/var/run/hadoop-yarn/yarn'] {'owner': 'yarn', 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'} 2018-08-20 12:41:21,483 - Directory['/var/log/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'create_parents': True, 'cd_access': 'a'} 2018-08-20 12:41:21,484 - Directory['/var/run/hadoop-mapreduce'] {'owner': 'mapred', 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'} 2018-08-20 12:41:21,484 - Directory['/var/run/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'} 2018-08-20 12:41:21,485 - Directory['/var/log/hadoop-mapreduce'] {'owner': 'mapred', 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'} 2018-08-20 12:41:21,485 - Directory['/var/log/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'create_parents': True, 'cd_access': 'a'} 2018-08-20 12:41:21,486 - Directory['/usr/hdp/3.0.0.0-1634/hadoop/conf/embedded-yarn-ats-hbase'] {'owner': 'yarn-ats', 'group': 'hadoop', 'create_parents': True, 'cd_access': 'a'} 2018-08-20 12:41:21,496 - Directory['/usr/lib/ambari-logsearch-logfeeder/conf'] {'create_parents': True, 'mode': 0755, 'cd_access': 'a'} 2018-08-20 12:41:21,497 - Generate Log Feeder config file: /usr/lib/ambari-logsearch-logfeeder/conf/input.config-yarn.json 2018-08-20 12:41:21,497 - File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-yarn.json'] {'content': Template('input.config-yarn.json.j2'), 'mode': 0644} 2018-08-20 12:41:21,498 - XmlConfig['core-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'mode': 0644, 'configuration_attributes': {u'final': {u'fs.defaultFS': u'true'}}, 'owner': 'hdfs', 'configurations': ...} 2018-08-20 12:41:21,507 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/core-site.xml 2018-08-20 12:41:21,508 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/core-site.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-08-20 12:41:21,541 - Writing File['/usr/hdp/3.0.0.0-1634/hadoop/conf/core-site.xml'] because contents don't match 2018-08-20 12:41:21,542 - XmlConfig['hdfs-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'mode': 0644, 'configuration_attributes': {u'final': {u'dfs.datanode.failed.volumes.tolerated': u'true', u'dfs.datanode.data.dir': u'true', u'dfs.namenode.http-address': u'true', u'dfs.namenode.name.dir': u'true', u'dfs.webhdfs.enabled': u'true'}}, 'owner': 'hdfs', 'configurations': ...} 2018-08-20 12:41:21,552 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/hdfs-site.xml 2018-08-20 12:41:21,552 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hdfs-site.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-08-20 12:41:21,606 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'yarn', 'configurations': ...} 2018-08-20 12:41:21,615 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/mapred-site.xml 2018-08-20 12:41:21,615 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/mapred-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-08-20 12:41:21,661 - Changing owner for /usr/hdp/3.0.0.0-1634/hadoop/conf/mapred-site.xml from 1019 to yarn 2018-08-20 12:41:21,662 - XmlConfig['yarn-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'mode': 0644, 'configuration_attributes': {u'hidden': {u'hadoop.registry.dns.bind-port': u'true'}}, 'owner': 'yarn', 'configurations': ...} 2018-08-20 12:41:21,671 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/yarn-site.xml 2018-08-20 12:41:21,671 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/yarn-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-08-20 12:41:21,810 - XmlConfig['capacity-scheduler.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'yarn', 'configurations': ...} 2018-08-20 12:41:21,819 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/capacity-scheduler.xml 2018-08-20 12:41:21,820 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/capacity-scheduler.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-08-20 12:41:21,838 - Changing owner for /usr/hdp/3.0.0.0-1634/hadoop/conf/capacity-scheduler.xml from 1016 to yarn 2018-08-20 12:41:21,839 - XmlConfig['hbase-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf/embedded-yarn-ats-hbase', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'yarn-ats', 'configurations': ...} 2018-08-20 12:41:21,847 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/embedded-yarn-ats-hbase/hbase-site.xml 2018-08-20 12:41:21,848 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/embedded-yarn-ats-hbase/hbase-site.xml'] {'owner': 'yarn-ats', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-08-20 12:41:21,886 - XmlConfig['resource-types.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'yarn', 'configurations': {u'yarn.resource-types.yarn.io_gpu.maximum-allocation': u'8', u'yarn.resource-types': u''}} 2018-08-20 12:41:21,895 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/resource-types.xml 2018-08-20 12:41:21,896 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/resource-types.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-08-20 12:41:21,901 - File['/etc/security/limits.d/yarn.conf'] {'content': Template('yarn.conf.j2'), 'mode': 0644} 2018-08-20 12:41:21,903 - File['/etc/security/limits.d/mapreduce.conf'] {'content': Template('mapreduce.conf.j2'), 'mode': 0644} 2018-08-20 12:41:21,913 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/yarn-env.sh'] {'content': InlineTemplate(...), 'owner': 'yarn', 'group': 'hadoop', 'mode': 0755} 2018-08-20 12:41:21,914 - File['/usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/container-executor'] {'group': 'hadoop', 'mode': 02050} 2018-08-20 12:41:21,919 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/container-executor.cfg'] {'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644} 2018-08-20 12:41:21,920 - Directory['/cgroups_test/cpu'] {'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'} 2018-08-20 12:41:21,923 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/mapred-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'mode': 0755} 2018-08-20 12:41:21,925 - Directory['/var/log/hadoop-yarn/nodemanager/recovery-state'] {'owner': 'yarn', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'} 2018-08-20 12:41:21,928 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/taskcontroller.cfg'] {'content': Template('taskcontroller.cfg.j2'), 'owner': 'hdfs'} 2018-08-20 12:41:21,929 - XmlConfig['mapred-site.xml'] {'owner': 'mapred', 'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'configuration_attributes': {}, 'configurations': ...} 2018-08-20 12:41:21,938 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/mapred-site.xml 2018-08-20 12:41:21,938 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/mapred-site.xml'] {'owner': 'mapred', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'} 2018-08-20 12:41:22,002 - Changing owner for /usr/hdp/3.0.0.0-1634/hadoop/conf/mapred-site.xml from 1018 to mapred 2018-08-20 12:41:22,002 - XmlConfig['capacity-scheduler.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'configuration_attributes': {}, 'configurations': ...} 2018-08-20 12:41:22,011 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/capacity-scheduler.xml 2018-08-20 12:41:22,011 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/capacity-scheduler.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'} 2018-08-20 12:41:22,029 - Changing owner for /usr/hdp/3.0.0.0-1634/hadoop/conf/capacity-scheduler.xml from 1018 to hdfs 2018-08-20 12:41:22,029 - XmlConfig['ssl-client.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'configuration_attributes': {}, 'configurations': ...} 2018-08-20 12:41:22,038 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/ssl-client.xml 2018-08-20 12:41:22,038 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/ssl-client.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'} 2018-08-20 12:41:22,044 - Directory['/usr/hdp/3.0.0.0-1634/hadoop/conf/secure'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'} 2018-08-20 12:41:22,045 - XmlConfig['ssl-client.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf/secure', 'configuration_attributes': {}, 'configurations': ...} 2018-08-20 12:41:22,054 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/secure/ssl-client.xml 2018-08-20 12:41:22,054 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/secure/ssl-client.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'} 2018-08-20 12:41:22,060 - XmlConfig['ssl-server.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'configuration_attributes': {}, 'configurations': ...} 2018-08-20 12:41:22,069 - Generating config: /usr/hdp/3.0.0.0-1634/hadoop/conf/ssl-server.xml 2018-08-20 12:41:22,069 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/ssl-server.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'} 2018-08-20 12:41:22,076 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/ssl-client.xml.example'] {'owner': 'mapred', 'group': 'hadoop'} 2018-08-20 12:41:22,077 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/ssl-server.xml.example'] {'owner': 'mapred', 'group': 'hadoop'} 2018-08-20 12:41:22,078 - Execute['export HADOOP_LIBEXEC_DIR=/usr/hdp/3.0.0.0-1634/hadoop/libexec && /usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/yarn --config /usr/hdp/3.0.0.0-1634/hadoop/conf --daemon stop registrydns'] {'only_if': 'ambari-sudo.sh -H -E test -f /var/run/hadoop-yarn/yarn/hadoop-yarn-root-registrydns.pid && ambari-sudo.sh -H -E pgrep -F /var/run/hadoop-yarn/yarn/hadoop-yarn-root-registrydns.pid', 'user': 'root'} 2018-08-20 12:41:22,086 - Skipping Execute['export HADOOP_LIBEXEC_DIR=/usr/hdp/3.0.0.0-1634/hadoop/libexec && /usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/yarn --config /usr/hdp/3.0.0.0-1634/hadoop/conf --daemon stop registrydns'] due to only_if 2018-08-20 12:41:22,087 - call['! ( ambari-sudo.sh -H -E test -f /var/run/hadoop-yarn/yarn/hadoop-yarn-root-registrydns.pid && ambari-sudo.sh -H -E pgrep -F /var/run/hadoop-yarn/yarn/hadoop-yarn-root-registrydns.pid )'] {'tries': 5, 'try_sleep': 5, 'env': {'HADOOP_LIBEXEC_DIR': '/usr/hdp/3.0.0.0-1634/hadoop/libexec'}} 2018-08-20 12:41:22,094 - call returned (0, '') 2018-08-20 12:41:22,095 - Execute['export HADOOP_LIBEXEC_DIR=/usr/hdp/3.0.0.0-1634/hadoop/libexec && /usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/yarn --config /usr/hdp/3.0.0.0-1634/hadoop/conf --daemon stop registrydns'] {'only_if': 'ambari-sudo.sh -H -E test -f /var/run/hadoop-yarn/yarn/hadoop-yarn-registrydns.pid && ambari-sudo.sh -H -E pgrep -F /var/run/hadoop-yarn/yarn/hadoop-yarn-registrydns.pid', 'user': 'yarn'} 2018-08-20 12:41:22,102 - Skipping Execute['export HADOOP_LIBEXEC_DIR=/usr/hdp/3.0.0.0-1634/hadoop/libexec && /usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/yarn --config /usr/hdp/3.0.0.0-1634/hadoop/conf --daemon stop registrydns'] due to only_if 2018-08-20 12:41:22,103 - call['! ( ambari-sudo.sh -H -E test -f /var/run/hadoop-yarn/yarn/hadoop-yarn-registrydns.pid && ambari-sudo.sh -H -E pgrep -F /var/run/hadoop-yarn/yarn/hadoop-yarn-registrydns.pid )'] {'tries': 5, 'try_sleep': 5, 'env': {'PATH': '/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/var/lib/ambari-agent:/var/lib/ambari-agent', 'HADOOP_LIBEXEC_DIR': '/usr/hdp/3.0.0.0-1634/hadoop/libexec'}} 2018-08-20 12:41:22,110 - call returned (0, '') 2018-08-20 12:41:22,111 - Execute['ulimit -c unlimited; export HADOOP_LIBEXEC_DIR=/usr/hdp/3.0.0.0-1634/hadoop/libexec && /usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/yarn --config /usr/hdp/3.0.0.0-1634/hadoop/conf --daemon start registrydns'] {'not_if': 'ambari-sudo.sh -H -E test -f /var/run/hadoop-yarn/yarn/hadoop-yarn-root-registrydns.pid && ambari-sudo.sh -H -E pgrep -F /var/run/hadoop-yarn/yarn/hadoop-yarn-root-registrydns.pid', 'user': 'root'} 2018-08-20 12:41:29,413 - Execute['find /var/log/hadoop-yarn/yarn -maxdepth 1 -type f -name '*' -exec echo '==> {} <==' \; -exec tail -n 40 {} \;'] {'logoutput': True, 'ignore_failures': True, 'user': 'root'} ==> /var/log/hadoop-yarn/yarn/privileged-root-registrydns-d201-2-ht30-admin1.cluster.ca.out <== core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 127911 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 32768 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 65536 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited ==> /var/log/hadoop-yarn/yarn/hadoop-yarn-root-registrydns-d201-2-ht30-admin1.cluster.ca.out <== ==> /var/log/hadoop-yarn/yarn/privileged-root-registrydns-d201-2-ht30-admin1.cluster.ca.err <== java.net.BindException: Problem binding to [d201-2-ht30-admin1.cluster.ca:53] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:831) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:736) at org.apache.hadoop.registry.server.dns.RegistryDNS.openUDPChannel(RegistryDNS.java:1012) at org.apache.hadoop.registry.server.dns.RegistryDNS.addNIOUDP(RegistryDNS.java:921) at org.apache.hadoop.registry.server.dns.RegistryDNS.initializeChannels(RegistryDNS.java:192) at org.apache.hadoop.registry.server.dns.PrivilegedRegistryDNSStarter.init(PrivilegedRegistryDNSStarter.java:59) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:207) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:433) at sun.nio.ch.DatagramChannelImpl.bind(DatagramChannelImpl.java:691) at sun.nio.ch.DatagramSocketAdaptor.bind(DatagramSocketAdaptor.java:91) at org.apache.hadoop.registry.server.dns.RegistryDNS.openUDPChannel(RegistryDNS.java:1010) ... 8 more Cannot load daemon Service exit with a return value of 3 ==> /var/log/hadoop-yarn/yarn/hadoop-yarn-root-registrydns-d201-2-ht30-admin1.cluster.ca.log <== 2018-08-20 12:41:23,005 INFO dns.PrivilegedRegistryDNSStarter (LogAdapter.java:info(51)) - STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting RegistryDNSServer STARTUP_MSG: host = d201-2-ht30-admin1.cluster.ca/131.137.161.91 STARTUP_MSG: args = [] STARTUP_MSG: version = 3.1.0.3.0.0.0-1634 STARTUP_MSG: classpath = /usr/hdp/3.0.0.0-1634/hadoop/conf:/usr/hdp/3.0.0.0-1634/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jackson-annotations-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jackson-core-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jackson-databind-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/ranger-hdfs-plugin-shim-1.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/ranger-plugin-classloader-1.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/ranger-yarn-plugin-shim-1.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1634/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-annotations-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-auth-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-common-3.1.0.3.0.0.0-1634-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-common-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-kms-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-nfs-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jackson-annotations-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jackson-core-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jackson-databind-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-3.1.0.3.0.0.0-1634-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-client-3.1.0.3.0.0.0-1634-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-client-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-native-client-3.1.0.3.0.0.0-1634-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-native-client-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-nfs-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-rbf-3.1.0.3.0.0.0-1634-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-rbf-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-hdfs/.//hadoop-hdfs.jar::/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//azure-keyvault-core-1.0.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//azure-storage-7.0.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//gcs-connector-1.9.0.3.0.0.0-1634-shaded.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-aliyun-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-archive-logs-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-archives-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-aws-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-azure-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-azure-datalake-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-datajoin-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-distcp-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-extras-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-fs2img-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-gridmix-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-kafka-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.1.0.3.0.0.0-1634-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-openstack-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-resourceestimator-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-rumen-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-sls-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-streaming-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1634/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/./:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/jackson-jaxrs-base-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/objenesis-1.0.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-api-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-client-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-common-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-registry-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-common-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-router-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-tests-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-services-api-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-services-core-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1634/tez/hadoop-shim-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/hadoop-shim-2.8-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-api-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-common-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-dag-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-examples-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-history-parser-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-javadoc-tools-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-job-analyzer-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-mapreduce-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-protobuf-history-plugin-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-runtime-internals-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-runtime-library-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-tests-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-cache-plugin-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-history-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-history-with-acls-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-history-with-fs-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1634/tez/lib/async-http-client-1.9.40.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1634/tez/lib/gcs-connector-1.9.0.3.0.0.0-1634-shaded.jar:/usr/hdp/3.0.0.0-1634/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-aws-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-azure-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-azure-datalake-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-hdfs-client-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-mapreduce-client-common-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-mapreduce-client-core-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1634/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1634/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1634/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1634/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1634/tez/conf:/usr/hdp/3.0.0.0-1634/tez/conf_llap:/usr/hdp/3.0.0.0-1634/tez/doc:/usr/hdp/3.0.0.0-1634/tez/hadoop-shim-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/hadoop-shim-2.8-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib:/usr/hdp/3.0.0.0-1634/tez/man:/usr/hdp/3.0.0.0-1634/tez/tez-api-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-common-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-dag-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-examples-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-history-parser-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-javadoc-tools-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-job-analyzer-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-mapreduce-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-protobuf-history-plugin-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-runtime-internals-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-runtime-library-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-tests-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-cache-plugin-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-history-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-history-with-acls-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/tez-yarn-timeline-history-with-fs-0.9.1.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/ui:/usr/hdp/3.0.0.0-1634/tez/lib/async-http-client-1.9.40.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1634/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1634/tez/lib/gcs-connector-1.9.0.3.0.0.0-1634-shaded.jar:/usr/hdp/3.0.0.0-1634/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-aws-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-azure-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-azure-datalake-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-hdfs-client-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-mapreduce-client-common-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-mapreduce-client-core-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.1.0.3.0.0.0-1634.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1634/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1634/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1634/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1634/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1634/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1634/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1634/tez/lib/tez.tar.gz STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r ab6fed463d44250e0f1cc433987c9de0592db596; compiled by 'jenkins' on 2018-07-12T20:32Z STARTUP_MSG: java = 1.8.0_112 ************************************************************/ 2018-08-20 12:41:23,019 INFO dns.PrivilegedRegistryDNSStarter (LogAdapter.java:info(51)) - registered UNIX signal handlers for [TERM, HUP, INT] 2018-08-20 12:41:23,266 INFO dns.RegistryDNS (RegistryDNS.java:initializeChannels(191)) - Opening TCP and UDP channels on /0.0.0.0 port 53 2018-08-20 12:41:23,278 ERROR dns.PrivilegedRegistryDNSStarter (PrivilegedRegistryDNSStarter.java:init(61)) - Error initializing Registry DNS java.net.BindException: Problem binding to [d201-2-ht30-admin1.cluster.ca:53] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:831) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:736) at org.apache.hadoop.registry.server.dns.RegistryDNS.openUDPChannel(RegistryDNS.java:1012) at org.apache.hadoop.registry.server.dns.RegistryDNS.addNIOUDP(RegistryDNS.java:921) at org.apache.hadoop.registry.server.dns.RegistryDNS.initializeChannels(RegistryDNS.java:192) at org.apache.hadoop.registry.server.dns.PrivilegedRegistryDNSStarter.init(PrivilegedRegistryDNSStarter.java:59) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:207) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:433) at sun.nio.ch.DatagramChannelImpl.bind(DatagramChannelImpl.java:691) at sun.nio.ch.DatagramSocketAdaptor.bind(DatagramSocketAdaptor.java:91) at org.apache.hadoop.registry.server.dns.RegistryDNS.openUDPChannel(RegistryDNS.java:1010) ... 8 more Command failed after 1 tries

2 REPLIES 2

Re: hdp 2.7 new install error java.net.BindException: java.net.BindException [hostname:53] Address already in use

Super Mentor

@Ray Donovan

We see that you are getting the error:

ERROR dns.PrivilegedRegistryDNSStarter (PrivilegedRegistryDNSStarter.java:init(61)) - Error initializing Registry DNS java.net.BindException: Problem binding to [xxxxxxxxxxxx.cluster.ca:53] java.net.BindException: Address 
already in use; For more details see: http://wiki.apache.org/hadoop/BindException
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

.

RegistryDNS Bind Port default value is "53" so please make sure that the mentioned port is not being used by some other process on the host where the registryDNS is failing to start (or try changing the port to some other port which is not in use).

Check if the port 53 is in use?

# netstat -tnlpa | grep 53

.

Ambari UI --> Yarn --> Configs --> Advanced --> Registry --> "RegistryDNS Bind Port"  (53 is default value)

Re: hdp 2.7 new install error java.net.BindException: java.net.BindException [hostname:53] Address already in use

New Contributor

Hi,

I had the same issue with HDP 3.0 on a fresh CentOS7. Port 53 was already taken by dnsmasq.

I changed the port and now it is working fine.