Created 01-04-2017 06:46 PM
Ranger is failing to install admin.
HDP version - 2.4
Ranger version - 0.5
Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/ranger_admin.py", line 124, in <module> RangerAdmin().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/ranger_admin.py", line 43, in install setup_ranger_db() File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py", line 186, in setup_ranger_db sudo=True) File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 238, in action_run tries=self.resource.tries, try_sleep=self.resource.try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call raise Fail(err_msg) resource_management.core.exceptions.Fail: Execution of 'cp --remove-destination /var/lib/ambari-agent/tmp/mysql-connector-java.jar /usr/hdp/current/ranger-admin/ews/lib' returned 1. cp: cannot create regular file `/usr/hdp/current/ranger-admin/ews/lib': No such file or directory
2017-01-04 18:43:28,496 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.4.0.0-169 2017-01-04 18:43:28,497 - Checking if need to create versioned conf dir /etc/hadoop/2.4.0.0-169/0 2017-01-04 18:43:28,497 - call['conf-select create-conf-dir --package hadoop --stack-version 2.4.0.0-169 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1} 2017-01-04 18:43:28,519 - call returned (1, '/etc/hadoop/2.4.0.0-169/0 exist already', '') 2017-01-04 18:43:28,519 - checked_call['conf-select set-conf-dir --package hadoop --stack-version 2.4.0.0-169 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False} 2017-01-04 18:43:28,540 - checked_call returned (0, '/usr/hdp/2.4.0.0-169/hadoop/conf -> /etc/hadoop/2.4.0.0-169/0') 2017-01-04 18:43:28,540 - Ensuring that hadoop has the correct symlink structure 2017-01-04 18:43:28,540 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2017-01-04 18:43:28,542 - Group['spark'] {} 2017-01-04 18:43:28,543 - Group['ranger'] {} 2017-01-04 18:43:28,543 - Group['zeppelin'] {} 2017-01-04 18:43:28,544 - Group['hadoop'] {} 2017-01-04 18:43:28,544 - Group['users'] {} 2017-01-04 18:43:28,544 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,545 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,545 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']} 2017-01-04 18:43:28,546 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,547 - User['falcon'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']} 2017-01-04 18:43:28,547 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger']} 2017-01-04 18:43:28,548 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']} 2017-01-04 18:43:28,548 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,549 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,550 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']} 2017-01-04 18:43:28,550 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,551 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,551 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,552 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,552 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']} 2017-01-04 18:43:28,553 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2017-01-04 18:43:28,555 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2017-01-04 18:43:28,559 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if 2017-01-04 18:43:28,559 - Group['hdfs'] {} 2017-01-04 18:43:28,560 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'hdfs']} 2017-01-04 18:43:28,560 - Directory['/etc/hadoop'] {'mode': 0755} 2017-01-04 18:43:28,572 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2017-01-04 18:43:28,573 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 0777} 2017-01-04 18:43:28,584 - Repository['HDP-2.4'] {'base_url': 'http://usw2dvdprp01.glassdoor.local/HDP-2.4.0.0', 'action': ['create'], 'components': ['HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP', 'mirror_list': None} 2017-01-04 18:43:28,592 - File['/etc/yum.repos.d/HDP.repo'] {'content': '[HDP-2.4]\nname=HDP-2.4\nbaseurl=http://usw2dvdprp01.glassdoor.local/HDP-2.4.0.0\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-01-04 18:43:28,593 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://usw2dvdprp01.glassdoor.local/HDP-UTILS-1.1.0.20', 'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None} 2017-01-04 18:43:28,596 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': '[HDP-UTILS-1.1.0.20]\nname=HDP-UTILS-1.1.0.20\nbaseurl=http://usw2dvdprp01.glassdoor.local/HDP-UTILS-1.1.0.20\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-01-04 18:43:28,596 - Package['unzip'] {} 2017-01-04 18:43:28,684 - Skipping installation of existing package unzip 2017-01-04 18:43:28,684 - Package['curl'] {} 2017-01-04 18:43:28,694 - Skipping installation of existing package curl 2017-01-04 18:43:28,694 - Package['hdp-select'] {} 2017-01-04 18:43:28,703 - Skipping installation of existing package hdp-select 2017-01-04 18:43:28,825 - Package['ranger_2_4_*-admin'] {} 2017-01-04 18:43:28,913 - Skipping installation of existing package ranger_2_4_*-admin 2017-01-04 18:43:28,914 - Package['ranger_2_4_*-usersync'] {} 2017-01-04 18:43:28,923 - Skipping installation of existing package ranger_2_4_*-usersync 2017-01-04 18:43:28,926 - File['/var/lib/ambari-agent/tmp/mysql-connector-java.jar'] {'content': DownloadSource('http://usw2dbdpmn02.glassdoor.local:8080/resources//mysql-jdbc-driver.jar'), 'mode': 0644} 2017-01-04 18:43:28,927 - Not downloading the file from http://usw2dbdpmn02.glassdoor.local:8080/resources//mysql-jdbc-driver.jar, because /var/lib/ambari-agent/tmp/mysql-jdbc-driver.jar already exists 2017-01-04 18:43:28,930 - Directory['/usr/share/java'] {'recursive': True, 'mode': 0755, 'cd_access': 'a'} 2017-01-04 18:43:28,930 - Execute[('cp', '--remove-destination', '/var/lib/ambari-agent/tmp/mysql-connector-java.jar', '/usr/share/java/mysql-connector-java.jar')] {'path': ['/bin', '/usr/bin/'], 'sudo': True} 2017-01-04 18:43:28,938 - File['/usr/share/java/mysql-connector-java.jar'] {'mode': 0644} 2017-01-04 18:43:28,938 - Execute[('cp', '--remove-destination', '/var/lib/ambari-agent/tmp/mysql-connector-java.jar', '/usr/hdp/current/ranger-admin/ews/lib')] {'path': ['/bin', '/usr/bin/'], 'sudo': True}
Please help.
Created 01-04-2017 07:30 PM
I don't see any ranger-admin and ranger-usersync folder under /usr/hdp/2.4.0.0-169/
I noticed that in the installation steps, the message says Skipping installation of existing package 2017-01-04 18:43:28,703 - Skipping installation of existing package hdp-select2017-01-04 18:43:28,825 - Package['ranger_2_4_*-admin'] {}2017-01-04 18:43:28,913 - Skipping installation of existing package ranger_2_4_*-admin2017-01-04 18:43:28,914 - Package['ranger_2_4_*-usersync'] {}
[root@usw2dbdpmn01 ~]# yum list installed |grep ranger ranger_2_2_6_0_2800-hdfs-plugin.x86_64 0.4.0.2.2.6.0-2800.el6 @HDP-2.2 ranger_2_2_6_0_2800-hive-plugin.x86_64 0.4.0.2.2.6.0-2800.el6 @HDP-2.2 ranger_2_4_0_0_169-admin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4 ranger_2_4_0_0_169-hdfs-plugin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4.0.0 ranger_2_4_0_0_169-hive-plugin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4.0.0 ranger_2_4_0_0_169-usersync.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4 ranger_2_4_0_0_169-yarn-plugin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4.0.0
How do I un-install ranger-admin and re-install ?
is running yum remove ranger_2_4_0_0_169-admin will have other adverse effect ?
Created 01-04-2017 07:04 PM
cp: cannot create regular file `/usr/hdp/current/ranger-admin/ews/lib': No such file or directory
Please check this path is correct and parent directory exist.
Also check for disk and permission issues.
Created 01-04-2017 07:11 PM
Probably I should have framed question better. I have the same question too. When I am installing Ranger, it should have installed those packages on that path. But I don't see any error while installing ranger-admin package.
2017-01-04 18:43:28,703 - Skipping installation of existing package hdp-select2017-01-04 18:43:28,825 - Package['ranger_2_4_*-admin'] {}2017-01-04 18:43:28,913 - Skipping installation of existing package ranger_2_4_*-admin2017-01-04 18:43:28,914 - Package['ranger_2_4_*-usersync'] {}
Created 01-04-2017 07:13 PM
Installation directory is /usr/hdp/<version>
Inside /usr/hdp/current it should have symlink to /usr/hdp/<version>/ranger
Please check for broken symlink as well.
Also share output of hdp-select command.
Created 01-04-2017 07:30 PM
I don't see any ranger-admin and ranger-usersync folder under /usr/hdp/2.4.0.0-169/
I noticed that in the installation steps, the message says Skipping installation of existing package 2017-01-04 18:43:28,703 - Skipping installation of existing package hdp-select2017-01-04 18:43:28,825 - Package['ranger_2_4_*-admin'] {}2017-01-04 18:43:28,913 - Skipping installation of existing package ranger_2_4_*-admin2017-01-04 18:43:28,914 - Package['ranger_2_4_*-usersync'] {}
[root@usw2dbdpmn01 ~]# yum list installed |grep ranger ranger_2_2_6_0_2800-hdfs-plugin.x86_64 0.4.0.2.2.6.0-2800.el6 @HDP-2.2 ranger_2_2_6_0_2800-hive-plugin.x86_64 0.4.0.2.2.6.0-2800.el6 @HDP-2.2 ranger_2_4_0_0_169-admin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4 ranger_2_4_0_0_169-hdfs-plugin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4.0.0 ranger_2_4_0_0_169-hive-plugin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4.0.0 ranger_2_4_0_0_169-usersync.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4 ranger_2_4_0_0_169-yarn-plugin.x86_64 0.5.0.2.4.0.0-169.el6 @HDP-2.4.0.0
How do I un-install ranger-admin and re-install ?
is running yum remove ranger_2_4_0_0_169-admin will have other adverse effect ?
Created 01-04-2017 07:48 PM
Un-installing and re-installing resolved the problem.
yum remove ranger_2_4_*-admin yum remove ranger_2_4_*-usersync
Created 01-04-2017 08:30 PM
Please upvote and accept the answer to close the thread.