Support Questions
Find answers, ask questions, and share your expertise

Issue while installing DP Profiler Agent via Ambari for DSS

Issue while installing DP Profiler Agent via Ambari for DSS

Explorer

Hi,

I am trying to install DP Profiler Agent using Ambari 2.7. While installing DP Profiler Agent, I am getting the following error

 

 

stderr: 
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 455, in <module>
    DpProfilerAgent().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 54, in install
    self.install_packages(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 849, in install_packages
    retry_count=agent_stack_retry_count)
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/packaging.py", line 30, in action_install
    self._pkg_manager.install_package(package_name, self.__create_context())
  File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py", line 219, in install_package
    shell.repository_manager_executor(cmd, self.properties, context)
  File "/usr/lib/ambari-agent/lib/ambari_commons/shell.py", line 753, in repository_manager_executor
    raise RuntimeError(message)
RuntimeError: Failed to execute command '/usr/bin/yum -y install profiler_agent', exited with code '1', message: 'Error: Nothing to do
'
 stdout:
2020-05-20 23:26:47,841 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=None -> 3.1
2020-05-20 23:26:47,849 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-05-20 23:26:47,851 - Group['kms'] {}
2020-05-20 23:26:47,852 - Group['livy'] {}
2020-05-20 23:26:47,852 - Group['spark'] {}
2020-05-20 23:26:47,852 - Group['dpprofiler'] {}
2020-05-20 23:26:47,852 - Group['ranger'] {}
2020-05-20 23:26:47,853 - Group['hdfs'] {}
2020-05-20 23:26:47,853 - Group['hadoop'] {}
2020-05-20 23:26:47,853 - Group['users'] {}
2020-05-20 23:26:47,853 - Group['knox'] {}
2020-05-20 23:26:47,854 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,855 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,857 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,858 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,859 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2020-05-20 23:26:47,860 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,861 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,862 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,864 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2020-05-20 23:26:47,865 - User['kms'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['kms', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,866 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['livy', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,867 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['spark', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,868 - User['dpprofiler'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,869 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2020-05-20 23:26:47,871 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,872 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,873 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,874 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,875 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,876 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,878 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'knox'], 'uid': None}
2020-05-20 23:26:47,878 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-05-20 23:26:47,880 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2020-05-20 23:26:47,887 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2020-05-20 23:26:47,887 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2020-05-20 23:26:47,888 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-05-20 23:26:47,890 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-05-20 23:26:47,891 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2020-05-20 23:26:47,901 - call returned (0, '1019')
2020-05-20 23:26:47,901 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1019'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2020-05-20 23:26:47,907 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1019'] due to not_if
2020-05-20 23:26:47,908 - Group['hdfs'] {}
2020-05-20 23:26:47,908 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', u'hdfs']}
2020-05-20 23:26:47,909 - FS Type: HDFS
2020-05-20 23:26:47,909 - Directory['/etc/hadoop'] {'mode': 0755}
2020-05-20 23:26:47,930 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'root', 'group': 'hadoop'}
2020-05-20 23:26:47,931 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2020-05-20 23:26:47,953 - Repository['HDP-3.1-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.1.4.0', 'action': ['prepare'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,961 - Repository['DSS-1.6-repo-1'] {'base_url': 'http://18.132.155.36:9090/DSS-APP/centos7/1.6.0.0-4/', 'action': ['prepare'], 'components': [u'DSS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,963 - Repository['HDP-UTILS-1.1.0.22-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7', 'action': ['prepare'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,965 - Repository['das-1.2.0-repo-1'] {'base_url': 'http://18.132.155.36:9090/DSS-APP/centos7/1.6.0.0-4/', 'action': ['prepare'], 'components': [u'dasbn-repo', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,967 - Repository['HDP-3.1-GPL-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-GPL/centos7/3.x/updates/3.1.4.0', 'action': ['prepare'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,969 - Repository[None] {'action': ['create']}
2020-05-20 23:26:47,970 - File['/tmp/tmppat0NY'] {'content': ...}
2020-05-20 23:26:47,970 - Writing File['/tmp/tmppat0NY'] because contents don't match
2020-05-20 23:26:47,971 - File['/tmp/tmpQ7EMIj'] {'content': StaticFile('/etc/yum.repos.d/ambari-hdp-1.repo')}
2020-05-20 23:26:47,971 - Writing File['/tmp/tmpQ7EMIj'] because contents don't match
2020-05-20 23:26:47,972 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,060 - Skipping installation of existing package unzip
2020-05-20 23:26:48,061 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,069 - Skipping installation of existing package curl
2020-05-20 23:26:48,069 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,080 - Skipping installation of existing package hdp-select
2020-05-20 23:26:48,087 - The repository with version 3.1.4.0-315 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-05-20 23:26:48,092 - Skipping stack-select on DPPROFILER because it does not exist in the stack-select package structure.
2020-05-20 23:26:48,314 - call['ambari-sudo.sh su dpprofiler -l -s /bin/bash -c 'date +%s | sha256sum | base64 | head -c 32  1>/tmp/tmpMnrNdd 2>/tmp/tmpHFniTv''] {'quiet': False}
2020-05-20 23:26:48,372 - call returned (0, '')
2020-05-20 23:26:48,372 - get_user_call_output returned (0, u'OGQyODg1YzVlNTNmZTc3YzhjM2M0ZjEz', u'')
2020-05-20 23:26:48,381 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-05-20 23:26:48,383 - Package['profiler_agent'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,465 - Installing package profiler_agent ('/usr/bin/yum -y install profiler_agent')
2020-05-20 23:26:49,673 - The repository with version 3.1.4.0-315 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-05-20 23:26:49,679 - Skipping stack-select on DPPROFILER because it does not exist in the stack-select package structure.

Command failed after 1 tries

 

Can anyone suggest what is the issue/solution?

 

Regards,

 

2 REPLIES 2

Re: Issue while installing DP Profiler Agent via Ambari for DSS

Explorer

I also setup another repo on the repo server and pointed to it in Ambari versions. 

When I do it first time I get the following error. I spent many hours trying to fix this issue. Any help on this will be highly appreciated. 

 

Thanks.

 

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 455, in <module>
    DpProfilerAgent().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 54, in install
    self.install_packages(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 849, in install_packages
    retry_count=agent_stack_retry_count)
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/packaging.py", line 30, in action_install
    self._pkg_manager.install_package(package_name, self.__create_context())
  File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py", line 219, in install_package
    shell.repository_manager_executor(cmd, self.properties, context)
  File "/usr/lib/ambari-agent/lib/ambari_commons/shell.py", line 753, in repository_manager_executor
    raise RuntimeError(message)
RuntimeError: Failed to execute command '/usr/bin/yum -y install profiler_agent', exited with code '1', message: 'Not using downloaded DSS-1.6-repo-1/repomd.xml because it is older than what we have:

  Current   : Fri Oct  4 05:35:14 2019

  Downloaded: Thu Oct  3 08:15:18 2019

Error: Nothing to do

 

Re: Issue while installing DP Profiler Agent via Ambari for DSS

Explorer

Never mind. cleaning yum repos helped.

$ yum clean all