Support Questions
Find answers, ask questions, and share your expertise

Issue while installing DP Profiler Agent via Ambari for DSS

Explorer

Hi,

I am trying to install DP Profiler Agent using Ambari 2.7. While installing DP Profiler Agent, I am getting the following error

 

 

stderr: 
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 455, in <module>
    DpProfilerAgent().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 54, in install
    self.install_packages(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 849, in install_packages
    retry_count=agent_stack_retry_count)
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/packaging.py", line 30, in action_install
    self._pkg_manager.install_package(package_name, self.__create_context())
  File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py", line 219, in install_package
    shell.repository_manager_executor(cmd, self.properties, context)
  File "/usr/lib/ambari-agent/lib/ambari_commons/shell.py", line 753, in repository_manager_executor
    raise RuntimeError(message)
RuntimeError: Failed to execute command '/usr/bin/yum -y install profiler_agent', exited with code '1', message: 'Error: Nothing to do
'
 stdout:
2020-05-20 23:26:47,841 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=None -> 3.1
2020-05-20 23:26:47,849 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-05-20 23:26:47,851 - Group['kms'] {}
2020-05-20 23:26:47,852 - Group['livy'] {}
2020-05-20 23:26:47,852 - Group['spark'] {}
2020-05-20 23:26:47,852 - Group['dpprofiler'] {}
2020-05-20 23:26:47,852 - Group['ranger'] {}
2020-05-20 23:26:47,853 - Group['hdfs'] {}
2020-05-20 23:26:47,853 - Group['hadoop'] {}
2020-05-20 23:26:47,853 - Group['users'] {}
2020-05-20 23:26:47,853 - Group['knox'] {}
2020-05-20 23:26:47,854 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,855 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,857 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,858 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,859 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2020-05-20 23:26:47,860 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,861 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,862 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,864 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2020-05-20 23:26:47,865 - User['kms'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['kms', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,866 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['livy', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,867 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['spark', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,868 - User['dpprofiler'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,869 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2020-05-20 23:26:47,871 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,872 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None}
2020-05-20 23:26:47,873 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,874 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,875 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,876 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2020-05-20 23:26:47,878 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'knox'], 'uid': None}
2020-05-20 23:26:47,878 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-05-20 23:26:47,880 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2020-05-20 23:26:47,887 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2020-05-20 23:26:47,887 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2020-05-20 23:26:47,888 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-05-20 23:26:47,890 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-05-20 23:26:47,891 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2020-05-20 23:26:47,901 - call returned (0, '1019')
2020-05-20 23:26:47,901 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1019'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2020-05-20 23:26:47,907 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1019'] due to not_if
2020-05-20 23:26:47,908 - Group['hdfs'] {}
2020-05-20 23:26:47,908 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', u'hdfs']}
2020-05-20 23:26:47,909 - FS Type: HDFS
2020-05-20 23:26:47,909 - Directory['/etc/hadoop'] {'mode': 0755}
2020-05-20 23:26:47,930 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'root', 'group': 'hadoop'}
2020-05-20 23:26:47,931 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2020-05-20 23:26:47,953 - Repository['HDP-3.1-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.1.4.0', 'action': ['prepare'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,961 - Repository['DSS-1.6-repo-1'] {'base_url': 'http://18.132.155.36:9090/DSS-APP/centos7/1.6.0.0-4/', 'action': ['prepare'], 'components': [u'DSS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,963 - Repository['HDP-UTILS-1.1.0.22-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7', 'action': ['prepare'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,965 - Repository['das-1.2.0-repo-1'] {'base_url': 'http://18.132.155.36:9090/DSS-APP/centos7/1.6.0.0-4/', 'action': ['prepare'], 'components': [u'dasbn-repo', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,967 - Repository['HDP-3.1-GPL-repo-1'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-GPL/centos7/3.x/updates/3.1.4.0', 'action': ['prepare'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''}
2020-05-20 23:26:47,969 - Repository[None] {'action': ['create']}
2020-05-20 23:26:47,970 - File['/tmp/tmppat0NY'] {'content': ...}
2020-05-20 23:26:47,970 - Writing File['/tmp/tmppat0NY'] because contents don't match
2020-05-20 23:26:47,971 - File['/tmp/tmpQ7EMIj'] {'content': StaticFile('/etc/yum.repos.d/ambari-hdp-1.repo')}
2020-05-20 23:26:47,971 - Writing File['/tmp/tmpQ7EMIj'] because contents don't match
2020-05-20 23:26:47,972 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,060 - Skipping installation of existing package unzip
2020-05-20 23:26:48,061 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,069 - Skipping installation of existing package curl
2020-05-20 23:26:48,069 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,080 - Skipping installation of existing package hdp-select
2020-05-20 23:26:48,087 - The repository with version 3.1.4.0-315 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-05-20 23:26:48,092 - Skipping stack-select on DPPROFILER because it does not exist in the stack-select package structure.
2020-05-20 23:26:48,314 - call['ambari-sudo.sh su dpprofiler -l -s /bin/bash -c 'date +%s | sha256sum | base64 | head -c 32  1>/tmp/tmpMnrNdd 2>/tmp/tmpHFniTv''] {'quiet': False}
2020-05-20 23:26:48,372 - call returned (0, '')
2020-05-20 23:26:48,372 - get_user_call_output returned (0, u'OGQyODg1YzVlNTNmZTc3YzhjM2M0ZjEz', u'')
2020-05-20 23:26:48,381 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-05-20 23:26:48,383 - Package['profiler_agent'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-05-20 23:26:48,465 - Installing package profiler_agent ('/usr/bin/yum -y install profiler_agent')
2020-05-20 23:26:49,673 - The repository with version 3.1.4.0-315 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-05-20 23:26:49,679 - Skipping stack-select on DPPROFILER because it does not exist in the stack-select package structure.

Command failed after 1 tries

 

Can anyone suggest what is the issue/solution?

 

Regards,

 

2 REPLIES 2

Explorer

I also setup another repo on the repo server and pointed to it in Ambari versions. 

When I do it first time I get the following error. I spent many hours trying to fix this issue. Any help on this will be highly appreciated. 

 

Thanks.

 

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 455, in <module>
    DpProfilerAgent().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/DPPROFILER/1.6.0/package/scripts/dpprofiler_agent.py", line 54, in install
    self.install_packages(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 849, in install_packages
    retry_count=agent_stack_retry_count)
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/packaging.py", line 30, in action_install
    self._pkg_manager.install_package(package_name, self.__create_context())
  File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py", line 219, in install_package
    shell.repository_manager_executor(cmd, self.properties, context)
  File "/usr/lib/ambari-agent/lib/ambari_commons/shell.py", line 753, in repository_manager_executor
    raise RuntimeError(message)
RuntimeError: Failed to execute command '/usr/bin/yum -y install profiler_agent', exited with code '1', message: 'Not using downloaded DSS-1.6-repo-1/repomd.xml because it is older than what we have:

  Current   : Fri Oct  4 05:35:14 2019

  Downloaded: Thu Oct  3 08:15:18 2019

Error: Nothing to do

 

Explorer

Never mind. cleaning yum repos helped.

$ yum clean all