HDP using Ambari Installation

[#1]

Obtained the Ambari, HDP, HDP-UTILS tarballs and extracted in the /var/www/html.

Created a local repositries with no internet access, ambari.repo, hdp.repo, hdp-utils.repo .

Gave the baseurls correctly, according to that files in the directory

* https://<webserver>/ambari/centos7/2.7.5.0-72/

Can able to access url until centos7, after that it throws error. 

Same issue with HDP baseurl: http://<webserver>/HDP/centos7/3.1.5.0-152

However can able to access HDP-UTILS baseurl completely

* http://<webserver>/HDP-UTILS/centos7/1.1.0.22/

Couldn't get what exactly the error is , kindly help.

[#2]

@HDP_Suja  Can you share the error / error code

Make sure the below document is followed correctly

https://docs.cloudera.com/HDPDocuments/Ambari-2.7.1.0/bk_ambari-installation/content/setting_up_a_lo...

[#3]

I've tried two methods

1. With internet: Created a dir named ambari/centos7 in the /var/www/html. While trying to get the files

#reposync -r Updates-Ambari-2.7.5.0
Error setting up repositories: failure: repodata/repomd.xml from ambari-2.7.5.0: [Errno 256] No more mirrors to try.
https://archive.cloudera.com/p/ambari/centos7/2.x/updates/2.7.5.0/repodata/repomd.xml: [Errno 14] curl#22 - "The requested URL returned error: 403"

2. Without internet-  Obtained the tarballs and extracted in /var/www/html dir.

Created ambari.repo, hdp.repo, hdp-utils.repo by myself in /etc/yum.repos.d/

[ambari-2.7.5.0]
name=ambari.repo
baseurl=http://<webserver>/ambari/centos7/2.7.5.0-72
gpgcheck=0
enabled=1
priority=1

Like this i've created for other two repo files also

from all three baseurls, i can only access hdp-utils baseurl only

http://<webserver>/HDP-UTILS/centos7/1.1.0.22

While accessing other two baseurls , i'm getting this error

Error: [object Object]

Please provide solutions for either with internet access or without internet access

[#4]

@HDP_Suja  While accessing repo through the internet I can see 403 error, Make sure the paywall credentials are correct

For the local repository, Check is the tarball that you downloaded contains all the required files, note that you need to pass the paywall credentials to download the tarball

Refer the following link for more info

https://www.cloudera.com/downloads/paywall-expansion.html

[#5]

Facing Error TimeLine Servive V1.5 Install while trying to deploy the cluster.

2022-01-31 10:40:21,105 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=None -> 3.1
2022-01-31 10:40:21,110 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2022-01-31 10:40:21,111 - Group['hdfs'] {}
2022-01-31 10:40:21,112 - Group['hadoop'] {}
2022-01-31 10:40:21,113 - Group['users'] {}
2022-01-31 10:40:21,113 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2022-01-31 10:40:21,114 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2022-01-31 10:40:21,115 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2022-01-31 10:40:21,116 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2022-01-31 10:40:21,117 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2022-01-31 10:40:21,118 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2022-01-31 10:40:21,119 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None}
2022-01-31 10:40:21,120 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2022-01-31 10:40:21,121 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2022-01-31 10:40:21,122 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2022-01-31 10:40:21,124 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2022-01-31 10:40:21,133 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2022-01-31 10:40:21,133 - Group['hdfs'] {}
2022-01-31 10:40:21,133 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', u'hdfs']}
2022-01-31 10:40:21,134 - FS Type: HDFS
2022-01-31 10:40:21,134 - Directory['/etc/hadoop'] {'mode': 0755}
2022-01-31 10:40:21,135 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2022-01-31 10:40:21,152 - Repository['HDP-3.1-repo-102'] {'base_url': 'http://10.81.68.217/HDP/centos7/3.1.5.6091-7/', 'action': ['prepare'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-102', 'mirror_list': None}
2022-01-31 10:40:21,159 - Repository['HDP-3.1-GPL-repo-102'] {'base_url': 'http://10.81.68.217/HDP-GPL/centos7/3.1.5.6091-7', 'action': ['prepare'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-102', 'mirror_list': None}
2022-01-31 10:40:21,161 - Repository['HDP-UTILS-1.1.0.22-repo-102'] {'base_url': 'http://10.81.68.217/HDP-UTILS/centos7/1.1.0.22/', 'action': ['prepare'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-102', 'mirror_list': None}
2022-01-31 10:40:21,163 - Repository[None] {'action': ['create']}
2022-01-31 10:40:21,164 - File['/tmp/tmpgNRtA6'] {'content': '[HDP-3.1-repo-102]\nname=HDP-3.1-repo-102\nbaseurl=http://10.81.68.217/HDP/centos7/3.1.5.6091-7/\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-3.1-GPL-repo-102]\nname=HDP-3.1-GPL-repo-102\nbaseurl=http://10.81.68.217/HDP-GPL/centos7/3.1.5.6091-7\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.22-repo-102]\nname=HDP-UTILS-1.1.0.22-repo-102\nbaseurl=http://10.81.68.217/HDP-UTILS/centos7/1.1.0.22/\n\npath=/\nenabled=1\ngpgcheck=0'}
2022-01-31 10:40:21,164 - Writing File['/tmp/tmpgNRtA6'] because contents don't match
2022-01-31 10:40:21,165 - File['/tmp/tmpuShDix'] {'content': StaticFile('/etc/yum.repos.d/ambari-hdp-102.repo')}
2022-01-31 10:40:21,166 - Writing File['/tmp/tmpuShDix'] because contents don't match
2022-01-31 10:40:21,166 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2022-01-31 10:40:22,052 - Skipping installation of existing package unzip
2022-01-31 10:40:22,052 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2022-01-31 10:40:22,814 - Skipping installation of existing package curl
2022-01-31 10:40:22,814 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2022-01-31 10:40:23,581 - Skipping installation of existing package hdp-select
2022-01-31 10:40:23,651 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2022-01-31 10:40:23,679 - call returned (0, '')
2022-01-31 10:40:23,905 - Command repositories: HDP-3.1-repo-102, HDP-3.1-GPL-repo-102, HDP-UTILS-1.1.0.22-repo-102
2022-01-31 10:40:23,905 - Applicable repositories: HDP-3.1-repo-102, HDP-3.1-GPL-repo-102, HDP-UTILS-1.1.0.22-repo-102
2022-01-31 10:40:23,906 - Looking for matching packages in the following repositories: HDP-3.1-repo-102, HDP-3.1-GPL-repo-102, HDP-UTILS-1.1.0.22-repo-102
2022-01-31 10:40:40,805 - Adding fallback repositories: HDP-GPL-3.1.5
2022-01-31 10:40:46,315 - Package['hadoop_3_1_5_6091_7-yarn'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2022-01-31 10:40:47,179 - Installing package hadoop_3_1_5_6091_7-yarn ('/usr/bin/yum -y install hadoop_3_1_5_6091_7-yarn')
2022-01-31 10:41:08,509 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2022-01-31 10:41:08,538 - call returned (0, '')
2022-01-31 10:41:08,538 - The 'hadoop-yarn-timelineserver' component did not advertise a version. This may indicate a problem with the component packaging.

Command failed after 1 tries

Can you please provide a solution for this?

[#6]

@HDP_Suja Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks!