Forbidden 403 error on HDP 2.4 installation.

[#1]

I am create a new cluster based on HDP 2.4. I have installed Ambari, which went smooth. I have setup a Local repository, which has HDP and HDP utilties related files. I have used the same local repository for Ambari installation. I am using the wizard to install a cluster. When click the "Next ->" button at the "Install, Start and test" Wizard dialog box, I get the following error:

resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'hbase_2_4_*'' returned 1. Error Downloading Packages:
  hadoop_2_4_0_0_169-2.7.1.2.4.0.0-169.el6.x86_64: failure: hadoop/hadoop_2_4_0_0_169-2.7.1.2.4.0.0-169.el6.x86_64.rpm from HDP-2.4: [Errno 256] No more mirrors to try.

I confirm that the repository is up and running. Out of curiosity to find out the real cause of this error, I executed the command /usr/bin/yum -d 10 -e 1 -y install 'hbase_2_4_* at the command prompt and found that the detailed error giving this error.

[Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 403 Forbidden"

I used to get this error with ambari installation, so I put a line proxy = _none_ in the ambari.repo. However I cannot do this for HDP.repo because if I add this line, ambari is overwriting the HDP.repo file. My yum.conf file has the following entry. If I comment the below line then yum complains about net unreacheable.

proxy=http://xxx.xxx.xxx.xxx:8080

[#2 · Accepted solution]

I have fixed it myself. For those who might face the same issue. This is what I did. Basically HDP.repo should be told to skip proxy server, but if you edit HDP.repo, Ambari wizard will overwrite it. So what is the workaround?. This is how you make HDP.repo skip the proxy. Just add the following lines to the yum.conf file for all the nodes. It worked for me. Hope this helps! 🙂

[HDP-2.4]

name=HDP-2.4

proxy = _none_

baseurl=http://item-70288/hdp/HDP/centos6/2.x/updates/2.4.0.0

enabled=1

gpgcheck=0