Issue with HDP 2.3.4.0 Centos 7 tar file ?

[#1]

I recently installed Ambari 2.2 and downloaded the HDP-2.3.4.0-centos7-rpm.tar file to create a local repository. Once untared, I noted that the folder structure is named centos6. Is it normal or is it a packaging issue?

Regards

Christophe

PS: sorry in advanced if I didn't choose the right track for this question.

[#2]

@Christophe P. It's normal afaik.

@mahadev @jeff

[#3]

Hi Neeraj,

Are you sure ? I followed the same process for the HDP-2.3.0.0-centos7-rpm.tar file and the folder structure looks like: HDP/centos7/2.x/updates/2.3.0.0

I was then expecting the same for the new version.

My concern is about Ambari to find the correct file paths and avoid install issues with messages like ' File XX cannot be downloaded'...

[#4]

@Christophe P. I have added Jeff in the thread.

[#5]

http://s3.amazonaws.com/public-repo-1.hortonworks.com/index.html#/HDP/centos7/2.x/updates/2.3.4.0 seem to contain centos6 directory.

$ tar tzf HDP-2.3.4.0-centos7-rpm.tar.gz.part 
HDP/centos6/2.x/updates/2.3.4.0/
HDP/centos6/2.x/updates/2.3.4.0/ranger/
HDP/centos6/2.x/updates/2.3.4.0/ranger/ranger_2_3_4_0_3485-storm-plugin-0.5.0.2.3.4.0-3485.el6.x86_64.rpm
...

That does not seem right as the hdp.repo file says:

#VERSION_NUMBER=2.3.4.0-3485
[HDP-2.3.4.0]
name=HDP Version - HDP-2.3.4.0
baseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.4.0
...

[#6]

At 2.3.2 it reads:

$ tar tzf HDP-2.3.2.0-centos7-rpm.tar.gz.part 
HDP/
HDP/centos7/
HDP/centos7/2.x/
HDP/centos7/2.x/updates/
HDP/centos7/2.x/updates/2.3.2.0/
...

[#7]

I can confirm this for the following tar http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.4.0/HDP-2.3.4.0-centos7-rpm.tar.gz

Any news on this? We are considering a deployment on a cluster using local repositories..

[#8]

We just resorted to opening up a temporary internet connection -- took ages to install and had to restart three or four times because of failures because of time-outs

[#9]

@Willem Van Asperen @Goran Štrok

Local repo did not work? Let me check with engineering on centos6 confusion

[#10]

The tar file to create the local repo contains CentOS 6 files, not the CentOS 7 files that one would expect form the file name (HDP-2.3.4.0-centos7-rpm.tar.gz)

[#11]

@Tim Hall

[#12]

@Willem Van Asperen I have escalated this to engineering and will update the thread as soon as I hear back.

[#13]

We have noticed the same issue. The tarball for centos7 contains centos6.

Thanks for looking into this! 🙂

[#14]

@Willem Van Asperen

@Robert Pappas @Goran Štrok

As mentioned in the initial reply it's normal.

Answer is "Centos 6 builds are used to certify both 6 and 7"

[#15]

In HDP 2.3.2.0, this was not the case. The centos7 tarball for 2.3.2.0 contains a "centos7" directory, not centos6.

Did you guys make a conscious decision to combine the centos7 and 6 distributions into centos6? I think that's going to cause some issues when there's documentation and tooling that is assuming a strong consistency in naming rules.

[#16]

Fixed the tarballs to reflect centos7 in the directory name once untared .Please try now.

Technically, HDP centos6 and centos7 are the same.

[#17 · Accepted solution]

@Willem Van Asperen

@Robert Pappas @Goran Štrok

Bits are same but directory structure is different. It's fixed now. Please let me know if you can see centos7 now

[#18]

@Willem Van Asperen

@Robert Pappas @Goran Štrok Did it work?

[#19]

I do now see the directory centos7 -- will try an install and see if it holds.

Thanks for the quick response.

[#20]

@Willem Van Asperen Perfect! Bits were always the same so there wont be any surprises. If you do see the same directoy then help me to close the thread by accepting the answer.

[#21]

Cool. I can now confirm that these new repos rock. I tried a simple Ambari / Hadoop / Hive install and they work as expected. Still the rpm's are called XXX.el6.noarch.rpm which might be unnerving to the user.

Thanks again for the quick fix.