question Re: Issue with HDP 2.3.4.0 Centos 7 tar file ? in Support Questions

Issue with HDP 2.3.4.0 Centos 7 tar file ?

christophe1 — Wed, 06 Jan 2016 22:20:29 GMT

I recently installed Ambari 2.2 and downloaded the HDP-2.3.4.0-centos7-rpm.tar file to create a local repository. Once untared, I noted that the folder structure is named centos6. Is it normal or is it a packaging issue?

Regards

Christophe

PS: sorry in advanced if I didn't choose the right track for this question.

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Wed, 06 Jan 2016 22:23:55 GMT

@Christophe P. It's normal afaik.

@mahadev @jeff

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

christophe1 — Thu, 07 Jan 2016 00:14:06 GMT

Hi Neeraj,

Are you sure ? I followed the same process for the HDP-2.3.0.0-centos7-rpm.tar file and the folder structure looks like: HDP/centos7/2.x/updates/2.3.0.0

I was then expecting the same for the new version.

My concern is about Ambari to find the correct file paths and avoid install issues with messages like ' File XX cannot be downloaded'...

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Thu, 07 Jan 2016 00:21:51 GMT

@Christophe P. I have added Jeff in the thread.

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

willem_van_aspe — Thu, 28 Jan 2016 20:38:09 GMT

http://s3.amazonaws.com/public-repo-1.hortonworks.com/index.html#/HDP/centos7/2.x/updates/2.3.4.0 seem to contain centos6 directory.

$ tar tzf HDP-2.3.4.0-centos7-rpm.tar.gz.part 
HDP/centos6/2.x/updates/2.3.4.0/
HDP/centos6/2.x/updates/2.3.4.0/ranger/
HDP/centos6/2.x/updates/2.3.4.0/ranger/ranger_2_3_4_0_3485-storm-plugin-0.5.0.2.3.4.0-3485.el6.x86_64.rpm
...

That does not seem right as the hdp.repo file says:

#VERSION_NUMBER=2.3.4.0-3485
[HDP-2.3.4.0]
name=HDP Version - HDP-2.3.4.0
baseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.4.0
...

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

willem_van_aspe — Thu, 28 Jan 2016 20:40:27 GMT

At 2.3.2 it reads:

$ tar tzf HDP-2.3.2.0-centos7-rpm.tar.gz.part 
HDP/
HDP/centos7/
HDP/centos7/2.x/
HDP/centos7/2.x/updates/
HDP/centos7/2.x/updates/2.3.2.0/
...

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

goran1 — Fri, 29 Jan 2016 16:15:28 GMT

I can confirm this for the following tar http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.4.0/HDP-2.3.4.0-centos7-rpm.tar.gz

Any news on this? We are considering a deployment on a cluster using local repositories..

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Fri, 29 Jan 2016 19:56:00 GMT

@Tim Hall

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

willem_van_aspe — Fri, 29 Jan 2016 21:15:14 GMT

We just resorted to opening up a temporary internet connection -- took ages to install and had to restart three or four times because of failures because of time-outs

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Fri, 29 Jan 2016 21:19:02 GMT

@Willem Van Asperen @Goran Štrok

Local repo did not work? Let me check with engineering on centos6 confusion

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

willem_van_aspe — Fri, 29 Jan 2016 21:47:07 GMT

The tar file to create the local repo contains CentOS 6 files, not the CentOS 7 files that one would expect form the file name (HDP-2.3.4.0-centos7-rpm.tar.gz)

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Fri, 29 Jan 2016 21:49:12 GMT

@Willem Van Asperen I have escalated this to engineering and will update the thread as soon as I hear back.

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

robert_pappas — Fri, 29 Jan 2016 22:28:21 GMT

We have noticed the same issue. The tarball for centos7 contains centos6.

Thanks for looking into this! 🙂

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Sat, 30 Jan 2016 00:36:18 GMT

@Willem Van Asperen

@Robert Pappas @Goran Štrok

As mentioned in the initial reply it's normal.

Answer is "Centos 6 builds are used to certify both 6 and 7"

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

robert_pappas — Sat, 30 Jan 2016 00:51:15 GMT

In HDP 2.3.2.0, this was not the case. The centos7 tarball for 2.3.2.0 contains a "centos7" directory, not centos6.

Did you guys make a conscious decision to combine the centos7 and 6 distributions into centos6? I think that's going to cause some issues when there's documentation and tooling that is assuming a strong consistency in naming rules.

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

sriharshad — Sat, 30 Jan 2016 02:21:32 GMT

Fixed the tarballs to reflect centos7 in the directory name once untared .Please try now.

Technically, HDP centos6 and centos7 are the same.

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Sat, 30 Jan 2016 02:46:39 GMT

@Willem Van Asperen

@Robert Pappas @Goran Štrok

Bits are same but directory structure is different. It's fixed now. Please let me know if you can see centos7 now

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Sun, 31 Jan 2016 03:10:18 GMT

@Willem Van Asperen

@Robert Pappas @Goran Štrok Did it work?

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

willem_van_aspe — Sun, 31 Jan 2016 17:21:46 GMT

I do now see the directory centos7 -- will try an install and see if it holds.

Thanks for the quick response.

Re: Issue with HDP 2.3.4.0 Centos 7 tar file ?

nsabharwal — Sun, 31 Jan 2016 19:24:59 GMT

@Willem Van Asperen Perfect! Bits were always the same so there wont be any surprises. If you do see the same directoy then help me to close the thread by accepting the answer.