question Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing in Archives of Support Questions (Read Only)

Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Indra — Mon, 04 Dec 2017 00:33:13 GMT

Hello,

Issue:
Around mid-November 2017, ran into an issue with datanodes not coming up, and namenode therefore not coming out of safe node when we kerberized (MIT kerberos KDC) a cluster after we provisioned via Cloudbreak.

Reference:
https://issues.apache.org/jira/browse/HDFS-12029
https://access.redhat.com/errata/RHBA-2017:1674
https://community.hortonworks.com/articles/109940/after-os-patching-all-the-datanodes-nodes-are-up-b.html

Temporary Fix:
Hortonworks support was consulted, and they applied a temporary fix:
Updated hadoop-env.sh configs in HDFS configs in ambari as follows:

Original entry:

export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true
${HADOOP_OPTS}"

With fix:

export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true -Xss1280k ${HADOOP_OPTS}”

Restarted services and we were good to go.

Strategic solution:
Upgrade the underlying OS image to a version that includes a patch.
3.10.0-514.26.2.el7.x86_64 version, per the support engineer

Reporting this since an upgrade is being worked, should have done it earlier 😞

@pdarvasi

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

darvasip — Sun, 18 Aug 2019 03:42:43 GMT

@Airawat

I've just double-checked the new Cloudbreak 1.16.5 version in Marketplace and it seems to have the correct version:

Could You please verify? Thanks!

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Indra — Wed, 06 Dec 2017 23:17:15 GMT

@pdarvasi
Will try out and get back to you. Thanks so much!

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

darvasip — Tue, 12 Dec 2017 21:53:37 GMT

@Airawat

Have you had the chance to have a look at this one? Thanks!

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Indra — Wed, 13 Dec 2017 00:46:44 GMT

@pdarvasi - testing it today.

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Indra — Thu, 14 Dec 2017 13:45:21 GMT

@pdarvasi:
(1) Availability set (1 for multiple host groups - masters): Works fine
(2) Linux kernel version: is the one in your screenshot - version with patch
(3) Kerberos enabled post-provisioning against MIT Kerberos KDC: No issues
(4) Kerberos enabled at provision time with new MIT Kerberos KDC: Did not complete in 12 hours..lots of alerts, install pending, and services in invalid state and unable to start, Ambari version could not be determined...will open a separate post

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

darvasip — Fri, 15 Dec 2017 21:27:11 GMT

@Airawat If you consider your original question answered, would you please consider accepting the answer? Thanks!

question Re: *Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing in Archives of Support Questions (Read Only)

*Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: *Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: *Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: *Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: *Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: *Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: *Closed*: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

question Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing in Archives of Support Questions (Read Only)

Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing

Re: Closed: Cloudbreak on Azure: Linux kernel version and impact on kerberizing