About Shelton

Shelton · ‎12-28-2018

@Vinay What do you mean by "After restart spark service, hive-site.xml to original xml file." Make sure all changes are made through Ambari otherwise it will be overwritten! Can you give latest status ...

Shelton · ‎12-27-2018

@Vinay In a Kerberized cluster, you MUST add the below parameter spark.sql.hive.hiveserver2.jdbc.url.principal = $hiveS2@REALM The above principle you can either copy it from Advanced hive-site hive.server2.authentication.kerberos.principal or get by $ klist -kt /etc/security/keytabs/hiveserver2.service.keytab Please check the correct HS2 keytab in /etc/security/keytabs/ that should resolve the issue.

Shelton · ‎12-27-2018

@Vinay Can you share your spark code let me test if you set the parameters as above? Is your cluster kerberized?

Shelton · ‎12-26-2018

@Vinay This article explains it all Hive Warehouse Connector for accessing Apache Spark data The Hive Warehouse Connector supports the following applications: Spark shell PySpark The spark-submit script

Shelton · ‎12-25-2018

@Adi Jabkowsky That Jira you are pointing to is unresolved hence not a solution, For centralized authorization, you should look at Ranger .

Shelton · ‎12-21-2018

@Michael Bronson Do you remember the components you removed?

Shelton · ‎12-20-2018

@Siva Kumar From the YARN logs "Session 0x2675d4e5b3b0046 for server prdhdpdn1.example.com/<MN1_IP>:2181, unexpected error" that shows there is a problem with the zookeeper. Can you share the zookeeper.log in /var/log/* on the 2 nodes where the active and standby RM's are running. Ensure also the NTPD is running and synchronized on all the servers!! Please revert.

Shelton · ‎12-20-2018

@Lindsay Gaff The best practice is to confine all the user's to the edge node, make sure you have all the clients eg oozie,hive,hdfs, zookeeper etc installed on this host as these client configs will be updated automatically by Ambari with the correct files during their installation. Once done your users should be able to execute any task on the cluster from the edge node. As you remarked it's impractical to have users on all the nodes ...YES that defeats the reason for having centarlized control.

Shelton · ‎12-20-2018

@Ankita Ghate Now can you proceed with the kerberization check the 2 screenshots attached ensure your input values are correct. Please revert

Shelton · ‎12-20-2018

@Amardeep Sarkar Have you tried copying the wallet to hdfs ?

Online	Offline
Last Visited	‎12-11-2025 11:50 PM

Member Since	‎01-19-2017 04:35 AM
Last Visited	‎12-11-2025 11:50 PM
Posts	3,679
Kudos received	627

Cloudera Community

Re: Apache nifi memory consumption in kubernetes

Re: Nifi toolkit command for GitLabFlowRegistry

Re: Not able to delete the NiFi existing flow usin...

Re: Securing Nifi with SSL and using OIDC provider...

Re: External zookeeper and nifi cluster connection...

Re: Spark unable to connect Hive database in HDP 3...

Re: Spark unable to connect Hive database in HDP 3...

Re: Spark unable to connect Hive database in HDP 3...

Re: Spark unable to connect Hive database in HDP 3...

Re: Hive column encryption

Re: how to resolve the DB configs consistency chec...

Re: Yarn Resource Manager HA is failed along with ...

Re: User management on each node

Re: Missing KDC administrator credentials. Please ...

Re: Import data from Oracle using Spark with Oracl...