Member since
04-03-2019
962
Posts
1743
Kudos Received
146
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
11542 | 03-08-2019 06:33 PM | |
4917 | 02-15-2019 08:47 PM | |
4173 | 09-26-2018 06:02 PM | |
10604 | 09-07-2018 10:33 PM | |
5679 | 04-25-2018 01:55 AM |
06-19-2016
08:15 PM
4 Kudos
Note - For this tutorial I assume that you already have HDP cluster kerberized. If you want to configure automated kerberos then please refer to https://community.hortonworks.com/articles/29203/automated-kerberos-installation-and-configuration.html. . First you need to configure your Ambari Server for Kerberos configuration, without configuring Ambari for Kerberos, views will not work. . Use below commands to configure Ambari for Kerberos: . 1 Login to kadmin and create principal for Ambari Server
Note - Please replace your REALM in REALM.COM addprinc -randkey ambari-server@REALM.COM . 2 Extract principal created in above step to keytab file xst -k ambari.server.keytab ambari-server@REALM.COM . 3 Above command should generate keytab file in current working directory, copy keytab file to /etc/security/keytabs/ location cp ambari.server.keytab /etc/security/keytabs/ambari.server.keytab Note - Please make sure that, user running ambari server daemon should have read access to ambari.server.keytab . 4 Stop Ambari server daemon and setup security using below command. service ambari-server stop
ambari-server setup-security . 5 Select 3 for Setup Ambari kerberos JAAS configuration.
Enter the Kerberos principal name for the Ambari Server you set up in step 1.1. Enter the path to the keytab for the Ambari principal.
Restart Ambari Server. ambari-server restart . 6. Add below properties in yarn-site.xml using Ambari UI. yarn.timeline-service.http-authentication.proxyuser.ambari-server.hosts=*
yarn.timeline-service.http-authentication.proxyuser.ambari-server.users=*
yarn.timeline-service.http-authentication.proxyuser.ambari-server.groups=* . 7. Add below properties in core-site.xml hadoop.proxyuser.ambari-server.hosts=*
hadoop.proxyuser.ambari-server.groups=*
hadoop.proxyuser.admin.hosts=*
hadoop.proxyuser.admin.groups=* Your TEZ view should be accessible now! . . Happy Hadooping!! 🙂
... View more
Labels:
06-19-2016
08:33 AM
@Anshul Sisodia - You are welcome! 🙂 Please accept the answer if you thing it has helped you.
... View more
06-17-2016
05:09 PM
@Rajkumar Singh
... View more
06-17-2016
05:03 PM
2 Kudos
@Shashang Sheth The broker tells the client which hostname should be used to produce/consume messages. By default Kafka uses the hostname of the system it runs on. If this hostname can not be resolved by the client side you get this exception. You can try setting advertised.host.name in the Kafka configuration to an hostname/address which the clients should use.
... View more
06-17-2016
12:42 PM
Good stuff @Sagar Shimpi 🙂
... View more
06-17-2016
04:24 AM
1 Kudo
@Anandha L Ranganathan Can you please check status of your nodemanagers? If they are not healthy or crashing then your job will be in ACCEPTED state and will never come to in progress state.
... View more
06-17-2016
04:22 AM
2 Kudos
@Artem Ervits That's correct! There is no need to turn off Kerberos while rolling upgrade using Ambari 2.2.2.0 I believe it stops both the Namenode and then perform upgrade and that's what minimal downtime is. For slaves it will do upgrade in batches to avoid complete downtime.
... View more
06-15-2016
03:34 AM
5 Kudos
@Uday Vakalapudi Please add your edge node to the cluster via Ambari and install only required client packages. If you install hdp clients/kerberos manually then it is difficult for you to keep it up to date with the latest configuration. It's complicated when you do it manually, you need to make sure that everytime you make changes in configurations via Ambari, you need to deploy same thing to the edge node manually! Please let Ambari handle it. Hope this information helps!
... View more
06-15-2016
03:28 AM
3 Kudos
@Gade Naga Venkata Rajasekhar /user/horton/flightdelays_clean.pig need to be present on local storage, not on hdfs. Please copy it to local storage and pass local path to exec.
... View more