Member since
04-03-2019
962
Posts
1743
Kudos Received
146
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
11533 | 03-08-2019 06:33 PM | |
4912 | 02-15-2019 08:47 PM | |
4171 | 09-26-2018 06:02 PM | |
10599 | 09-07-2018 10:33 PM | |
5660 | 04-25-2018 01:55 AM |
04-25-2016
08:41 AM
1 Kudo
@Nitin Kumar - Please see https://community.hortonworks.com/articles/14309/demystify-tez-tuning-step-by-step.html
... View more
04-25-2016
05:41 AM
1 Kudo
@Vishal Shah Are you trying give input data to your yarn application from encrypted zone? if so then are you sure that user1 has access to encrypt/decrypt data to/from encrypted zone? have you tried reading/writing file from/to encrypted zone? If not then can you please try this first?
... View more
04-25-2016
05:20 AM
1 Kudo
@omkar pathallapalli Please refer - https://community.hortonworks.com/articles/14802/sqoop-importexport-tutorial.html
... View more
04-23-2016
09:46 PM
22 Kudos
Note - I did receive few complaints about this script that it's failing on new Ambari versions, It happened because of change in kerberos payload. I have modified the script and it works like a charm again for new versions. Please continue to provide me the feedback! 🙂 Disclaimer - "Please do not use unless you know what u r doing! Test on Dev. cluster before using on production systems" 🙂 Automated Kerberos Installation and Configuration – For this post, I have written a shell script which uses Ambari APIs to configure Kerberos on HDP Single or Multinode clusters. You just need to clone our github repository and modify property file according to your cluster environment, execute setup script and phew!! Within 5-10 minutes you should have your cluster completely secured by Kerberos! Cool isn’t it? Detailed Steps(Demo on HDP Sandbox 2.4): 1. Clone our github repository Ambari server in your HDP Cluster Note - This script will install and configure KDC on your Ambari Server. git clone https://github.com/crazyadmins/useful-scripts.git Sample Output: [root@sandbox ~]# git clone https://github.com/crazyadmins/useful-scripts.git
Initialized empty Git repository in /root/useful-scripts/.git/
remote: Counting objects: 29, done.
remote: Compressing objects: 100% (25/25), done.
remote: Total 29 (delta 4), reused 25 (delta 3), pack-reused 0
Unpacking objects: 100% (29/29), done. 2. Goto useful-scripts/ambari directory [root@sandbox ~]# cd useful-scripts/ambari/
[root@sandbox ambari]# ls -lrt
total 16
-rw-r--r-- 1 root root 5701 2016-04-23 20:33 setup_kerberos.sh
-rw-r--r-- 1 root root 748 2016-04-23 20:33 README
-rw-r--r-- 1 root root 366 2016-04-23 20:33 ambari.props
[root@sandbox ambari]# 3. Copy setup_kerberos.sh and ambari.props to the host where you want to setup KDC Server 4. Edit and modify ambari.props file according to your cluster environment Note - In case of multinode cluster, Please don't forget to add comma separated list of hosts as a value of KERBEROS_CLIENTS variable. Sample output for my Sandbox [root@sandbox ambari]# cat ambari.props
CLUSTER_NAME=Sandbox
AMBARI_ADMIN_USER=admin
AMBARI_ADMIN_PASSWORD=admin
AMBARI_HOST=sandbox.hortonworks.com
KDC_HOST=sandbox.hortonworks.com
REALM=HWX.COM
KERBEROS_CLIENTS=sandbox.hortonworks.com
##### Notes #####
#1. KERBEROS_CLIENTS - Comma separated list of Kerberos clients in case of multinode cluster
#2. Admin princial is admin/admin and password is hadoop
[root@sandbox ambari]# 5. Start installation by simply executing setup_kerberos.sh Notes: 1. Please run setup_kerberos.sh from KDC_HOST only, you don’t need to setup or configure KDC, this script will do everything for you. 2. If you are running script on Sandbox then please turn OFF maintenance mode for HDFS and turn ON maintenance mode for Zepplin Notebook before executing the script. sh setup_kerberos.sh
Screenshots: 1. Before Script execution 2. Script execution is in progress 3. Script execution has finished 4. Voila!! Please comment if you have any feedback/questions/suggestions. Happy Hadooping!!
... View more
04-23-2016
07:45 AM
@Gerd Koenig
... View more
04-23-2016
07:45 AM
@Gerd Koenig - Thank you for your reply, can you please check answer given by @hkropp
... View more
04-22-2016
04:07 PM
2 Kudos
@Hefei Li - Data will be safe but not readable, you can only read it if you have decryption key and KMS Running.
... View more
04-22-2016
03:36 PM
2 Kudos
@Gerd Koenig Please refer https://community.hortonworks.com/questions/10015/namenode-unable-to-start-ranger-issue-in-namenode.html https://community.hortonworks.com/questions/14329/hiveserver2-wont-start-after-changing-rangers-admi.html
... View more
04-22-2016
02:50 PM
7 Kudos
@John Dison You can use Ambari views for submitting pig/hive jobs, you can use Ambari's file browser view to browse HDFS, you can use TEZ view to browse TEZ applications but AFAIK You cannot browse the YARN applications using Ambari UI like HUE. I checked in Ambari 2.2.1.0.
... View more
04-22-2016
02:42 PM
3 Kudos
@VENKATESH M Please use : http://127.0.0.1:19888 If you are using linux then add below entry in /etc/hosts file 127.0.0.1 sandbox.hortonworks.com If you are using windows then add above entry in C:\Windows\System32\drivers\etc\hosts
... View more