Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2731 | 04-27-2020 03:48 AM | |
| 5290 | 04-26-2020 06:18 PM | |
| 4459 | 04-26-2020 06:05 PM | |
| 3584 | 04-13-2020 08:53 PM | |
| 5387 | 03-31-2020 02:10 AM |
02-26-2018
07:56 AM
@ASIF Khan Similarly if you want to enable ActiveDirectory based authentication for Zeppelin then you can refer to the following article: https://community.hortonworks.com/articles/70392/how-to-configure-zeppelin-for-active-directory-use.html
... View more
02-26-2018
07:50 AM
@ASIF Khan Please refer to the following article to know how to enable simple Basic Authentication for Zeppelin UI access. https://community.hortonworks.com/articles/174329/how-to-enable-basic-authentication-for-zeppelin-ui.html
... View more
02-26-2018
07:49 AM
3 Kudos
In this article we will see how to add sample users and enable password based authentication for the Zeppelin UI. By default when we access Zeppelin we see that we are able to access it as "anonymous" user. (means users are not challenged to provide credentials) . 1. Login to Ambari UI and then navigate to : Ambari UI --> Zeppelin Notebook --> Configs --> Advanced --> Advanced zeppelin-shiro-ini 2. Then add the users inside the "[users]" section as following: [users]
# List of users with their password allowed to access Zeppelin.
# To use a different strategy (LDAP / Database / ...) check the shiro doc at http://shiro.apache.org/configuration.html
#Configuration-INISections
admin = admin
user1=user1pwd
user2=user2pwd 3. Also edit the "[urls]" section and add "authBasic" as following to tell which all URL patterns needs to be protected: [urls]
# anon means the access is anonymous.
# authcBasic means Basic Auth Security
# To enfore security, comment the line below and uncomment the next one /api/version = anon
#/** = anon
/** = authcBasic 4. Restart Zeppelin and then users can try accessing the Zeppelin Notebook UI and you will see that it presents a Basic Authentication window to enter username & password. http://$ZEPPELIN_HOST:9995/#/ . NOTE: Zeppelin can also be configured to leverage an organization's Active Directory infrastructure for user authentication. By doing this, the existing Active Directory users can login to Zeppelin UI using their Active Directory credentials. In order to enable Active Directory based authentication for
Zeppelin then you can refer to the following article:
https://community.hortonworks.com/articles/70392/how-to-configure-zeppelin-for-active-directory-use.html
... View more
Labels:
02-25-2018
08:53 PM
1 Kudo
@Andres Urrego Are you connecting to the Sandbox on SSH port 2222 ? (if not then those commands will not be available) Please try this to connect to Sandbox: # ssh root@127.0.0.1 -p 2222
Enter Password: hadoop . If you are using Putty to connect to Sandbox then while opening Putty please select the SSH port as 2222 while connecting to Sandbox. Other alternative will be to use the web terminal : http://localhost:4200
... View more
02-25-2018
08:34 PM
@Yassine If this answers your query then please mark this thread as answered by
clicking on the "Accepted" button that way other HCC users can quickly
browser the answered queries.
... View more
02-24-2018
11:18 PM
@Michael Bronson Yes. But this value should be implemented after consulting your network admins.
... View more
02-24-2018
11:09 PM
1 Kudo
@Michael Bronson The Huge Pages needs to be disabled on all the cluster nodes. Thats the reason ambari shows a WARNING while registering a Host to the cluster if the Huge Pages are not setup. Ambari Host Check Fails if Transparent Huge Pages (THP) is not disabled. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-troubleshooting/content/resolving_cluster_install_and_configuration_problems.html # echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
# echo never > /sys/kernel/mm/redhat_transparent_hugepage/enabled . When we configure the MTU explicitly then we should configuring the MTU same across the cluster nodes else MTU configurations can produce serious problems with the network. Enabling Jumbo Frames across the cluster nodes can improve bandwidth through better check sums and possibly may also provide packet integrity however you will need to consult with your Network admins before making this decision. Regarding setting MTU to 9000 it is better to check the network infrastructure first and to see if all the network devices can support MTU 9000 or not. Network admins can be more helpful here as this is basically a network tuning parameter. .
... View more
02-22-2018
11:04 AM
1 Kudo
@Michael Bronson One solution can be as following: # export HOST=amb25101.example.com
# export USER=admin
# export PASSWD=admin
# export ACTION=INSTALLED
# export CLUSTER_NAME=plain_ambari
# echo {"\"RequestInfo\": {\"context\" :\"Stop AMBARI_METRICS via REST\"}, \"Body\": {\"ServiceInfo\": {\"state\": \"$ACTION\"}}}" > /tmp/postData.txt
# curl -u $USER:$PASSWD -i -H 'X-Requested-By: ambari' -X PUT -d@/tmp/postData.txt http://$HOST:8080/api/v1/clusters/$CLUSTER_NAME/services/AMBARI_METRICS . So basically we are doing the following thing differently: # echo {"\"RequestInfo\": {\"context\" :\"Stop AMBARI_METRICS via REST\"}, \"Body\": {\"ServiceInfo\": {\"state\": \"$ACTION\"}}}" > /tmp/postData.txt
# curl -u $USER:$PASSWD -i -H 'X-Requested-By: ambari' -X PUT -d@/tmp/postData.txt http://$HOST:8080/api/v1/clusters/$CLUSTER_NAME/services/AMBARI_METRICS .
... View more
02-22-2018
12:10 AM
1 Kudo
@Michael Bronson You can use "expect" utility offered by Linux as following: 1. Install that package: # yum install expect -y 2. Create a file as following as "/tmp/test.sh" #!/usr/bin/expect
set timeout 20
spawn /usr/sbin/ambari-server upgrade
expect "Ambari Server configured for Postgres. Confirm you have made a backup of the Ambari Server database" { send "y\n" }
interact Notice i am passing "y". here { send "y\n" } which means it will take my input as "yes" 3. Give execute permission to the script and then run it # chmod 755 /tmp/test.sh
# /tmp/test.sh
OUTPUT:
---------
# /tmp/test.sh
spawn /usr/sbin/ambari-server upgrade
Using python /usr/bin/python
Upgrading ambari-server
INFO: Upgrade Ambari Server
INFO: Updating Ambari Server properties in ambari.properties ...
WARNING: Can not find ambari.properties.rpmsave file from previous version, skipping import of settings
INFO: Updating Ambari Server properties in ambari-env.sh ...
INFO: Can not find ambari-env.sh.rpmsave file from previous version, skipping restore of environment settings. ambari-env.sh may not include any user customization.
INFO: Fixing database objects owner
Ambari Server configured for Postgres. Confirm you have made a backup of the Ambari Server database [y/n] (y)? y
INFO: Upgrading database schema
INFO: Return code from schema upgrade command, retcode = 0
INFO: Schema upgrade completed
Adjusting ambari-server permissions and ownership...
Ambari Server 'upgrade' completed successfully. Notice i am passing "y". here { send "y\n" } which means it will take my input as "yes" .
... View more
02-20-2018
10:58 AM
@yassine sihi One command is to To stop HiveServer2 on host "amb25103.example.com" And the other command is to To stop HiveMetastore on host "amb25103.example.com" . If you want to stop the Whole Hive Service then please refer to my previous command in same thread: To stop whole "Hive Service" # curl -u admin:admin -H "X-Requested-By: ambari" -X PUT -d '{"RequestInfo":{"context":"_PARSE_.START.HIVE","operation_level":{"level":"SERVICE","cluster_name":"plain_ambari","service_name":"HIVE"}},"Body":{"ServiceInfo":{"state":"INSTALLED"}}}' http://amb25101.example.com:8080/api/v1/clusters/plain_ambari/services/HIVE . To start whole "Hive Service" # curl -u admin:admin -H "X-Requested-By: ambari" -X PUT -d '{"RequestInfo":{"context":"_PARSE_.START.HIVE","operation_level":{"level":"SERVICE","cluster_name":"plain_ambari","service_name":"HIVE"}},"Body":{"ServiceInfo":{"state":"STARTED"}}}' http://amb25101.example.com:8080/api/v1/clusters/plain_ambari/services/HIVE
.
... View more