Member since
10-20-2015
8
Posts
2
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1355 | 02-21-2017 07:01 PM | |
2735 | 09-02-2016 11:22 PM |
02-21-2017
07:01 PM
Livy 0.2 does not work with Spark 2 that I have found. Upgrading to Livy 0.3 and modifying the livy-env.sh to: export SPARK_HOME=/usr/hdp/current/spark2-client export SPARK_MAJOR_VERSION=2 This also works for Zeppelin 0.7. With livy 0.2 Zeppelin was throwing a 404 error attempting to get the version from livy.
... View more
01-30-2017
03:50 PM
This is what I ran to clean up the issue on my ambari database, thank you for the post: delete from ambari.serviceconfigmapping where service_config_id in (select service_config_id from ambari.serviceconfig where service_name in ('PXF','HAWQ','ZEPPELIN')); delete from ambari.hostcomponentstate where service_name in ('PXF','HAWQ','ZEPPELIN'); delete from ambari.hostcomponentdesiredstate where service_name in ('PXF','HAWQ','ZEPPELIN'); delete from ambari.servicecomponentdesiredstate where service_name in ('PXF','HAWQ','ZEPPELIN'); delete from ambari.servicedesiredstate where service_name in ('PXF','HAWQ','ZEPPELIN'); delete from ambari.serviceconfig where service_name in ('PXF','HAWQ','ZEPPELIN'); delete from ambari.requestresourcefilter where service_name in ('PXF','HAWQ','ZEPPELIN'); delete from ambari.requestoperationlevel where service_name in ('PXF','HAWQ','ZEPPELIN'); delete from ambari.clusterservices where service_name in ('PXF','HAWQ','ZEPPELIN');
... View more
01-06-2017
07:01 PM
I too had run into several of the issues above but with 2.5.0. The 2 major things that I change on top of what is listed above is: Add these items in Ambari: livy.conf livy.server.launch.kerberos.keytab /etc/security/keytabs/livy.service.keytab livy.server.launch.kerberos.principal livy/_HOST@REALM livy-env.sh export HADOOP_HOME=/usr/hdp/current/hadoop-client I was getting 401 errors from Zeppelin to Livy: WARN [2017-01-06 11:07:29,393] ({pool-2-thread-4} HttpAuthenticator.java[generateAuthResponse]:207) - NEGOTIATE authentication error: No valid credentials provided (Mechani
sm level: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - UNKNOWN_SERVER)) ERROR [2017-01-06 11:07:29,407] ({pool-2-thread-4} LivyHelper.java[createSession]:128) - Error getting session for user
org.springframework.web.client.RestClientException: Error running rest call; nested exception is org.springframework.web.client.HttpClientErrorException: 401 Authentication
required
... View more
09-02-2016
11:22 PM
There is a great article already on this site describing how to do this. https://community.hortonworks.com/articles/49439/how-to-use-api-curl-commands-to-create-internal-ra.html Here is how I was able to do this: First capture the current users information: curl -s -u admin:admin -H "Accept: application/json" -H "Content-Type: application/json" -X GET http://127.0.0.1:6080/service/xusers/users/8 > /tmp/curl.out File contents: {"id":8,"createDate":"2016-03-14T14:41:05Z","updateDate":"2016-09-02T23:07:10Z","owner":"rangerusersync","updatedBy":"Admin","name":"HDP","firstName":"HDP","lastName":"HDP","emailAddress":"HDP@sandbox.hortonworks.com", "password":"*****","description":"HDP - add from Unix box","groupIdList":[6],"groupNameList":["root"],"status":0,"isVisible":1,"userSource":0,"userRoleList":["ROLE_USER"]} Modified to include mandatory fields and values to update: {"id":8,"name":"HDP","firstName":"HDP","lastName":"HDP","emailAddress":"HDP@sandbox.hortonworks.com","description":"HDP - add from Unix box","userRoleList":["ROLE_SYS_ADM"]} Update the users information and read it back: curl -u admin:admin -v -i -s -X PUT -H "Accept: application/json" -H "Content-Type: application/json" http://127.0.0.1:6080/service/xusers/secure/users/8 -d @/tmp/curl.out
curl -s -u admin:admin -H "Accept: application/json" -H "Content-Type: application/json" -X GET http://127.0.0.1:6080/service/xusers/users/8
{"id":8,"createDate":"2016-03-14T14:41:05Z","updateDate":"2016-09-02T23:08:49Z","owner":"rangerusersync","updatedBy":"Admin","name":"HDP","firstName":"HDP","lastName":"HDP","emailAddress":"HDP@sandbox.hortonworks.com","password":"*****","description":"HDP - add from Unix box","groupIdList":[6],"groupNameList":["root"],"status":0,"isVisible":1,"userSource":0,"userRoleList":["ROLE_SYS_ADM"]}
... View more
08-26-2016
07:31 PM
2 Kudos
Since Zeppelin has evolved so has the answer to this question. In newer versions it is possible to deploy jar files to the local-repo directory if set properly. zeppelin.interpreter.localRepo /usr/hdp/current/zeppelin-server/lib/local-repo/2BS9Q4FMD
... View more