Member since
02-28-2022
171
Posts
14
Kudos Received
17
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 573 | 07-07-2025 06:35 AM | |
| 588 | 06-17-2025 09:42 AM | |
| 2091 | 04-02-2025 07:43 AM | |
| 712 | 10-18-2024 12:29 PM | |
| 11904 | 09-05-2024 09:06 AM |
10-14-2022
07:06 AM
I managed to solve. canary timeouts have been changed: ZooKeeper Canary Connection Timeout = 30s ZooKeeper Canary Session Timeout = 1m ZooKeeper Canary Operation Timeout = 30s with that, the error no longer presented and the status is healthy 100%
... View more
10-14-2022
06:23 AM
hello cloudera community we are having a problem with zookeeper on cdp after enabling kerberos on the cluster zookeeper instances are healthy (status green), but the general status of zookeeper shows the message: Canary test of client connection to ZooKeeper and execution of basic operations succeeded though a session could not be established with one or more servers how can we solve this problem?
... View more
Labels:
- Labels:
-
Apache Zookeeper
-
Cloudera Manager
09-30-2022
06:32 AM
hello cloudera community, solved the problem by pointing hive-site.xml file in spark and spark2 so spark jobs in livy in jupyter notebook ran successfully
... View more
09-29-2022
11:55 AM
hello cloudera community,
we are having problems using livy with job spark to read hive by jupyter notebook
when we run a simple query, for example:
"spark.sql("show show databases").show()"
returns the error below "org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient"
Could you help us with this setup?
ps: we are using cdh 5.16.x
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
-
Apache Spark
09-21-2022
01:00 PM
hello cloudera community, we are having a problem accessing the hive cli of a certain user and the spark-shell too when executing the query "show databases" in hive cli returns the error: "FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset " when executing the "show databases" query in spark-shell returns the error: "org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.transport.TTransportException;" "WARN metastore.RetryingMetaStoreClient: MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.transport.TTransportException" when we use beeline and run the query "show databases" it works without problem could you help us with this problem? we are using cloudera manager 5.16.1 and cdh 5.16.1 the cluster is with kerberos and sentry is managing the permissions to the cluster databases
... View more
Labels:
09-15-2022
06:54 AM
hi @araujo the userPrincipalName of user livy is: livy/hostname_livy_server@DOMAIN.LOCAL the userPrincipalName of the livy-http user is: livy-http@DOMAIN.LOCAL running the command "kinit livy": running the command "kinit livy-http": running the "kinit" command with the keytab created for user livy: running the command "kinit" with the keytab created for the user livy-http: we've been facing this problem for months, we haven't found the solution yet.
... View more
09-12-2022
11:58 AM
hi @Scharan the same goes for sentry?
... View more
09-12-2022
10:55 AM
hi @Scharan so, does the ranger only work the permissions if it uses beeline or connections that access the hiveserver2 address?
... View more
09-12-2022
09:11 AM
we are using ambari 2.6.2.2 with hdp 2.6.5 the permissions are being managed by the ranger, but checking the ranger settings, it's only managing the /apps/hive/warehouse directory on the hdfs the problem we are having is in the /area/data/pll directory on the hdfs, this directory has acl rwx permission for the user using beeline to create an external table is returning the error: Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [service_user] does not have [ALL] privilege on [hdfs://service1/area/data/pll] (state=42000,code=40000) but using hive cli does not return error, table is created successfully. What could be causing this problem?
... View more
Labels:
08-30-2022
05:41 AM
hi @araujo yes, we know the passwords, because we created these two users from scratch before creating the keytabs for the two users, we managed to kinit the two users without problem "kinit user", after creating the keytabs for the two users, kinit only works with the keytab, but it only works on the livy user, when we try to run kinit in livy-http user keytab displays the error "kinit: Preauthentication failed while getting initial credentials" the userprincipalname of each user is: livy: livy/hostname_livy_server@DOMAIN.LOCAL livy-http: HTTP/hostname_livy_server@DOMAIN.LOCAL
... View more