I faced the same issue. Increased the tez memory to 256. The job has been launched after that. But it got stuck at the next step. Not sure process is running or not. I could not find any active query in hiveserver2 UI   0: jdbc:hive2://rudu-cldmst001.rush.edu:2181,> select count(*) from ctakes_annotations_docs_2008; INFO : Compiling command(queryId=hive_20220531043803_772f756b-c226-40a9-b0f4-186d05ce44b5): select count(*) from ctakes_annotations_docs_2008 INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:_c0, type:bigint, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20220531043803_772f756b-c226-40a9-b0f4-186d05ce44b5); Time taken: 6.933 seconds INFO : Executing command(queryId=hive_20220531043803_772f756b-c226-40a9-b0f4-186d05ce44b5): select count(*) from ctakes_annotations_docs_2008 WARN : Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. INFO : Query ID = hive_20220531043803_772f756b-c226-40a9-b0f4-186d05ce44b5 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Number of reduce tasks determined at compile time: 1 INFO : In order to change the average load for a reducer (in bytes): INFO : set hive.exec.reducers.bytes.per.reducer=<number> INFO : In order to limit the maximum number of reducers: INFO : set hive.exec.reducers.max=<number> INFO : In order to set a constant number of reducers: INFO : set mapreduce.job.reduces=<number> INFO : number of splits:204 INFO : Submitting tokens for job: job_1638892027289_0036 INFO : Executing with tokens: [Kind: HDFS_DELEGATION_TOKEN, Service: 10.21.24.36:8020, Ident: (token for hive: HDFS_DELEGATION_TOKEN owner=newer=yarn, realUser=, issueDate=1653989890904, maxDate=1654594690904, sequenceNumber=2652, masterKeyId=1077), Kind: kms-dt, Service: , Ident: (kms-dt owner=hive, renewer=yarn, realUser=, issueDate=1653989890936, maxDate=1654594690936, sequenceNumber=3843, masterKeyId=2078)] ... View more

Hi,   I am facing the same exception after restarting the clouder server   Mar 18 09:27:36 xxx.example.com cm-server[8420]: 09:27:36.744 [ScmActive-0] ERROR org.hibernate.engine.jdbc.spi.SqlExceptionHelper - Lock wait timeo...nsaction   I have checked the database and its up and running.   Could you please provide more insight on 'iptables'   Thanks, Deiveegan ... View more

I am facing the same issue. Please note that I have valid kinit token     Here is the output from klist command Ticket cache: FILE:/tmp/krb5cc_10002 Default principal: dpugazhe@RUSH.EDU Valid starting Expires Service principal 04/25/2018 06:27:16 04/25/2018 16:27:16 krbtgt/RUSH.EDU@RUSH.EDU renew until 05/02/2018 06:27:16     Please find the connection string and output command.     beeline> !connect jdbc:hive2://localhost:10000/default;principal=hive/_HOST@.RUSH.EDU scan complete in 1ms Connecting to jdbc:hive2://localhost:10000/default;principal=hive/_HOST@.RUSH.EDU 18/04/25 08:25:23 [main]: ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7))] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204) at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:169) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) at org.apache.hive.beeline.Commands.connect(Commands.java:1526) at org.apache.hive.beeline.Commands.connect(Commands.java:1421) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:52) at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1135) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1174) at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1010) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:922) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:518) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:501) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7)) at sun.security.jgss.krb5.Krb5Context.initSecContext(Krb5Context.java:770) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:248) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 35 more Caused by: KrbException: Server not found in Kerberos database (7) at sun.security.krb5.KrbTgsRep.<init>(KrbTgsRep.java:70) at sun.security.krb5.KrbTgsReq.getReply(KrbTgsReq.java:251) at sun.security.krb5.KrbTgsReq.sendAndGetCreds(KrbTgsReq.java:262) at sun.security.krb5.internal.CredentialsUtil.serviceCreds(CredentialsUtil.java:308) at sun.security.krb5.internal.CredentialsUtil.acquireServiceCreds(CredentialsUtil.java:126) at sun.security.krb5.Credentials.acquireServiceCreds(Credentials.java:458) at sun.security.jgss.krb5.Krb5Context.initSecContext(Krb5Context.java:693) ... 38 more Caused by: KrbException: Identifier doesn't match expected value (906) at sun.security.krb5.internal.KDCRep.init(KDCRep.java:140) at sun.security.krb5.internal.TGSRep.init(TGSRep.java:65) at sun.security.krb5.internal.TGSRep.<init>(TGSRep.java:60) at sun.security.krb5.KrbTgsRep.<init>(KrbTgsRep.java:55) ... 44 more Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/default;principal=hive/_HOST@.RUSH.EDU: GSS initiate failed (state=08S01,code=0)       ... View more

Thanks Gekas. So I can delete the log files under the name of   cloudera-scm-% in the /var/log folder It wont cause any issue  in UI right ?   This is error message I see in cloudera manager    This role's Log Directory is on a filesystem with less than 5.0 GiB of its space free. /var/log/cloudera-scm-firehose (free: 4.0 GiB (8.02%), capacity: 50.0 GiB)   The "proper" way is to change "Max Log Size" and "Maximum Log File Backups" in Cloudera Manager, for each service is running on this machine.   Its set to 200 MB . Please advice        ... View more