Member since
07-26-2017
23
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3302 | 07-28-2018 02:06 PM |
06-12-2023
02:05 PM
Hi Team, Mysql service is not getting start and log is also not showing . Can someone help? [root@]# service mysqld start Redirecting to /bin/systemctl start mysqld.service Job for mysqld.service failed because a configured resource limit was exceeded. See "systemctl status mysqld.service" and "journalctl -xe" for details. [root@devtest mysqld.log]# Regards Shamim
... View more
Labels:
- Labels:
-
Data Analytics Studio
08-24-2022
02:50 PM
Dear Friends, I am upgrading CDH to CDP and getting below error while upgrading. Please help. Show All Steps Show Only Failed Steps Show Only Running Steps Converting configuration parameters Failed due to java.lang.IllegalStateException: HS2 role count in Hive and Hive on Tez services should match. Failed due to java.lang.IllegalStateException: HS2 role count in Hive and Hive on Tez services should match java.lang.IllegalStateException: HS2 role count in Hive and Hive on Tez services should match.
... View more
Labels:
- Labels:
-
Apache Hive
08-01-2022
01:40 AM
Hi, Please find the version details below. root@wa1cog3mgmt2200:/var/log/sentry >mysql -V mysql Ver 14.14 Distrib 5.7.38, for Linux (x86_64) using EditLine wrapper root@wa1cog3mgmt2200:/var/log/sentry >sentry -v WARNING: Use "yarn jar" to launch YARN applications. Apache Sentry 2.1.0-cdh6.3.4 ,built from commit#Unknown ,compiled by jenkins with source checksum 6fcac5ae238eb7680948756228051c52 root@wa1cog3mgmt2200:/var/log/sentry >
... View more
08-01-2022
01:12 AM
Hi, Please download full log by using below mentioned link. https://drive.google.com/file/d/1WmOuSBflsj73xYAyxvjJtMlz-2uxBonc/view?usp=sharing
... View more
08-01-2022
12:05 AM
Below is the sentry log root@wa1cog3mgmt2200:/var/log/sentry >vi hadoop-cmf-sentry-SENTRY_SERVER-wa1cog3mgmt2200.cdp.centurylink.com.log.out at org.datanucleus.state.StateManagerImpl.initialiseForPersistentNew(StateManagerImpl.java:120) at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:218) at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2079) at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:1923) at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1778) at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:724) at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:749) at org.apache.sentry.provider.db.service.model.MAuthzPathsMapping.makePersistent(MAuthzPathsMapping.java:185) at org.apache.sentry.provider.db.service.persistent.SentryStore.lambda$persistFullPathsImage$52(SentryStore.java:3413) at org.apache.sentry.provider.db.service.persistent.TransactionManager.executeTransaction(TransactionManager.java:123) at org.apache.sentry.provider.db.service.persistent.TransactionManager$1.call(TransactionManager.java:192) at org.apache.sentry.provider.db.service.persistent.TransactionManager$ExponentialBackoff.execute(TransactionManager.java:233) at org.apache.sentry.provider.db.service.persistent.TransactionManager.executeTransactionWithRetry(TransactionManager.java:188) at org.apache.sentry.provider.db.service.persistent.SentryStore.persistFullPathsImage(SentryStore.java:3386) at org.apache.sentry.provider.db.service.persistent.HMSFollower.createFullSnapshot(HMSFollower.java:423) at org.apache.sentry.provider.db.service.persistent.HMSFollower.syncupWithHms(HMSFollower.java:237) at org.apache.sentry.provider.db.service.persistent.HMSFollower.run(HMSFollower.java:198) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2022-08-01 01:45:31,274 WARN org.apache.sentry.provider.db.service.persistent.TransactionManager: Retrying transaction 10/11 times 2022-08-01 01:45:31,274 WARN org.apache.sentry.provider.db.service.persistent.TransactionManager: Sleeping for 33587 milliseconds before retrying
... View more
07-31-2022
11:45 PM
Hi , Please find the below HS2 logs below. HiveConf of name hive.sentry.conf.url does not exist 2022-08-01 01:42:57,251 WARN org.apache.thrift.transport.TIOStreamTransport: [pool-9-thread-192]: Error closing output stream. java.net.SocketException: Socket closed at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:118) ~[?:1.8.0_181] at java.net.SocketOutputStream.write(SocketOutputStream.java:155) ~[?:1.8.0_181] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) ~[?:1.8.0_181] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) ~[?:1.8.0_181] at java.io.FilterOutputStream.close(FilterOutputStream.java:158) ~[?:1.8.0_181] at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) [hive-exec-2.1.1-cdh6.3.4.jar:2.1.1-cdh6.3.4]
... View more
07-31-2022
09:25 AM
Hi All, I enabled sentry and all services are healthy but unable to create roles and not getting 0: jdbc:hive2://wa1cog3mgmt2200.cdp.centuryli> CREATE ROLE huesuperrole; going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777): CREATE ROLE huesuperrole INFO : Semantic Analysis Completed INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777); Time taken: 2.529 seconds INFO : Executing command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777): CREATE ROLE huesuperrole INFO : Starting task [Stage-0:DDL] in serial mode printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null INFO : Completed executing command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777); Time taken: 184.819 seconds printed operations logs Getting log thread is interrupted, since query is done! Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null (state=08S01,code=1) java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:381) at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:260) at org.apache.hive.beeline.Commands.executeInternal(Commands.java:984) at org.apache.hive.beeline.Commands.execute(Commands.java:1180) at org.apache.hive.beeline.Commands.sql(Commands.java:1109) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1331) at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1188) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1027) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:526) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:508) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:313) at org.apache.hadoop.util.RunJar.main(RunJar.java:227) 0: jdbc:hive2://wa1cog3mgmt2200.cdp.centuryli>
... View more
Labels:
- Labels:
-
Apache Sentry
02-10-2022
12:37 AM
Hi , I am enabling kerberos in newly build cluster but getting below error while enabling kerberos. Please help. /opt/cloudera/cm/bin/import_credentials.sh failed with exit code 1 and output of << + export PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + KEYTAB_OUT=/var/run/cloudera-scm-server/cmf7540304403722920693.keytab + USER=USERNAME-REDACTED + passwd=BUNDLE-REDACTED KVNO=1 + SLEEP=0 + RHEL_FILE=/etc/redhat-release + '[' -f /etc/redhat-release ']' + set +e + grep Tikanga /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'CentOS release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'Scientific Linux release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + set -e + '[' -z /var/run/cloudera-scm-server/krb55731547516040010178.conf ']' + echo 'Using custom config path '\''/var/run/cloudera-scm-server/krb55731547516040010178.conf'\'', contents below:' + cat /var/run/cloudera-scm-server/krb55731547516040010178.conf + IFS=' ' + read -a ENC_ARR + for ENC in '"${ENC_ARR[@]}"' + ktutil + echo 'addent -password -p USERNAME-REDACTED -k 1 -e aes128-cts' + '[' 0 -eq 1 ']' + echo PASSWORD-REDACTED + echo 'wkt /var/run/cloudera-scm-server/cmf7540304403722920693.keytab' + chmod 600 /var/run/cloudera-scm-server/cmf7540304403722920693.keytab + kinit -k -t /var/run/cloudera-scm-server/cmf7540304403722920693.keytab USERNAME-REDACTED + '[' true '!=' true ']' ++ mktemp /tmp/cm_ldap.XXXXXXXX + LDAP_CONF=/tmp/cm_ldap.KGP7XTd0 + echo 'TLS_REQCERT never' + echo 'sasl_secprops minssf=0,maxssf=0' + export LDAPCONF=/tmp/cm_ldap.KGP7XTd0 + LDAPCONF=/tmp/cm_ldap.KGP7XTd0 + set +e + ldapsearch -LLL -H ldaps://Hostname****.jan313.hs.com:636 -b CN=testpoc,OU=bigdata,DC=JAN313,DC=HS,DC=COM userPrincipalName=USERNAME-REDACTED /opt/cloudera/cm/bin/import_credentials.sh: line 84: ldapsearch: command not found + '[' 127 -ne 0 ']' + echo 'ldapsearch did not work with SASL authentication. Trying with simple authentication' + ldapsearch -LLL -H ldaps://hostaname.jan313.hs.com:636 -b CN=testpoc,OU=bigdata,DC=JAN313,DC=HS,DC=COM -x -D USERNAME-REDACTED -w PASSWORD-REDACTED userPrincipalName=USERNAME-REDACTED /opt/cloudera/cm/bin/import_credentials.sh: line 87: ldapsearch: command not found + '[' 127 -ne 0 ']' + echo 'Failed to do ldapsearch.' + echo 'Please make sure Active Directory configuration is correctly specified and LDAP over SSL is enabled.' + exit 1
... View more
Labels:
- Labels:
-
Kerberos
03-18-2021
01:29 PM
Hi Friends , RM UI page is not accessible. log is below. [root@node1 yarn]# netstat -anp | grep 8088 tcp 0 0 0.0.0.0:8088 0.0.0.0:* LISTEN 111749/java tcp 0 0 10.160.102.162:56606 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56656 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56604 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56610 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56618 10.160.102.162:8088 TIME_WAIT - ========================================================================= 2021-03-12 17:54:39,512 INFO client.RpcRetryingCallerImpl (RpcRetryingCallerImpl.java:callWithRetries(134)) - Call exception, tries=6, retries=6, started=4117 ms ago, cancelled=false, msg=Call to host35.fifo.com/10.211.111.17:17020 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifo.com/10.211.111.17:17020, details=row 'prod.timelineservice.flowrun,yarn-cluster!svcumf1d!distcp!^?�����ӕ,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=host35.fifo.com,17020,1590141203044, seqNum=-1 2021-03-12 17:54:43,525 INFO client.RpcRetryingCallerImpl (RpcRetryingCallerImpl.java:callWithRetries(134)) - Call exception, tries=7, retries=7, started=8130 ms ago, cancelled=false, msg=Call to host35.fifo.com/10.211.111.17:17020 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifo.com/10.211.111.17:17020, details=row 'prod.timelineservice.flowrun,yarn-cluster!svcumf1d!distcp!^?�����ӕ,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=host35.fifo.com,17020,1590141203044, seqNum=-1 2021-03-12 17:54:46,665 INFO webapp.ApiServer (ApiServer.java:getVersion(113)) - 3.1.1.3.1.0.0-78 from e4f82af51faec922b4804d0232a637422ec29e64 by jenkins source checksum eab9fa2a6aa38c6362c66d8df75774 2021-03-12 17:54:46,759 INFO webapp.ApiServer (ApiServer.java:getService(197)) - GET: getService for appName = ats-hbase user = yarn-ats (auth:PROXY) via rm/host15.fifo.com@CORPDEV.fifo.com (auth:KERBEROS) 2021-03-12 17:54:46,764 INFO client.RequestHedgingRMFailoverProxyProvider (RequestHedgingRMFailoverProxyProvider.java:init(89)) - Created wrapped proxy for [rm1, rm2] 2021-03-12 17:54:46,765 INFO client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at host15.fifo.com/10.160.102.162:10200 2021-03-12 17:54:46,765 INFO utils.ServiceApiUtil (ServiceApiUtil.java:loadService(359)) - Loading service definition from hdfs://UMFDEV/user/yarn-ats/.yarn/services/ats-hbase/ats-hbase.json 2021-03-12 17:54:46,819 INFO client.RequestHedgingRMFailoverProxyProvider (RequestHedgingRMFailoverProxyProvider.java:invoke(147)) - Looking for the active RM in [rm1, rm2]... 2021-03-12 17:54:46,851 INFO ipc.Server (Server.java:logException(2719)) - IPC Server handler 11 on 8032, call Call#32992 Retry#0 org.apache.hadoop.yarn.api.ApplicationClientProtocolPB.getApplicationReport from 10.160.102.162:39836: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1590152319040_0001' doesn't exist in RM. Please check that the job submission was successful. 2021-03-12 17:54:46,857 WARN client.RequestHedgingRMFailoverProxyProvider (RequestHedgingRMFailoverProxyProvider.java:invoke(177)) - Invocation returned exception: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1590152319040_0001' doesn't exist in RM. Please check that the job submission was successful. at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:382) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:234) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:561) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:524) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1025) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:876) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:822) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2682) on [rm1], so propagating back to caller. 2021-03-12 17:54:46,879 ERROR webapp.ApiServer (ApiServer.java:getService(216)) - Get service failed: {} java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1748) at org.apache.hadoop.yarn.service.webapp.ApiServer.getServiceFromClient(ApiServer.java:745) "hadoop-yarn-resourcemanager-host15.fifo.com.log" 936672L, 184034377C Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifa.com/10.211.111.17:17020 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 7 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifa.com/10.211.111.17:17020 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:715) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 7 more Caused by: java.net.ConnectException: Connection refused ... 11 more 2021-03-18 20:11:17,107 INFO client.RpcRetryingCallerImpl (RpcRetryingCallerImpl.java:callWithRetries(134)) - Call exception, tries=6, retries=6, started=4132 ms ago, cancelled=false, msg=Call to host35.fifa.com/10.211.111.17:17020 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifa.com/10.211.111.17:17020, details=row 'prod.timelineservice.flowrun,yarn-cluster!svcumf1d!distcp!^?����Xb�,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=host35.fifa.com,17020,1590141203044, seqNum=-1
... View more
Labels:
- Labels:
-
Apache YARN