Hi Team, Mysql service is not getting start and log is also not showing . Can someone help?   [root@]# service mysqld start Redirecting to /bin/systemctl start mysqld.service Job for mysqld.service failed because a configured resource limit was exceeded. See "systemctl status mysqld.service" and "journalctl -xe" for details. [root@devtest mysqld.log]#   Regards Shamim   ... View more

Dear Friends, I am upgrading CDH to CDP and getting below error while upgrading. Please help.    Show All Steps  Show Only Failed Steps  Show Only Running Steps     Converting configuration parameters Failed due to java.lang.IllegalStateException: HS2 role count in Hive and Hive on Tez services should match.     Failed due to java.lang.IllegalStateException: HS2 role count in Hive and Hive on Tez services should match java.lang.IllegalStateException: HS2 role count in Hive and Hive on Tez services should match.  ... View more

Hi All,   I enabled sentry and all services are healthy but unable to create roles and not getting   0: jdbc:hive2://wa1cog3mgmt2200.cdp.centuryli> CREATE ROLE huesuperrole; going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777): CREATE ROLE huesuperrole INFO : Semantic Analysis Completed INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777); Time taken: 2.529 seconds INFO : Executing command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777): CREATE ROLE huesuperrole INFO : Starting task [Stage-0:DDL] in serial mode printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null INFO : Completed executing command(queryId=hive_20220731105224_c56c786a-bfaf-4270-a2a0-e62936b67777); Time taken: 184.819 seconds printed operations logs Getting log thread is interrupted, since query is done! Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null (state=08S01,code=1) java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:381) at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:260) at org.apache.hive.beeline.Commands.executeInternal(Commands.java:984) at org.apache.hive.beeline.Commands.execute(Commands.java:1180) at org.apache.hive.beeline.Commands.sql(Commands.java:1109) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1331) at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1188) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1027) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:526) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:508) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:313) at org.apache.hadoop.util.RunJar.main(RunJar.java:227) 0: jdbc:hive2://wa1cog3mgmt2200.cdp.centuryli> ... View more

Hi , I am enabling kerberos in newly build cluster but getting below error while enabling kerberos. Please help.   /opt/cloudera/cm/bin/import_credentials.sh failed with exit code 1 and output of << + export PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + KEYTAB_OUT=/var/run/cloudera-scm-server/cmf7540304403722920693.keytab + USER=USERNAME-REDACTED + passwd=BUNDLE-REDACTED KVNO=1 + SLEEP=0 + RHEL_FILE=/etc/redhat-release + '[' -f /etc/redhat-release ']' + set +e + grep Tikanga /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'CentOS release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'Scientific Linux release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + set -e + '[' -z /var/run/cloudera-scm-server/krb55731547516040010178.conf ']' + echo 'Using custom config path '\''/var/run/cloudera-scm-server/krb55731547516040010178.conf'\'', contents below:' + cat /var/run/cloudera-scm-server/krb55731547516040010178.conf + IFS=' ' + read -a ENC_ARR + for ENC in '"${ENC_ARR[@]}"' + ktutil + echo 'addent -password -p USERNAME-REDACTED -k 1 -e aes128-cts' + '[' 0 -eq 1 ']' + echo PASSWORD-REDACTED + echo 'wkt /var/run/cloudera-scm-server/cmf7540304403722920693.keytab' + chmod 600 /var/run/cloudera-scm-server/cmf7540304403722920693.keytab + kinit -k -t /var/run/cloudera-scm-server/cmf7540304403722920693.keytab USERNAME-REDACTED + '[' true '!=' true ']' ++ mktemp /tmp/cm_ldap.XXXXXXXX + LDAP_CONF=/tmp/cm_ldap.KGP7XTd0 + echo 'TLS_REQCERT never' + echo 'sasl_secprops minssf=0,maxssf=0' + export LDAPCONF=/tmp/cm_ldap.KGP7XTd0 + LDAPCONF=/tmp/cm_ldap.KGP7XTd0 + set +e + ldapsearch -LLL -H ldaps://Hostname****.jan313.hs.com:636 -b CN=testpoc,OU=bigdata,DC=JAN313,DC=HS,DC=COM userPrincipalName=USERNAME-REDACTED /opt/cloudera/cm/bin/import_credentials.sh: line 84: ldapsearch: command not found + '[' 127 -ne 0 ']' + echo 'ldapsearch did not work with SASL authentication. Trying with simple authentication' + ldapsearch -LLL -H ldaps://hostaname.jan313.hs.com:636 -b CN=testpoc,OU=bigdata,DC=JAN313,DC=HS,DC=COM -x -D USERNAME-REDACTED -w PASSWORD-REDACTED userPrincipalName=USERNAME-REDACTED /opt/cloudera/cm/bin/import_credentials.sh: line 87: ldapsearch: command not found + '[' 127 -ne 0 ']' + echo 'Failed to do ldapsearch.' + echo 'Please make sure Active Directory configuration is correctly specified and LDAP over SSL is enabled.' + exit 1 ... View more

Hi Friends , RM UI page is not accessible. log is below. [root@node1 yarn]# netstat -anp | grep 8088 tcp 0 0 0.0.0.0:8088 0.0.0.0:* LISTEN 111749/java tcp 0 0 10.160.102.162:56606 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56656 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56604 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56610 10.160.102.162:8088 TIME_WAIT - tcp 0 0 10.160.102.162:56618 10.160.102.162:8088 TIME_WAIT - =========================================================================   2021-03-12 17:54:39,512 INFO client.RpcRetryingCallerImpl (RpcRetryingCallerImpl.java:callWithRetries(134)) - Call exception, tries=6, retries=6, started=4117 ms ago, cancelled=false, msg=Call to host35.fifo.com/10.211.111.17:17020 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifo.com/10.211.111.17:17020, details=row 'prod.timelineservice.flowrun,yarn-cluster!svcumf1d!distcp!^?�����ӕ,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=host35.fifo.com,17020,1590141203044, seqNum=-1 2021-03-12 17:54:43,525 INFO client.RpcRetryingCallerImpl (RpcRetryingCallerImpl.java:callWithRetries(134)) - Call exception, tries=7, retries=7, started=8130 ms ago, cancelled=false, msg=Call to host35.fifo.com/10.211.111.17:17020 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifo.com/10.211.111.17:17020, details=row 'prod.timelineservice.flowrun,yarn-cluster!svcumf1d!distcp!^?�����ӕ,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=host35.fifo.com,17020,1590141203044, seqNum=-1 2021-03-12 17:54:46,665 INFO webapp.ApiServer (ApiServer.java:getVersion(113)) - 3.1.1.3.1.0.0-78 from e4f82af51faec922b4804d0232a637422ec29e64 by jenkins source checksum eab9fa2a6aa38c6362c66d8df75774 2021-03-12 17:54:46,759 INFO webapp.ApiServer (ApiServer.java:getService(197)) - GET: getService for appName = ats-hbase user = yarn-ats (auth:PROXY) via rm/host15.fifo.com@CORPDEV.fifo.com (auth:KERBEROS) 2021-03-12 17:54:46,764 INFO client.RequestHedgingRMFailoverProxyProvider (RequestHedgingRMFailoverProxyProvider.java:init(89)) - Created wrapped proxy for [rm1, rm2] 2021-03-12 17:54:46,765 INFO client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at host15.fifo.com/10.160.102.162:10200 2021-03-12 17:54:46,765 INFO utils.ServiceApiUtil (ServiceApiUtil.java:loadService(359)) - Loading service definition from hdfs://UMFDEV/user/yarn-ats/.yarn/services/ats-hbase/ats-hbase.json 2021-03-12 17:54:46,819 INFO client.RequestHedgingRMFailoverProxyProvider (RequestHedgingRMFailoverProxyProvider.java:invoke(147)) - Looking for the active RM in [rm1, rm2]... 2021-03-12 17:54:46,851 INFO ipc.Server (Server.java:logException(2719)) - IPC Server handler 11 on 8032, call Call#32992 Retry#0 org.apache.hadoop.yarn.api.ApplicationClientProtocolPB.getApplicationReport from 10.160.102.162:39836: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1590152319040_0001' doesn't exist in RM. Please check that the job submission was successful. 2021-03-12 17:54:46,857 WARN client.RequestHedgingRMFailoverProxyProvider (RequestHedgingRMFailoverProxyProvider.java:invoke(177)) - Invocation returned exception: org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException: Application with id 'application_1590152319040_0001' doesn't exist in RM. Please check that the job submission was successful. at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:382) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:234) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:561) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:524) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1025) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:876) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:822) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2682) on [rm1], so propagating back to caller. 2021-03-12 17:54:46,879 ERROR webapp.ApiServer (ApiServer.java:getService(216)) - Get service failed: {} java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1748) at org.apache.hadoop.yarn.service.webapp.ApiServer.getServiceFromClient(ApiServer.java:745) "hadoop-yarn-resourcemanager-host15.fifo.com.log" 936672L, 184034377C   Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifa.com/10.211.111.17:17020 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 7 more   Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifa.com/10.211.111.17:17020 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:715) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 7 more Caused by: java.net.ConnectException: Connection refused ... 11 more 2021-03-18 20:11:17,107 INFO client.RpcRetryingCallerImpl (RpcRetryingCallerImpl.java:callWithRetries(134)) - Call exception, tries=6, retries=6, started=4132 ms ago, cancelled=false, msg=Call to host35.fifa.com/10.211.111.17:17020 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: host35.fifa.com/10.211.111.17:17020, details=row 'prod.timelineservice.flowrun,yarn-cluster!svcumf1d!distcp!^?����Xb�,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=host35.fifa.com,17020,1590141203044, seqNum=-1 ... View more