Member since
03-19-2018
47
Posts
2
Kudos Received
0
Solutions
04-25-2018
08:55 AM
Could you please suggest why and how should i resolve the below error [pool-4-thread-3]: AlreadyExistsException(message:Database cloudera_manager_metastore_canary_test_db_hive_HIVEMETASTORE_eab3ee7a2ef37229bc56436ae1121ac2 already exists) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database(HiveMetaStore.java:941) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:138) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99) at com.sun.proxy.$Proxy8.create_database(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_database.getResult(ThriftHiveMetastore.java:8863) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_database.getResult(ThriftHiveMetastore.java:8847) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:735) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:730) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:730) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
... View more
Labels:
- Labels:
-
Apache Hive
-
Cloudera Manager
04-23-2018
11:13 AM
2 Kudos
Could anyone please let me know , how could i resolve the below error [23/Apr/2018 11:10:05 -0700] conf ERROR failed to get oozie status Traceback (most recent call last): File "/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/conf.py", line 61, in get_oozie_status status = str(get_oozie(user).get_oozie_status()) File "/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/oozie_api.py", line 325, in get_oozie_status resp = self._root.get('admin/status', params) File "/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 98, in get return self.invoke("GET", relpath, params, headers=headers, allow_redirects=True) File "/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 79, in invoke urlencode=self._urlencode) File "/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/hue/desktop/core/src/desktop/lib/rest/http_client.py", line 170, in execute raise self._exc_class(ex) RestException: bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)
... View more
Labels:
- Labels:
-
Cloudera Manager
-
Security
04-18-2018
07:57 AM
Awesome ..you are right , i have successfully enabled TLS/SSL with Level -3 encryption Thank you @GeKas for all your inputs
... View more
04-18-2018
06:04 AM
But woudn't this would have an impact on the certificate already being generated from CA Team ? As the private key changes .crt file would also change right ? in that case Cloudera TLS/SSL -level 3 configuration may not work It's just an thought process , please clarify
... View more
04-17-2018
10:31 PM
i did not mentioned any passphrase while generating the TLS Private key and the Certificates has been issued by the CA Team As the document states to set client_keypw_file with the password of Private key. what steps do i need to take in this case ? Reference Link https://www.cloudera.com/documentation/enterprise/5-8-x/topics/cm_sg_config_tls_agent_auth.html#concept_oqh_mxk_rp
... View more
Labels:
04-11-2018
08:53 PM
Great !...Thank you… I got to have realized lately
... View more
04-10-2018
07:39 AM
i'm unable to remove dead host which no-longer exists from the Cluster. i tried deleting/removing from the cluster but after few mins it comes back , i think couldera management services is bringing back those dead host could you please let me know , how could i get this resolved ? for now, i have decommissioned the host and suppressed the agent status alert
... View more
Labels:
- Labels:
-
Cloudera Manager
03-24-2018
12:08 AM
Yes, we do have an KMS service in the cluster.Thanks for providing an clarity on "OS running out of PID"
... View more
03-23-2018
11:25 PM
i'm currently on CDH - 5.8.2 with KMS service, but what's your thought about OS running out of PID as the error message suggests to be likely so?
... View more
03-22-2018
11:47 PM
YARN Resource Manager Halts with the OOM : Unable to create native thread and the Job fails over to standby Resource Manager in completing the Task. Could you please let us know the root cause of the issue ERROR Message : 2018-03-22 02:30:09,637 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e189_1521451854044_2288_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2018-03-22 02:30:10,413 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e189_1521451854044_2288_01_000002 Container Transitioned from ACQUIRED to RUNNING 2018-03-22 02:30:10,695 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate... 2018-03-22 02:30:19,354 INFO org.apache.hadoop.yarn.server.webproxy.WebAppProxyServlet: hue is accessing unchecked http://server1:43045/ws/v1/mapreduce/jobs/job_1521451854044_2288 which is the app master GUI of application_1521451854044_2288 owned by edh_srv_prod 2018-03-22 02:30:30,212 INFO org.apache.hadoop.yarn.server.webproxy.WebAppProxyServlet: hue is accessing unchecked http://server1:43045/ws/v1/mapreduce/jobs/job_1521451854044_2288 which is the app master GUI of application_1521451854044_2288 owned by edh_srv_prod 2018-03-22 02:30:34,090 FATAL org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread Thread[2101925946@qtp-1878992188-14302,5,main] threw an Error. Shutting down now... java.lang.OutOfMemoryError: unable to create new native thread at java.lang.Thread.start0(Native Method) at java.lang.Thread.start(Thread.java:714) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1095) at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387) at org.mortbay.jetty.security.SslSocketConnector$SslConnection.run(SslSocketConnector.java:723) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) 2018-03-22 02:30:34,093 INFO org.apache.hadoop.util.ExitUtil: Halt with status -1 Message: HaltException yarn application -status application_1521451854044_2288 Application Report : Application-Id : application_1521451854044_2288 Application-Name : oozie:launcher:T=shell:W=OS_Changes_incremental_workflow:A=shell-b8b2:ID=0006766-180222181315002-oozie-oozi-W Application-Type : MAPREDUCE User : edh_srv_prod Queue : root.edh_srv_prod Start-Time : 1521710999557 Finish-Time : 1521711593154 Progress : 100% State : FINISHED Final-State : SUCCEEDED Tracking-URL : https://server1:19890/jobhistory/job/job_1521451854044_2288 RPC Port : 40930 AM Host : server3 Aggregate Resource Allocation : 1809548 MB-seconds, 1181 vcore-seconds Log Aggregation Status : SUCCEEDED Diagnostics : Attempt recovered after RM restart
... View more
Labels:
- Labels:
-
Apache YARN
-
Cloudera Manager
- « Previous
- Next »