Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.
raghu9raghavend
Contributor

Re: hive connection via zookeeper

by Contributor in Support Questions
‎12-13-2022 07:17 AM
‎12-13-2022 07:17 AM
Thanks for the responses. This is a old one and resolved long back. ... View more

Re: msck repair is failing for random partitions

by Contributor in Support Questions
‎11-10-2021 09:23 AM
‎11-10-2021 09:23 AM
2021-11-02 09:27:36,555 WARN org.apache.hive.common.util.RetryUtilities$ExponentiallyDecayingBatchWork: [HiveServer2-Background-Pool: Thread-180]: Exception thrown while processing using a batch size 15 org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Expecting a partition with name extract_date=2018-02-15, but metastore is returning a partition with name extract_date=2018-02-15 .) at org.apache.hadoop.hive.ql.metadata.Hive.createPartitions(Hive.java:2201) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.exec.DDLTask$1.execute(DDLTask.java:2020) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.exec.DDLTask$1.execute(DDLTask.java:1999) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hive.common.util.RetryUtilities$ExponentiallyDecayingBatchWork.run(RetryUtilities.java:93) [hive-common-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.exec.DDLTask.createPartitionsInBatches(DDLTask.java:2027) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.exec.DDLTask.msck(DDLTask.java:1918) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:413) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2200) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1843) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1563) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1339) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1334) [hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:256) [hive-service-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hive.service.cli.operation.SQLOperation.access$600(SQLOperation.java:92) [hive-service-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:345) [hive-service-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_231] at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_231] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) [hadoop-common-3.0.0-cdh6.2.1.jar:?] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:357) [hive-service-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_231] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_231] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_231] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_231] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_231] Caused by: org.apache.hadoop.hive.metastore.api.MetaException: Expecting a partition with name extract_date=2018-02-15, but metastore is returning a partition with name extract_date=2018-02-15 . at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$add_partitions_req_result$add_partitions_req_resultStandardScheme.read(ThriftHiveMetastore.java:64399) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$add_partitions_req_result$add_partitions_req_resultStandardScheme.read(ThriftHiveMetastore.java:64358) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$add_partitions_req_result.read(ThriftHiveMetastore.java:64281) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_add_partitions_req(ThriftHiveMetastore.java:1819) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.add_partitions_req(ThriftHiveMetastore.java:1806) ~[hive-exec-2.1.1-cdh6.2.1.jar:2.1.1-cdh6.2.1]   ... View more

msck repair is failing for random partitions

by Contributor in Support Questions
‎11-09-2021 08:13 AM
‎11-09-2021 08:13 AM
Hi,  We recently upgraded the cluster from CDH 5.16.2 to CDH 6.2.1 and after the upgrade MSCK repair in hive is failing for random partitions and for random tables, does anyone has any insights on how to fix this issue?    Thanks ... View more
Labels:

HTTP 403: Yarn RM UI and History server UI are th...

by Contributor in Support Questions
‎01-07-2021 01:26 PM
‎01-07-2021 01:26 PM
Hi All,  Yarn RM UI and History server are throwing java.lang.illegalargumentexception when try to launch.  Java version: 1.8.0_241 CDH: 6.2.1 Any Suggestions on how to over come this error.      ... View more
Labels:

Restricting UDF function access to fewer roles

by Contributor in Support Questions
‎11-30-2020 11:47 AM
‎11-30-2020 11:47 AM
Recently we added few jars to the AUX jar location in our environments and I can see the desired functions from Hive and these functions are accessible by all users who are connecting to hadoop. Is there any way to restrict the newly added functions(added UDF jar file on all hive and HS2 servers) only to fewer users instead of all using roles?  current env: CDH 6.21.   ... View more

Notable changes from 5.16.2 to 6.2.1

by Contributor in Support Questions
‎06-29-2020 08:56 AM
‎06-29-2020 08:56 AM
Hi Everyone,  Currently we are at 5.16.2 CDH version and planning to upgrade to 6.2.1. I'm searching for the notable changes from the current version to the new version, but cannot find any. can anyone provide the notable changes from 5.16.2 to 6.2.1. Does CDH 6.2.X supports erasure coding??   Thanks, RV. ... View more

Re: yarm RM and NM on same node

by Contributor in Support Questions
‎05-20-2020 12:39 PM
‎05-20-2020 12:39 PM
Thanks @StevenOD. we have a similar layout. But more jobs are adding to the cluster every day, as a result, there are some resource constraints. we are not expanding the cluster this year, hence searching for other routes like adding NM on top of RM and NN. Is it good to add NM on the Master nodes where NN and RM are hosted? Thanks, Raghu.  ... View more

yarm RM and NM on same node

by Contributor in Support Questions
‎05-19-2020 08:51 PM
‎05-19-2020 08:51 PM
Hi All, Is it suggested to have both the Resource Manager and Node Manager on the same nodes? Cluster is with 51 nodes and each node is 512Gb of memory.    Thanks, Raghu. ... View more
Labels:

Re: times series graph for httpfs in cloudera mana...

by Contributor in Support Questions
‎02-20-2020 11:15 AM
‎02-20-2020 11:15 AM
@venkatsambath Thanks for your input's on this. I built the chart and your redirect provided extra metrics.  ... View more

times series graph for httpfs in cloudera manager

by Contributor in Support Questions
‎02-20-2020 08:10 AM
‎02-20-2020 08:10 AM
Hi all,  Does any one know how to create timeseries graph for httpfs service from cloudera manager.  Currently we have httpfs service on 3 servers and We need to build a graph on top of it. Is there any query which I Can use of it to create a graph.   Thanks, Raghu. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎01-24-2023 04:30 PM
Public Statistics
Date Registered ‎06-10-2017 07:45 PM
Last Visited ‎01-24-2023 04:30 PM
Total Messages Posted 39
Total Kudos Received 1