Re: Yarn Queue Manager Not starting

balajip · ‎12-05-2021

@MoatazNader Can you set false for below property and try to rerun the query. CM>Impala> Configuration>Catalog Server Hive Advanced Configuration Snippet (Safety Valve) set hive.metastore.disallow.incompatible.col.type.changes to false and restarted the Impala service.

balajip · ‎11-08-2021

@drgenious From where you connect with impala-shell that will act as impala coordinator other impala damonens are executors. If you configured a dedicated coordinator that daemon won't execute any fragments. For more information about dedicated coordinator please refer to the below doc. https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/impala_dedicated_coordinator.html

balajip · ‎11-03-2021

@drgenious You can create a function like below. CREATE FUNCTION [IF NOT EXISTS] [db_name.]function_name LOCATION 'hdfs_path_to_jar' SYMBOL='class_name' For more information please refer below doc. https://docs.cloudera.com/documentation/enterprise/latest/topics/impala_create_function.html#create_function

balajip · ‎10-28-2021

@dv_conan Can you please check the cm and cdp/cdh compatibility. use the below link to check. If not compatible please upgrade your CM and check. https://supportmatrix.cloudera.com/

balajip · ‎10-27-2021

@MikeB You can find/add the property in Ambari--> YARN--> Configs--> Advanced--> Customer yarn-site --> Add/find Property

balajip · ‎10-25-2021

@railincdba Seems ambari database not updated. Can you restart ambari-server and ambari-agent from the decommission nodemanager host and check. If issues still persist you can revert the changes (Recommission NodeManagers) then decommission it and check.

balajip · ‎10-25-2021

Hello @MikeB As for automatic clean up not getting triggered, well it may be due to (or at-least related to) this unresolved bug reported on Yarn. https://issues.apache.org/jira/browse/YARN-4540 You can reduce the below property value to lower the local file cache size. yarn.nodemanager.localizer.cache.target-size-mb

balajip · ‎10-11-2021

@cloudera_de575 For the failed query STATUS=ERROR the exception will not show in Queries tab from das webui. you can use the queryId to check the exception in hs2 log.

balajip · ‎10-11-2021

@Sam7 Was the query working fine before in das ?

balajip · ‎10-10-2021

@Geenspruitjes Was the below query working in hs2 beeline ? 'select cola, null as colb, "x" as colc from mytable' Can you share the show create table output. show create table <tablename>;

balajip · ‎10-07-2021

@MikeB To resolve this issue, configure Hive Metastore to use SerdeStorageSchemaReader implementation: Go to Ambari > Hive > Config > Custom hive-site . Set the following property to configure Hive Metastore: metastore.storage.schema.reader.impl=org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader

balajip · ‎09-21-2021

@drgenious You can find the impala memory consumption in the "impala_memory_total_used" chart. In Cm -> impala -> charts library -> impala_memory_total_used

balajip · ‎09-14-2021

@Sayed016 Can you set the property below and try to rerun the query. set hive.fetch.task.conversion=none;

balajip · ‎08-23-2021

@Amn_468 Please refer the below Knowledge base article for heap memory calculation. https://my.cloudera.com/knowledge/Impaladembeddedjvmheapsize-has-a-default-value-of-32-GB-after?id=278279

balajip · ‎08-01-2021

@Gcima009 Please follow below steps to install oozie sharelib. Stop Oozie Service. Go to --> Cloudera Manager --> Oozie --> Actions --> Click on Install Oozie Sharelib Restart Oozie.

balajip · ‎07-21-2021

@MattSchmitz Please check the permission for the Log directory. you can find the log location in LogPath.

balajip · ‎04-13-2021

Hello @ryu Please refer below doc for query failed with this error Result fetch timed out in hive view. https://community.cloudera.com/t5/Community-Articles/How-to-fix-ambari-Hive-View-1-5-2-0-Result-fetch-timed-out/ta-p/244965

balajip · ‎04-06-2021

Hello @ryu Please refer below doc for enable ranger Authorization for hive LLAP. https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.0.1/securing-hive/content/hive_secure_llap_in_hiveserver.html

balajip · ‎01-22-2021

@mike_bronson7Please refer below KB article for this issue https://my.cloudera.com/knowledge/StandBy-NameNode-fails-to-start-Error-shows--?id=271605

balajip · ‎11-23-2020

@JoSam Please refer below doc to clean old queries. https://docs.cloudera.com/HDPDocuments/DAS/DAS-1.4.4/operations/content/das_postgres_db_cleanup.html Can I delete this table? select pg_size_pretty(pg_total_relation_size('query_details')); -- run this query to check the table size. truncate table das.query_details CASCADE; -- run this command to truncate the table data.

balajip · ‎10-28-2020

@kuldeephawks 1. Enable debug for HiveServer Interactive from Ambari -> Hive -> Configs -> Advanced hive-log4j2. Update below property and set it to DEBUG: property.hive.log.level = DEBUG 2. Restart HSI or From ambari > Hive > Configs > Hive log level > change to DEBUG from INFO.

balajip · ‎10-13-2020

Seems you are hitting the number of max buckets limit in hive. For more information please refer below apache jira. https://issues.apache.org/jira/browse/TEZ-4130

balajip · ‎10-11-2020

@analytics-shek From when you started facing this issue ? Have you done any recent changes ? Are you able to run any other query on this students table ? can you set the below property to false in beeline session and try to rerun the query. hive.query.results.cache.enabled to false

balajip · ‎10-09-2020

@Mondi You can use the below property to use a specific queue for hue jobs. set below property before running query in hue. set mapred.job.queue.name=<hue_queue>;

Online	Offline
Last Visited	‎05-27-2022 02:10 PM

Date Registered	‎12-18-2018 11:13 AM
Last Visited	‎05-27-2022 02:10 PM
Total Messages Posted	71
Total Kudos Received	5

Re: Yarn Queue Manager Not starting

Re: Decomissioning a NodeManager in HDP 2.6.1

Re: /hadoop/yarn/local/usercache/hive/filecache/ g...

Re: Hive Error while calling watcher java.util.co...

Re: How to set the logging level of the hiveserver...

Re: Impala catalog metadata

Re: Impala executors and coordinators

Re: Create function every time impala restart

Re: Yarn Queue Manager Not starting

Re: /hadoop/yarn/local/usercache/hive/filecache/ g...

Re: Decomissioning a NodeManager in HDP 2.6.1

Re: /hadoop/yarn/local/usercache/hive/filecache/ g...

Re: Query error status in DAS

Re: SQL statement to capitalize the first letter

Re: python hivejdbc returns null values after firs...

Re: message:java.lang.UnsupportedOperationExceptio...

Re: Find the % of the used memory in impala

Re: Hive Error while calling watcher java.util.co...

Re: Impala Catalogue Server OOM

Re: Oozie does not create /user/oozie/shere/lib fo...

Re: Impala ODBC Logging Options: Automatically Rev...

Re: Why is that beeline hive query ran successfull...

Re: How to enable ranger authorization on hive LLA...

Re: What is the preferred solution for corrupted n...

Re: Data analytics studio Postgres database is la...

Re: How to set the logging level of the hiveserver...

Re: bucketId out of range: 4147

Re: Not able to Insert data into Hive table

Re: How can I make my Hue User run in a specific q...