About balajip

balajip · ‎11-03-2022

@chengxi Can you share the stack trace before the SHUTDOWN_MSG in hive.

balajip · ‎10-30-2022

@Anjaliwbmd can you please share the cluster version ? Does the issue user have admin privilege ?

balajip · ‎10-07-2022

@Anjaliwbmd You mean the issue user unable to see "Workflows, Schedules" tabs hue ?

balajip · ‎07-26-2022

@newbieone Was the above query working fine in hs2(beeline) ? If yes then you can use the oozie-hive action to run the query. Refer: https://community.cloudera.com/t5/Community-Articles/Oozie-Hive-2-Action-in-a-Kerberized-cluster/ta-p/248913

balajip · ‎07-26-2022

@learner1 Can you please set the below property value in yarn and try to rerun the query. mapreduce.framework.name=yarn

balajip · ‎07-01-2022

@Asim- Please refer below doc to schedule oozie job. https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/configuring-oozie/topics/oozie-scheduling-examples.html Let me now if you have any concerns.

balajip · ‎07-01-2022

@Meshal Thanks for your response. please check how the table was created in both clusters? Run show create table and compare the output. Solution: you can get a patch for this IMPALA-7087 in CDH 6.3.3

balajip · ‎06-27-2022

@Meshal You are hitting the below bug. https://issues.apache.org/jira/browse/IMPALA-7087 Let me know if you have any concerns.

balajip · ‎06-22-2022

@drgenious In hue -> issue workflow -> click gear icon -> retry interval Let me know if you have any concerns.

balajip · ‎06-21-2022

Hello @drgenious Please use the below line to retry the workflow. <action name="a" retry-max="2" retry-interval="1"> Refer : https://oozie.apache.org/docs/3.3.0/WorkflowFunctionalSpec.html#a18_User-Retry_for_Workflow_Actions_since_Oozie_3.1 Let me know if it helps.

balajip · ‎12-05-2021

@MoatazNader Can you set false for below property and try to rerun the query. CM>Impala> Configuration>Catalog Server Hive Advanced Configuration Snippet (Safety Valve) set hive.metastore.disallow.incompatible.col.type.changes to false and restarted the Impala service.

balajip · ‎11-08-2021

@drgenious From where you connect with impala-shell that will act as impala coordinator other impala damonens are executors. If you configured a dedicated coordinator that daemon won't execute any fragments. For more information about dedicated coordinator please refer to the below doc. https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/impala_dedicated_coordinator.html

balajip · ‎11-03-2021

@drgenious You can create a function like below. CREATE FUNCTION [IF NOT EXISTS] [db_name.]function_name LOCATION 'hdfs_path_to_jar' SYMBOL='class_name' For more information please refer below doc. https://docs.cloudera.com/documentation/enterprise/latest/topics/impala_create_function.html#create_function

balajip · ‎10-28-2021

@dv_conan Can you please check the cm and cdp/cdh compatibility. use the below link to check. If not compatible please upgrade your CM and check. https://supportmatrix.cloudera.com/

balajip · ‎10-27-2021

@MikeB You can find/add the property in Ambari--> YARN--> Configs--> Advanced--> Customer yarn-site --> Add/find Property

balajip · ‎10-25-2021

@railincdba Seems ambari database not updated. Can you restart ambari-server and ambari-agent from the decommission nodemanager host and check. If issues still persist you can revert the changes (Recommission NodeManagers) then decommission it and check.

balajip · ‎10-25-2021

Hello @MikeB As for automatic clean up not getting triggered, well it may be due to (or at-least related to) this unresolved bug reported on Yarn. https://issues.apache.org/jira/browse/YARN-4540 You can reduce the below property value to lower the local file cache size. yarn.nodemanager.localizer.cache.target-size-mb

balajip · ‎10-11-2021

@cloudera_de575 For the failed query STATUS=ERROR the exception will not show in Queries tab from das webui. you can use the queryId to check the exception in hs2 log.

balajip · ‎10-11-2021

@Sam7 Was the query working fine before in das ?

balajip · ‎10-10-2021

@Geenspruitjes Was the below query working in hs2 beeline ? 'select cola, null as colb, "x" as colc from mytable' Can you share the show create table output. show create table <tablename>;

balajip · ‎10-07-2021

@MikeB To resolve this issue, configure Hive Metastore to use SerdeStorageSchemaReader implementation: Go to Ambari > Hive > Config > Custom hive-site . Set the following property to configure Hive Metastore: metastore.storage.schema.reader.impl=org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader

balajip · ‎09-21-2021

@drgenious You can find the impala memory consumption in the "impala_memory_total_used" chart. In Cm -> impala -> charts library -> impala_memory_total_used

balajip · ‎09-14-2021

@Sayed016 Can you set the property below and try to rerun the query. set hive.fetch.task.conversion=none;

balajip · ‎08-23-2021

@Amn_468 Please refer the below Knowledge base article for heap memory calculation. https://my.cloudera.com/knowledge/Impaladembeddedjvmheapsize-has-a-default-value-of-32-GB-after?id=278279

balajip · ‎08-01-2021

@Gcima009 Please follow below steps to install oozie sharelib. Stop Oozie Service. Go to --> Cloudera Manager --> Oozie --> Actions --> Click on Install Oozie Sharelib Restart Oozie.

balajip · ‎07-21-2021

@MattSchmitz Please check the permission for the Log directory. you can find the log location in LogPath.

balajip · ‎04-13-2021

Hello @ryu Please refer below doc for query failed with this error Result fetch timed out in hive view. https://community.cloudera.com/t5/Community-Articles/How-to-fix-ambari-Hive-View-1-5-2-0-Result-fetch-timed-out/ta-p/244965

balajip · ‎04-06-2021

Hello @ryu Please refer below doc for enable ranger Authorization for hive LLAP. https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.0.1/securing-hive/content/hive_secure_llap_in_hiveserver.html

balajip · ‎01-22-2021

@mike_bronson7Please refer below KB article for this issue https://my.cloudera.com/knowledge/StandBy-NameNode-fails-to-start-Error-shows--?id=271605

balajip · ‎11-23-2020

@JoSam Please refer below doc to clean old queries. https://docs.cloudera.com/HDPDocuments/DAS/DAS-1.4.4/operations/content/das_postgres_db_cleanup.html Can I delete this table? select pg_size_pretty(pg_total_relation_size('query_details')); -- run this query to check the table size. truncate table das.query_details CASCADE; -- run this command to truncate the table data.

Online	Offline
Last Visited	‎12-02-2022 06:25 AM

Date Registered	‎12-18-2018 11:13 AM
Last Visited	‎12-02-2022 06:25 AM
Total Messages Posted	109
Total Kudos Received	5

Re: Ozzie Hive Script

Re: Retry in oozie through hue

Re: Yarn Queue Manager Not starting

Re: Decomissioning a NodeManager in HDP 2.6.1

Re: /hadoop/yarn/local/usercache/hive/filecache/ g...

Re: kerberos fails to be installed and hive cannot...

Re: On HUE UI - Workflow and schedules tabs are m...

Re: On HUE UI - Workflow and schedules tabs are m...

Re: Ozzie Hive Script

Re: insert query

Re: Schedule Impala Query - Oozie Scheduler

Re: Parquet Decimal Datatype Returning an Error in...

Re: Parquet Decimal Datatype Returning an Error in...

Re: Retry in oozie through hue

Re: Retry in oozie through hue

Re: Impala catalog metadata

Re: Impala executors and coordinators

Re: Create function every time impala restart

Re: Yarn Queue Manager Not starting

Re: /hadoop/yarn/local/usercache/hive/filecache/ g...

Re: Decomissioning a NodeManager in HDP 2.6.1

Re: /hadoop/yarn/local/usercache/hive/filecache/ g...

Re: Query error status in DAS

Re: SQL statement to capitalize the first letter

Re: python hivejdbc returns null values after firs...

Re: message:java.lang.UnsupportedOperationExceptio...

Re: Find the % of the used memory in impala

Re: Hive Error while calling watcher java.util.co...

Re: Impala Catalogue Server OOM

Re: Oozie does not create /user/oozie/shere/lib fo...

Re: Impala ODBC Logging Options: Automatically Rev...

Re: Why is that beeline hive query ran successfull...

Re: How to enable ranger authorization on hive LLA...

Re: What is the preferred solution for corrupted n...

Re: Data analytics studio Postgres database is la...