@Mondi    You can set the hive scratch directories to modify the intermediate data storage location from default /tmp hive.exec.local.scratchdir-  Local Directory where Hive stores jars and data when performing a MapJoin optimization. If not specified, Hive uses a default location. hive.exec.scratchdir Directory in HDFS where Hive writes intermediate data between MapReduce jobs. If not specified, Hive uses a default location.   Refer https://docs.cloudera.com/documentation/enterprise/6/properties/6.3/topics/cm_props_cdh600_hive.html#concept_6.3.x_hiveserver2_props__section_advanced_props   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.   ... View more

@SeanU    You can select the role group for the YARN role for which you want to configure log events, or search for "Rules to Extract Events from Log Files". These generate the events for the service and you can set alerts for these log events. Alert publisher can be configured to generate emails for alerts.   Refer https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_dg_monitoring_settings.html#cmug_topic_4_12_4__section_vlc_qr3_dr   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Replied on the new thread ... View more

  @AnjaliRocks    You should consider clearing the user .Trash directory or consider increasing the disk space quota.   You can try changing the 'yarn.app.mapreduce.am.staging-dir' in YARN configuration. 'yarn.app.mapreduce.am.staging-dir' is the property used to set the root HDFS directory of the staging area for users' MR2 jobs. By default this is set /user. You can change this to a different location that doesn't have any quota. YARN staging directories will be created under the new path always named after the user.    ... View more

@AnjaliRocks    It seems there are issues is removing trash from the user folder for which disk space quota is enabled leading to errors exceeding quota. What is the spark version? The support for purge was added in Spark 2.0:    As a workaround you can alter table properties to enable auto purge. ALTER TABLE table_name SET TBLPROPERTIES('auto.purge'='TRUE');   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.   ... View more

@syedshakir    For existing DB, stop the hue service and alter the DB using below query:   ALTER DATABASE hue CHARACTER SET utf8 ; ALTER DATABASE hue COLLATE = 'utf8_general_ci';   Start the hue service.   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.     ... View more

@Mondi    The group where the admin user is present should be added as the sentry admin group. This would also enable all other users in the group to act as sentry admins. If you want to se the user alone add it to the sentry admin groups as each user has a corresponding group entry created by the same name locally.   Please ensure that the user and group exists on all nodes on the cluster. ... View more

@Mondi    You should set yarn acls to restrict user access on YARN.  Please check if dr.who is part of yarn admin acl configurations in YARN. Remove the user in this case and set dedicated user and groups for yarn access   Refer https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_mc_yarn_acl.html#concept_manage_yarn_ACLs   Also refer  https://community.cloudera.com/t5/Support-Questions/What-is-Dr-who-user-100s-of-yarn-jobs-are-getting-triggered/td-p/68026   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more