@akshay0103    Please check the Hue.ini content under field  [useradmin] if there are any non default permissions being used? Are you adding the user using create home directory permissions?   ... View more

@Mondi  Please refer below document which explains steps to configure jar for UDFs.  You can configure the cluster in one of several ways to find the JAR containing your UDF code, and then you register the UDF in Hive. https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_mc_hive_udf.html#xd_583c10bfdbd326ba--43d5fd93-1410993f8c2--7ea3   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@rmr1989    Ideally, for a missing mounts in the cluster you would automatically get alerts for services if any hadoop service directories cannot be accessed which are mapped to the mountpoint. They can be generic though like "no such file or directory" or "file not found" errors.   If you are looking for specific mountpoint availability, you should consider using script to scan for mountpoints in the cluster hosts and can send email alerts using SMTP from the host instead of Cloudera Manager.   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.           ... View more

@rmr1989    You can edit the expression manually to include the NOT operator. Check the below example which uses NOT operator for a trigger. A trigger expression takes the form: IF (CONDITIONS) DO HEALTH_ACTION   A condition is any valid tsquery statement with below syntax.  SELECT [metric expression]WHERE [predicate]   Mount point is an attribute which can be used in filter conditions but not metric expression. Hence, I believe it would not be possible to create a trigger on mount point scans.   Refer below document which lists the supported metrics: https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_metrics.html#xd_583c10bfdbd326ba--7f25092b-13fba2465e5--7e52   Example:   IF (SELECT total_xceivers_across_datanodes WHERE serviceName=$SERVICENAME AND last(total_xceivers_across_datanodes) != 0 AND entityName = "HDFS-1:ns1" AND category = "SERVICE") DO health:concerning   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@Prav    You can leverage CM API to track parcel distribution status: /api/v19/clusters/{clusterName}/parcels - This can be used to note the parcel name and version the cluster has access to   /api/v19/clusters/{clusterName}/parcels/products/{product}/versions/{version} - This can be used to track the parcel distribution status   Refer below link for more details http://cloudera.github.io/cm_api/apidocs/v19/path__clusters_-clusterName-_parcels_products_-product-_versions_-version-.html   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@rok    You can use the Cloudera Manager REST API to export and import all of its configuration data. The API exports a JSON document that contains configuration data for the Cloudera Manager instance. You can use this JSON document to back up and restore a Cloudera Manager deployment.   Refer below document for the steps: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_intro_api.html#concept_dnn_cr5_mr   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@sarm    Minimum heap size should be set to : 4 GB Increase the memory for higher replica counts or a higher number of blocks per DataNode. When increasing the memory, Cloudera recommends an additional 1 GB of memory for every 1 million replicas above 4 million on the DataNodes. For example, 5 million replicas require 5 GB of memory. Set this value using the   Java Heap Size of DataNode in Bytes   HDFS configuration property. Reference: https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_hardware_requirements.html#concept_fzz_dq4_gbb   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@SeanU    This level of detailed log scanning and alert functionality is not available. The existing service role logs for which rules can be set will not contain each application exceptions logged since detailed information is present in the application logs.    You can check the available job history server logs and resource manager logs available to check if the logged in information during application run time helps serve your purpose. ... View more

@Mondi    What are these properties set to in your yarn configurations? 'yarn.app.mapreduce.am.staging-dir' 'yarn.app.mapreduce.am.staging-dir'    Also, can you try running below query before your hive query and share results >  set hive.exec.scratchdir=/tmp/mydir;   Regards, Paras ... View more

@AnjaliRocks    Can you please share your workflow.xml to understand exactly how you are trying to execute the operations? What is the behaviour you observe when you run insert overwrite query from beeline?   You can use the below query to set the hive scratch directories to set the temporary output path. set hive.exec.scratchdir=/tmp/mydir; Let me know if this helps.   ... View more

@Mondi    You can set the hive scratch directories to modify the intermediate data storage location from default /tmp hive.exec.local.scratchdir-  Local Directory where Hive stores jars and data when performing a MapJoin optimization. If not specified, Hive uses a default location. hive.exec.scratchdir Directory in HDFS where Hive writes intermediate data between MapReduce jobs. If not specified, Hive uses a default location.   Refer https://docs.cloudera.com/documentation/enterprise/6/properties/6.3/topics/cm_props_cdh600_hive.html#concept_6.3.x_hiveserver2_props__section_advanced_props   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.   ... View more

@SeanU    You can select the role group for the YARN role for which you want to configure log events, or search for "Rules to Extract Events from Log Files". These generate the events for the service and you can set alerts for these log events. Alert publisher can be configured to generate emails for alerts.   Refer https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_dg_monitoring_settings.html#cmug_topic_4_12_4__section_vlc_qr3_dr   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Replied on the new thread ... View more

  @AnjaliRocks    You should consider clearing the user .Trash directory or consider increasing the disk space quota.   You can try changing the 'yarn.app.mapreduce.am.staging-dir' in YARN configuration. 'yarn.app.mapreduce.am.staging-dir' is the property used to set the root HDFS directory of the staging area for users' MR2 jobs. By default this is set /user. You can change this to a different location that doesn't have any quota. YARN staging directories will be created under the new path always named after the user.    ... View more

@AnjaliRocks    It seems there are issues is removing trash from the user folder for which disk space quota is enabled leading to errors exceeding quota. What is the spark version? The support for purge was added in Spark 2.0:    As a workaround you can alter table properties to enable auto purge. ALTER TABLE table_name SET TBLPROPERTIES('auto.purge'='TRUE');   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.   ... View more

@Morbious    Please check the Service Monitor Logs for getting details on impala query status. Yes, different timezone will impact the query visibility. If you see messages related to queries outside of acceptance window, please ensure that the timezone is same across all Impala daemons and CM.   If the same CM is managing 3 clusters, you should also consider increasing the SMON heap size and check if queries are visible. You should also see slow queries messages in the SMON logs.   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.       ... View more

@syedshakir    For existing DB, stop the hue service and alter the DB using below query:   ALTER DATABASE hue CHARACTER SET utf8 ; ALTER DATABASE hue COLLATE = 'utf8_general_ci';   Start the hue service.   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.     ... View more

@Tar    Are you looking for CDP installation guide?   Refer https://docs.cloudera.com/cloudera-manager/7.0.3/installation/topics/cdpdc-installation.html   Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more