Hi zain52,   Please review this example:   https://github.com/cloudera/cdh-twitter-example ... View more

Hello @obar1,     Here is a similar forum topic:   https://community.cloudera.com/t5/Hadoop-101-Training-Quickstart/Not-able-to-access-HDFS-getting-Connection-exception/td-p/28302   Gabor     ... View more

Hello @npdell,   Cloudera Manager trigger is what you need. You can create it at here:   CM --> YARN --> Status --> Create trigger --> Edit manually   Examples:   1) It will alert if there are more than 50 applications in pending state   Expression:   IF (select total_apps_pending_across_yarn_pools WHERE entityName=$SERVICENAME and LAST( total_apps_pending_across_yarn_pools) > 50) DO health:concerning   Metric Evaluation Window: 10 minutes   2) It will alert if more than 5 applications are failing   Expression:   IF (select total_apps_failed_rate_across_yarn_pools WHERE entityName=$SERVICENAME and LAST( total_apps_failed_rate_across_yarn_pools) > 5) DO health:concerning   Here is the documentation about CM triggers:   http://www.cloudera.com/documentation/enterprise/latest/topics/cm_dg_triggers.html   Gabor ... View more

Hello,   You can add as many gateways as you want. If you add a gateway outside of Cloudera Manager  then the only disadvantage is that you need to do every step manually. For example these:   installation of client configurations installation of client packages configuration of kerberos (/etc/krb5.conf) etc. Gabor ... View more

Hello,   You have to move the SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar to here:   /opt/cloudera/csd   and restart the Cloudera Manager with the following command:   service cloudera-scm-server restart     Here are the other steps:   https://www.cloudera.com/documentation/betas/spark2/latest/topics/spark2_installing.html   Best regards,         Gabor ... View more

Dear butkiz,   Please add the following property to the configuration block of the oozie spark action to give this more memory. <property>     <name>oozie.launcher.mapreduce.map.memory.mb</name>    <value>4096</value> </property> <property>   <name>mapreduce.map.memory.mb</name>   <value>4096</value> </property> <property>     <name>oozie.launcher.mapred.child.java.opts</name>     <value>-Xmx4096m</value> </property> ... View more