Hello,   Can it be possible to set the alerts for long running jobs?   Thank you Bhanu ... View more

Hi, Michalis I hit the same situation with non residential gateway host. In my case, the script told, Service: [HDFS] contains role type [GATEWAY] - configuration [key: role_config_suppression_cdh_version_validator - value: true] Affected instance hostname: cdh-host-x // ipAddress: 10.x.x.x Service: [YARN] contains role type [GATEWAY] - configuration [key: role_config_suppression_cdh_version_validator - value: true] Affected instance hostname: cdh-host-x // ipAddress: 10.x.x.x Service: [HBASE] contains role type [GATEWAY] - configuration [key: role_config_suppression_cdh_version_validator - value: true] Affected instance hostname: cdh-host-x // ipAddress: 10.x.x.x Service: [HIVE] contains role type [GATEWAY] - configuration [key: role_config_suppression_cdh_version_validator - value: true] Affected instance hostname: cdh-host-x // ipAddress: 10.x.x.x Service: [SPARK2_ON_YARN] contains role type [GATEWAY] - configuration [key: role_config_suppression_cdh_version_validator - value: true] Affected instance hostname: cdh-host-x // ipAddress: 10.x.x.x I once removed the host mentioned from the cluster and cloudera manager.   At this point, mgmt service began working as ordinary. Then, re-added and applied host template to deploy cdh components again. After fixing package deployment, I ran the script above again that showed no list 🙂 Thanks a lot. ... View more

One quick solution is to add application host to cluster and give (only) HDFS Gateway role to it. Then you can use NameNode Nameservice name as uri e.g. hdfs://nameservice1/. This could be done with CM. https://www.cloudera.com/documentation/enterprise/5-9-x/topics/cm_mc_adding_hosts.html https://www.cloudera.com/documentation/enterprise/5-9-x/topics/cm_mc_managing_roles.html Pros: - Can manage configuration centrally. Cons: - Host goes under CM management i.e. get monitored by agent, be capable of getting assigned other roles and so on. - Files are distributed e.g. under /opt/cloudera which consume disk space (take log space into consideration also). - Some ports - 9000 and 9001 are used by agent. These might cross administrative boundary that please carefully consider and make a plan beforehand. ... View more

I noticed that from monitoring alert list, I can set Free Space Monitoring Percentage Thresholds.   I couldn't find other path to these setting though.   It may help if made clear where those adjustables are exposed I think. ... View more

Thanks a lot. I have encountered the same problem while upgrading from CDH5.10.0 to CDH5.11.0. Management services (including Navigator) where not able to start. I have followed your instructions and after restart of cloudera agent, the mgmt services were able to start. ... View more