You can find HAProxy configs for the Big Data ecosystem and other open source technologies on GitHub: https://github.com/HariSekhon/haproxy-configs ... View more

Oh Jonas that is excellent, thanks very much for the link, I've starred your repo and am going to put links to it on my PyTools and Tools repos which have a whole selection of related Hadoop tools as I think people would be interested in that. ... View more

Thanks Vladimir! I liked this so much I created a contrib folder in my Perl tools repo to save it. You can find similarly useful tools for Hadoop, HBase, Hive, Ambari etc there in adjacent repos: https://github.com/HariSekhon/tools (Perl, this is where I copied this script, there is also stuff for HDFS file and snapshots age out, Ambari FreeIPA automation, Hive SQL recaser etc) https://github.com/HariSekhon/pytools (lots of PySpark, HDFS and HBase code here as well as Ambari Blueprint CLI tool, data validators and converters) https://github.com/HariSekhon/nagios-plugins (350+ enterprise monitoring plugins for most of the Hadoop ecosystem, including integration to Ambari for everything it monitors too, plus NoSQL datastores, message queues, CI and infrastructure) ... View more

I've actually already published Nagios Plugins that integrate with the Ambari API which can retrieve the service & host states, health, alerts, even detect stale configs. You can just run them as is using the option switches in any normal open source monitoring platform that supports nagios plugins, see here: https://github.com/harisekhon/nagios-plugins If you want to proactively trigger service checks as well you can also use the tool I wrote specifically for that which I mentioned in the other comment on this page. ... View more

I've published a CLI tool to handle all of this more easily including auto-generating the payload, inferring the cluster name and services to check etc. It has --help with lots of options, including features for --wait which tracks the progress status of the request and returns only when complete, and --cancel to stop any outstanding service checks if you accidentally launch too many by playing with the tool 🙂 You can find it on my github here: https://github.com/harisekhon/pytools ./ambari_trigger_service_checks.py --help examples: ./ambari_trigger_service_checks.py --all ./ambari_trigger_service_checks.py --cancel ./ambari_trigger_service_checks.py --services hdfs,yarn --wait ... View more

I've published a CLI tool to handle all of this more easily including auto-generating the payload, inferring the cluster name and services to check etc. It has --help with lots of options, including features for --wait which tracks the progress status of the request and returns only when complete, and --cancel to stop any outstanding service checks if you accidentally launch too many by playing with the tool 🙂 You can find it on my github here: https://github.com/harisekhon/pytools ./ambari_trigger_service_checks.py --help examples: ./ambari_trigger_service_checks.py --all ./ambari_trigger_service_checks.py --cancel ./ambari_trigger_service_checks.py --services hdfs,yarn --wait ... View more