Member since
06-10-2014
10
Posts
13
Kudos Received
0
Solutions
07-25-2018
10:19 AM
You can find HAProxy configs for the Big Data ecosystem and other open source technologies on GitHub: https://github.com/HariSekhon/haproxy-configs
... View more
09-08-2017
09:36 AM
Oh Jonas that is excellent, thanks very much for the link, I've starred your repo and am going to put links to it on my PyTools and Tools repos which have a whole selection of related Hadoop tools as I think people would be interested in that.
... View more
09-08-2017
09:19 AM
1 Kudo
Thanks Vladimir! I liked this so much I created a contrib folder in my Perl tools repo to save it. You can find similarly useful tools for Hadoop, HBase, Hive, Ambari etc there in adjacent repos: https://github.com/HariSekhon/tools (Perl, this is where I copied this script, there is also stuff for HDFS file and snapshots age out, Ambari FreeIPA automation, Hive SQL recaser etc) https://github.com/HariSekhon/pytools (lots of PySpark, HDFS and HBase code here as well as Ambari Blueprint CLI tool, data validators and converters) https://github.com/HariSekhon/nagios-plugins (350+ enterprise monitoring plugins for most of the Hadoop ecosystem, including integration to Ambari for everything it monitors too, plus NoSQL datastores, message queues, CI and infrastructure)
... View more
08-24-2017
01:08 PM
Asif the links to Nagios documentation is near the bottom of the README and the plugins all come with --help and work like every other nagios plugin from the original nagios plugins package. You generally just have to read the documentation description and command line switches from --help.
... View more
09-27-2016
07:41 PM
1 Kudo
I've actually already published Nagios Plugins that integrate with the Ambari API which can retrieve the service & host states, health, alerts, even detect stale configs. You can just run them as is using the option switches in any normal open source monitoring platform that supports nagios plugins, see here: https://github.com/harisekhon/nagios-plugins If you want to proactively trigger service checks as well you can also use the tool I wrote specifically for that which I mentioned in the other comment on this page.
... View more
09-27-2016
06:23 PM
1 Kudo
I've published a CLI tool to handle all of this more easily including auto-generating the payload, inferring the cluster name and services to check etc. It has --help with lots of options, including features for --wait which tracks the progress status of the request and returns only when complete, and --cancel to stop any outstanding service checks if you accidentally launch too many by playing with the tool 🙂 You can find it on my github here: https://github.com/harisekhon/pytools ./ambari_trigger_service_checks.py --help examples: ./ambari_trigger_service_checks.py --all ./ambari_trigger_service_checks.py --cancel ./ambari_trigger_service_checks.py --services hdfs,yarn --wait
... View more
09-27-2016
06:20 PM
1 Kudo
I've published a CLI tool to handle all of this more easily including auto-generating the payload, inferring the cluster name and services to check etc. It has --help with lots of options, including features for --wait which tracks the progress status of the request and returns only when complete, and --cancel to stop any outstanding service checks if you accidentally launch too many by playing with the tool 🙂 You can find it on my github here: https://github.com/harisekhon/pytools ./ambari_trigger_service_checks.py --help examples: ./ambari_trigger_service_checks.py --all ./ambari_trigger_service_checks.py --cancel ./ambari_trigger_service_checks.py --services hdfs,yarn --wait
... View more
12-17-2015
04:22 PM
5 Kudos
Repo Description ambari_blueprints.py - Ambari Blueprint tool using Ambari API hadoop_hdfs_time_block_reads.jy - Hadoop HDFS per-block read timing debugger hadoop_hdfs_files_native_checksums.jy - fetches native HDFS checksums via API hadoop_hdfs_files_stats.jy - fetches HDFS file stats via API pig-text-to-elasticsearch.pig / pig-text-to-solr.pig - bulk indexes unstructured files in Hadoop to Elasticsearch or Solr/SolrCloud clusters, Pig Jython UDFs ipython-notebook-pyspark.py - per-user authenticated IPython Notebook + PySpark integration spark-json-to-parquet.py Repo Info Github Repo URL https://github.com/harisekhon/pytools Github account name harisekhon Repo name pytools
... View more
12-17-2015
04:22 PM
3 Kudos
Repo DescriptionVarious Utilities including: Ambari FreeIPA principal deployment automation Hive => Elasticsearch indexer Solr CLI HDFS file & snapshot age out scripts Hadoop config differ from live running services or xml files Hive SQL recaser and other utils Scrub config / log anonymizer for posting to forums / Apache Jira tickets Repo Info Github Repo URL https://github.com/harisekhon/tools Github account name harisekhon Repo name tools
... View more
Labels:
12-17-2015
04:22 PM
1 Kudo
Repo Description check_ambari_*.pl - Hadoop cluster checks via Ambari API - checks the service status, node(s) status, stale configs, cluster alerts summary, host alerts summary, cluster health report, kerberos enabled, cluster version, service config compatible with stack and cluster check_hadoop_*.pl - various Apache Hadoop monitoring utilities for various components check_hbase_*.pl - various HBase monitoring utilities check_zookeeper*.pl - ZooKeeper server and znode checks Repo Info Github Repo URL https://github.com/harisekhon/nagios-plugins Github account name harisekhon Repo name nagios-plugins
... View more
Labels: