About this article The Metron tutorial article for adding Squid telemetry walks through the process of creating the parser from scratch for Elasticsearch as the Indexing service. This article gives details of extending the tutorial for getting Squid telemetry working with Solr as the backend Indexing service. In other words, these steps are an equivalent of "Installing Squid parser template" for the Elasticsearch. Pre-requisites HCP >= 1.5.0.0 HDP search >= 3.0.0 It is assumed that you have deployed a HCP stack with Solr by following the HCP documentation The Solr node is co-located with the Metron node. In the event that these nodes are on different hosts, ensure that you copy the Metron schema files located at $METRON_HOME/config/schema to the Solr node. It is also assumed that you have followed the Metron tutorial for Squid telemtry by installing the squid sensor, creating the kafka topic and have started the storm topology Steps 1. SSH to the Metron host and run the following commands cd $METRON_HOME/config/schema mkdir squid cd squid Copy the attached files (schema.xml and solrconfig,xml) into the 'squid' folder created above. 2. Run the following commands on the Metron host to create a Solr collection for Squid export SOLR_HOME=/opt/lucidworks-hdpsearch/solr/ export SOLR_USER=solr su $SOLR_USER -c "$SOLR_HOME/bin/solr create -c squid -d $METRON_HOME/config/schema/squid/" 3. Go to the Solr UI at http://<solr-host>:8983/solr/#/~collections to confirm that the Squid collection is present 4. Ingest events into the 'squid' kafka topic and you should see documents being written into the Squid collection in Solr. 5. Fire up Alerts UI and verify that Squid events are seen. ... View more

Problem On some of the HCP deployments, the Indexing topology might show up as "stopped, while the actual topology might be running (when you check in Storm UI). Additionally, one might also see the following kind of error messages in ambari-agent,log. INFO 2018-02-05 22:21:39,990 PythonReflectiveExecutor.py:67 - Reflective command failed with exception: Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", line 59, in run_file imp.load_source('__main__', script) File "/var/lib/ambari-agent/cache/common-services/METRON/0.4.3/package/scripts/indexing_master.py", line 18, in <module> import requests File "/usr/lib/python2.6/site-packages/requests/__init__.py", line 53, in <module> from .packages.urllib3.contrib import pyopenssl File "/usr/lib/python2.6/site-packages/requests/packages/__init__.py", line 61, in load_module if name in sys.modules: AttributeError: 'NoneType' object has no attribute 'modules' Reasoning If the above symptoms are true, you are most likely seeing METRON-1451 Solution Install version 2.61. of python-requests on the server pip install requests==2.6.1 Restart the Indexing topology to resolve the issue. ... View more