question Re: metron singlenode vagrant installation ERROR in Support Questions

metron singlenode vagrant installation ERROR

vganji — Thu, 16 Jun 2016 02:43:26 GMT

My single node vagrant based installation is failing at elasticsearch start stage. Could you guys help me out with some troubleshooting

TASK [elasticsearch : Install Elasticsearch.] **********************************

changed: [node1]
TASK [elasticsearch : Create Data Directories] *********************************
changed: [node1] => (item=/data1/elasticsearch)
changed: [node1] => (item=/data2/elasticsearch)
TASK [elasticsearch : Configure Elasticsearch.] ********************************
changed: [node1] => (item={u'regexp': u'#cluster\\.name', u'line': u'cluster.name: metron'})
changed: [node1] => (item={u'regexp': u'#network\\.host:', u'line': u'network.host: _eth1:ipv4_'})
changed: [node1] => (item={u'regexp': u'#discovery\\.zen\\.ping\\.unicast\\.hosts', u'line': u'discovery.zen.ping.unicast.hosts: [ node1 ]'})
changed: [node1] => (item={u'regexp': u'#path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'})
TASK [elasticsearch : Start Elasticsearch.] ************************************
changed: [node1]
TASK [elasticsearch : include] *************************************************
included: /Users/<user>/BigData/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml for node1
TASK [elasticsearch : Wait for Elasticsearch Host to Start] ********************
ok: [node1]
TASK [elasticsearch : Wait for Green Index Status] *****************************
fatal: [node1]: FAILED! => {"failed": true, "msg": "ERROR! The conditional check 'result.content.find(\"green\") != -1' failed. The error was: ERROR! error while evaluating conditional (result.content.find(\"green\") != -1): ERROR! 'dict object' has no attribute 'content'"}
PLAY RECAP *********************************************************************
node1                      : ok=94   changed=38   unreachable=0    failed=1   
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again

Re: metron singlenode vagrant installation ERROR

dlyle — Thu, 16 Jun 2016 21:33:48 GMT

Hi Sai,

Can you tell me what version of Metron, Ansible, Python and Vagrant you are running?

Thanks!

-D...

Re: metron singlenode vagrant installation ERROR

nallen — Fri, 17 Jun 2016 06:21:25 GMT

You can also simply paste the output of `metron-deployment/scripts/platform-info.sh`. That should give us a good understanding of your environment.

Re: metron singlenode vagrant installation ERROR

vganji — Tue, 21 Jun 2016 02:49:15 GMT

@nallen and @David Lyle : Here are the versions:

Metron 0.1BETA
--
* master
--
commit 739e2eb523dd6b4daeeccd3bab5a4a614ace8328
Author: dlyle65535 <dlyle65535@gmail.com>
Date:   Tue Jun 14 15:35:15 2016 -0400


    METRON-212: Allow additional Elasticsearch templates to be loaded to the index (dlyle65535 via cestella) closes apache/incubator-metron#145
--
 metron-deployment/roles/metron_elasticsearch_templates/tasks/load_templates.yml | 1 +
 1 file changed, 1 insertion(+)
--
ansible 2.0.0.2
  config file =
  configured module search path = Default w/o overrides
--
Vagrant 1.8.4
--
Python 2.7.10
--
Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06; 2015-04-22T04:57:37-07:00)
Maven home: /usr/local/Cellar/maven/3.3.3/libexec
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.4", arch: "x86_64", family: "mac"
--
Darwin Venkatas-MacBook-Pro.local 15.4.0 Darwin Kernel Version 15.4.0: Fri Feb 26 22:08:05 PST 2016; root:xnu-3248.40.184~3/RELEASE_X86_64 x86_64

Re: metron singlenode vagrant installation ERROR

ryan_platt — Mon, 27 Jun 2016 08:45:37 GMT

Hi Sai,

I've had the same error message with a Ubuntu 14.04 host system. I'm yet to get it fully working but here's my progress so far. I'm thinking it may be a resolver / route issue, but haven't looked into it enough.

For the error message above, I edited the ansible script in incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml to use the ip of the host. e.g. http://192.168.66.121:9200/.

This needed to be done for 'Wait for Green Index Status' and the task below it.

After this change, the install seemed to complete successfully, however kibana was turning up blank.

This was resolved by:

1) edit the elasticsearch parameter at /usr/metron/0.1BETA/metron-ui/lib/public/config.js to be elasticsearch: 'http://<ip>:9200',

2) add the following to /etc/elasticsearch/elasticsearch.yml

http.cors.allow-origin: "/.*/"

http.cors.enabled: true

3) restart elasticsearch /etc/init.d/elasticsearch restart

At this stage, I am seeing the pcaps traversing through storm, however am getting getting errors in the enrichment topology forwarding the data to elasticsearch. I'm still looking into this.

Hope this helps,

Ryan

Re: metron singlenode vagrant installation ERROR

vganji — Mon, 19 Aug 2019 08:15:11 GMT

@Ryan Platt Thank you for the help. Your suggested fixes worked. Kibana dasboard is up with Green status

But now I am clueless where look for data ingestions. pcap or netflow. Could you help me with next steps, please

Re: metron singlenode vagrant installation ERROR

vganji — Thu, 04 Aug 2016 15:19:45 GMT

Hello @nallen: Could you hep me with this question: https://community.hortonworks.com/questions/49823/need-instructions-to-start-data-ingest-on-metron.html

Re: metron singlenode vagrant installation ERROR

kpaul — Fri, 20 Jan 2017 10:51:09 GMT

Hi Ryan, came across this post as I ran into similar issue as above installing metron and tried your steps to resolve. Im now also stuck with a blank Kibana screen but can't or don't seem to have a file "/etc/elasticsearch/elasticsearch.yml" to add the 2 parameters you're suggesting.

From the installation steps i can see elasticsearch has been installed and started correctly.

Any idea how to resolve, what i could be missing?

thx