Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

metron singlenode vagrant installation ERROR

Solved Go to solution
Highlighted

metron singlenode vagrant installation ERROR

Contributor

My single node vagrant based installation is failing at elasticsearch start stage. Could you guys help me out with some troubleshooting

TASK [elasticsearch : Install Elasticsearch.] **********************************

changed: [node1]
TASK [elasticsearch : Create Data Directories] *********************************
changed: [node1] => (item=/data1/elasticsearch)
changed: [node1] => (item=/data2/elasticsearch)
TASK [elasticsearch : Configure Elasticsearch.] ********************************
changed: [node1] => (item={u'regexp': u'#cluster\\.name', u'line': u'cluster.name: metron'})
changed: [node1] => (item={u'regexp': u'#network\\.host:', u'line': u'network.host: _eth1:ipv4_'})
changed: [node1] => (item={u'regexp': u'#discovery\\.zen\\.ping\\.unicast\\.hosts', u'line': u'discovery.zen.ping.unicast.hosts: [ node1 ]'})
changed: [node1] => (item={u'regexp': u'#path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'})
TASK [elasticsearch : Start Elasticsearch.] ************************************
changed: [node1]
TASK [elasticsearch : include] *************************************************
included: /Users/<user>/BigData/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml for node1
TASK [elasticsearch : Wait for Elasticsearch Host to Start] ********************
ok: [node1]
TASK [elasticsearch : Wait for Green Index Status] *****************************
fatal: [node1]: FAILED! => {"failed": true, "msg": "ERROR! The conditional check 'result.content.find(\"green\") != -1' failed. The error was: ERROR! error while evaluating conditional (result.content.find(\"green\") != -1): ERROR! 'dict object' has no attribute 'content'"}
PLAY RECAP *********************************************************************
node1                      : ok=94   changed=38   unreachable=0    failed=1   
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again
Engineer
1 ACCEPTED SOLUTION

Accepted Solutions

Re: metron singlenode vagrant installation ERROR

New Contributor

Hi Sai,

I've had the same error message with a Ubuntu 14.04 host system. I'm yet to get it fully working but here's my progress so far. I'm thinking it may be a resolver / route issue, but haven't looked into it enough.

For the error message above, I edited the ansible script in incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml to use the ip of the host. e.g. http://192.168.66.121:9200/.

This needed to be done for 'Wait for Green Index Status' and the task below it.

After this change, the install seemed to complete successfully, however kibana was turning up blank.

This was resolved by:

1) edit the elasticsearch parameter at /usr/metron/0.1BETA/metron-ui/lib/public/config.js to be elasticsearch: 'http://<ip>:9200',

2) add the following to /etc/elasticsearch/elasticsearch.yml

http.cors.allow-origin: "/.*/"

http.cors.enabled: true

3) restart elasticsearch /etc/init.d/elasticsearch restart

At this stage, I am seeing the pcaps traversing through storm, however am getting getting errors in the enrichment topology forwarding the data to elasticsearch. I'm still looking into this.

Hope this helps,

Ryan

7 REPLIES 7

Re: metron singlenode vagrant installation ERROR

Rising Star

Hi Sai,

Can you tell me what version of Metron, Ansible, Python and Vagrant you are running?

Thanks!

-D...

Re: metron singlenode vagrant installation ERROR

Rising Star

You can also simply paste the output of `metron-deployment/scripts/platform-info.sh`. That should give us a good understanding of your environment.

Re: metron singlenode vagrant installation ERROR

Contributor

Re: metron singlenode vagrant installation ERROR

Contributor

@nallen and @David Lyle : Here are the versions:

Metron 0.1BETA
--
* master
--
commit 739e2eb523dd6b4daeeccd3bab5a4a614ace8328
Author: dlyle65535 <dlyle65535@gmail.com>
Date:   Tue Jun 14 15:35:15 2016 -0400


    METRON-212: Allow additional Elasticsearch templates to be loaded to the index (dlyle65535 via cestella) closes apache/incubator-metron#145
--
 metron-deployment/roles/metron_elasticsearch_templates/tasks/load_templates.yml | 1 +
 1 file changed, 1 insertion(+)
--
ansible 2.0.0.2
  config file =
  configured module search path = Default w/o overrides
--
Vagrant 1.8.4
--
Python 2.7.10
--
Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06; 2015-04-22T04:57:37-07:00)
Maven home: /usr/local/Cellar/maven/3.3.3/libexec
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.4", arch: "x86_64", family: "mac"
--
Darwin Venkatas-MacBook-Pro.local 15.4.0 Darwin Kernel Version 15.4.0: Fri Feb 26 22:08:05 PST 2016; root:xnu-3248.40.184~3/RELEASE_X86_64 x86_64
Engineer

Re: metron singlenode vagrant installation ERROR

New Contributor

Hi Sai,

I've had the same error message with a Ubuntu 14.04 host system. I'm yet to get it fully working but here's my progress so far. I'm thinking it may be a resolver / route issue, but haven't looked into it enough.

For the error message above, I edited the ansible script in incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml to use the ip of the host. e.g. http://192.168.66.121:9200/.

This needed to be done for 'Wait for Green Index Status' and the task below it.

After this change, the install seemed to complete successfully, however kibana was turning up blank.

This was resolved by:

1) edit the elasticsearch parameter at /usr/metron/0.1BETA/metron-ui/lib/public/config.js to be elasticsearch: 'http://<ip>:9200',

2) add the following to /etc/elasticsearch/elasticsearch.yml

http.cors.allow-origin: "/.*/"

http.cors.enabled: true

3) restart elasticsearch /etc/init.d/elasticsearch restart

At this stage, I am seeing the pcaps traversing through storm, however am getting getting errors in the enrichment topology forwarding the data to elasticsearch. I'm still looking into this.

Hope this helps,

Ryan

Re: metron singlenode vagrant installation ERROR

Contributor

@Ryan Platt Thank you for the help. Your suggested fixes worked. Kibana dasboard is up with Green status

6267-screenshot-2016-08-01-213819.png

But now I am clueless where look for data ingestions. pcap or netflow. Could you help me with next steps, please

Engineer

Re: metron singlenode vagrant installation ERROR

New Contributor

Hi Ryan, came across this post as I ran into similar issue as above installing metron and tried your steps to resolve. Im now also stuck with a blank Kibana screen but can't or don't seem to have a file "/etc/elasticsearch/elasticsearch.yml" to add the 2 parameters you're suggesting.

From the installation steps i can see elasticsearch has been installed and started correctly.

Any idea how to resolve, what i could be missing?

thx