Trying to deploy Apache Metron on single node VM, but Ansible and maven dependency failures, please help I am stuck

[#1]

Hi,

I am trying to deploy Apache Metron on a single node VM, but after vagrant up, when I run vagrant provision, it gives me errors on maven dependencies and ansible failed to setup successfully.

I have installed all packages defined for Metron deployment, Ansible 2.0.0.2, Vagrant 1.9.6, Maven 3.3.9, Virtual Box 5.1.30 JDK 1.8 and Python 2.7.5

Also, when I run the command "mvn clean package", metron-config error pops up and it doesnt complete its installation, followed by metron-rest, metron-rest client

[#2]

@asubramanian

I am deploying Metron on i5 processor with 4 Cores VM and 13 GB RAM, is there a resource crunch still happening or I have not installed a package??

what is the last message that appears on the screen when I do vagrant up?

[#3]

@asubramanian

All Metron components were up, only metron parsers and indexing failed ..

Also I logged in with node1:4200 and 4201 and 5000 but was unable to open node1:2812

The error for metron parser was python scripts timeout after 900 seconds

Please suggest

[#4]

@asubramanian

Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?

Cant get Metron-parsers up?

[#5]

@asubramanian

I am facing this issue, please help.. Also I have to always do vagrant up as I am getting cannot connect to ambari-server error!!

Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?

[#6]

Hey @Gaurav Bapat, looks like a resource issue to me. Can you vagrant ssh into the box and see if ambari-server is running using the command ambari-server status ? If it is running, then from browser launch Ambari UI http://node1:8080 and you will be able to see the different service status. If many of the services are showing as red or not running, then it is apparent that you might be hitting the system limits.

I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.

[#7]

@asubramanian

My metron is going down frequently and I am not able to add services as it is showing red.

Also, when I do vagrant ssh it is showing ambari-server running but when I type node1:8080 and admin/admin, it is giving me ambari-server not up error. Then again I have to do all mvn clean compile and vagrant up which takes 3 hours to complete

[#8]

I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.

[#9]

@asubramanian

And how save this configuration as, when I shutdown this VM it is giving me ambari-sever error when I enter admin/admin

[#10]

You will have to discard the existing VM and build another afresh on the new system with higher system configuration.

[#11]

@asubramanian

I lost all the service and I have the error heartbeat lost