Trying to deploy Apache Metron on single node VM, but Ansible and maven dependency failures, please help I am stuck

[#1]

Hi,

I am trying to deploy Apache Metron on a single node VM, but after vagrant up, when I run vagrant provision, it gives me errors on maven dependencies and ansible failed to setup successfully.

I have installed all packages defined for Metron deployment, Ansible 2.0.0.2, Vagrant 1.9.6, Maven 3.3.9, Virtual Box 5.1.30 JDK 1.8 and Python 2.7.5

Also, when I run the command "mvn clean package", metron-config error pops up and it doesnt complete its installation, followed by metron-rest, metron-rest client

[#2]

@asubramanian

Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?

Cant get Metron-parsers up?

[#3]

@asubramanian

I am facing this issue, please help.. Also I have to always do vagrant up as I am getting cannot connect to ambari-server error!!

Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?

[#4]

Hey @Gaurav Bapat, looks like a resource issue to me. Can you vagrant ssh into the box and see if ambari-server is running using the command ambari-server status ? If it is running, then from browser launch Ambari UI http://node1:8080 and you will be able to see the different service status. If many of the services are showing as red or not running, then it is apparent that you might be hitting the system limits.

I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.

[#5]

@asubramanian

My metron is going down frequently and I am not able to add services as it is showing red.

Also, when I do vagrant ssh it is showing ambari-server running but when I type node1:8080 and admin/admin, it is giving me ambari-server not up error. Then again I have to do all mvn clean compile and vagrant up which takes 3 hours to complete

[#6]

I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.

[#7]

@asubramanian

And how save this configuration as, when I shutdown this VM it is giving me ambari-sever error when I enter admin/admin

[#8]

You will have to discard the existing VM and build another afresh on the new system with higher system configuration.

[#9]

@asubramanian

I lost all the service and I have the error heartbeat lost

[#10]

@Gaurav Bapat is this on the new setup with increased RAM ?

[#11]

No, current system config is i5 (4 Cores) and 13 GB RAM for VM

What is the recommended system requirements?

[#12]

I would recommend increasing to 16 GB RAM since you seem to be having issues with 13 GB.

[#13]

@asubramanian

Why am I facing heartbeat issue over all services??

[#14]

@asubramanian

How do I configure Apache NiFi in ambari ? I cant find the option of NiFi

[#15]

@asubramanian

How do I solve this errors??

My services go down and when I restart them they fail to go up

A

[#16]

software

When I restarted my VM, same errors are popping up, like - mvn dependencies, do I need to enter mvn clean packages -Dskiptests everytime and which is the best directory for the same?

Also I am attaching step 3, please let me know how to setup SSH private key?

[#17]

@asubramanian

I checked the logs and it seems there is a SSL connection error, please help me with the steps for the same??

[#18]

@asubramanian

I have got these two logs of ambari-agent and ambari-server, please help with the steps to fix the problem.

Also, I am losing heartbeats on all components , what might be the issue ??

[#19]

@asubramanian

From where do I download stable Metron Directory?

[#20]

@asubramanian

SELinux is preventing /usr/bin/install from read access

Also there is TLS handshake error and connection refused error on my Hbase&Metron component