Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Trying to deploy Apache Metron on single node VM, but Ansible and maven dependency failures, please help I am stuck

avatar
Explorer

Hi,

I am trying to deploy Apache Metron on a single node VM, but after vagrant up, when I run vagrant provision, it gives me errors on maven dependencies and ansible failed to setup successfully.

I have installed all packages defined for Metron deployment, Ansible 2.0.0.2, Vagrant 1.9.6, Maven 3.3.9, Virtual Box 5.1.30 JDK 1.8 and Python 2.7.5

Also, when I run the command "mvn clean package", metron-config error pops up and it doesnt complete its installation, followed by metron-rest, metron-rest client

1 ACCEPTED SOLUTION

avatar
Super Collaborator

Hey @Gaurav Bapat, you need not run the mvn command every time. Just once should suffice. Also, if you have used the full-dev vagrant deployment, you need not have to do anything with Ambari UI (or the Step 3 screenshot) you have pasted.

So, let me paraphrase the steps for you so that you can give this a try once more, afresh. Let me know how it goes.

Assumption: Say your metron folder is located at: /user/gaurav/metron

Step 0 - Cleanup all existing deployments:

* Run the following commands:

cd /user/gaurav/metron/metron-deployment/vagrant/full-dev-platform
vagrant destroy -f

* The above destroy command would terminate and delete the existing running VM. You can also run 'VirtualBox' command to launch the application console, and can delete any other stray VMs that are not required.

Step 1 - Compile metron

* Run the following commands:

cd /user/gaurav/metron
mvn clean compile -DskipTests

* The above command will take about 10 mins or so to complete, and should end with a "SUCCESS" message

Step 2 - Bring up metron VM

* Run the following commands:

cd /user/gaurav/metron/metron-deployment/vagrant/full-dev-platform
vagrant up

* The above command will take about 45 mins to over an hour to complete. I would recommend that you disable auto-sleep of the system in case it is enabled.

At the end of the step 2 above, you should be able to see a message saying that the deployment completed successfully.

View solution in original post

60 REPLIES 60

avatar
Explorer
@asubramanian

Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?

Cant get Metron-parsers up?

avatar
Explorer

@asubramanian

I am facing this issue, please help.. Also I have to always do vagrant up as I am getting cannot connect to ambari-server error!!

Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?

avatar
Super Collaborator

Hey @Gaurav Bapat, looks like a resource issue to me. Can you vagrant ssh into the box and see if ambari-server is running using the command ambari-server status ? If it is running, then from browser launch Ambari UI http://node1:8080 and you will be able to see the different service status. If many of the services are showing as red or not running, then it is apparent that you might be hitting the system limits.

I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.

avatar
Explorer
@asubramanian

My metron is going down frequently and I am not able to add services as it is showing red.

Also, when I do vagrant ssh it is showing ambari-server running but when I type node1:8080 and admin/admin, it is giving me ambari-server not up error. Then again I have to do all mvn clean compile and vagrant up which takes 3 hours to complete43771-capture67.jpg

avatar
Super Collaborator

I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.

avatar
Explorer

@asubramanian

And how save this configuration as, when I shutdown this VM it is giving me ambari-sever error when I enter admin/admin

avatar
Super Collaborator

You will have to discard the existing VM and build another afresh on the new system with higher system configuration.

avatar
Explorer

@asubramanian

I lost all the service and I have the error heartbeat lost

43772-capture68.jpg

avatar
Super Collaborator

@Gaurav Bapat is this on the new setup with increased RAM ?

avatar
Explorer

No, current system config is i5 (4 Cores) and 13 GB RAM for VM

What is the recommended system requirements?

avatar
Super Collaborator

I would recommend increasing to 16 GB RAM since you seem to be having issues with 13 GB.

avatar
Explorer

@asubramanian

Why am I facing heartbeat issue over all services??

43778-capture69.jpg

avatar
Explorer
@asubramanian

How do I configure Apache NiFi in ambari ? I cant find the option of NiFi

avatar
Explorer

@asubramanian

How do I solve this errors??

43805-capture73.jpgMy services go down and when I restart them they fail to go up

A

avatar
New Contributor

software

When I restarted my VM, same errors are popping up, like - mvn dependencies, do I need to enter mvn clean packages -Dskiptests everytime and which is the best directory for the same?

Also I am attaching step 3, please let me know how to setup SSH private key?

avatar
Explorer
@asubramanian

43810-capture74.jpg

I checked the logs and it seems there is a SSL connection error, please help me with the steps for the same??

avatar
Explorer
@asubramanian

43832-capture83.jpg

43833-capture84.jpg

I have got these two logs of ambari-agent and ambari-server, please help with the steps to fix the problem.

43834-capture68.jpg

Also, I am losing heartbeats on all components , what might be the issue ??

avatar
Explorer

@asubramanian

43835-capture85.jpg

From where do I download stable Metron Directory?

avatar
Explorer

@asubramanian

SELinux is preventing /usr/bin/install from read access

Also there is TLS handshake error and connection refused error on my Hbase&Metron component

Labels