Created 11-26-2017 04:54 AM
Hi,
I am trying to deploy Apache Metron on a single node VM, but after vagrant up, when I run vagrant provision, it gives me errors on maven dependencies and ansible failed to setup successfully.
I have installed all packages defined for Metron deployment, Ansible 2.0.0.2, Vagrant 1.9.6, Maven 3.3.9, Virtual Box 5.1.30 JDK 1.8 and Python 2.7.5
Also, when I run the command "mvn clean package", metron-config error pops up and it doesnt complete its installation, followed by metron-rest, metron-rest client
Created 11-27-2017 10:05 AM
Hey @Gaurav Bapat, you need not run the mvn command every time. Just once should suffice. Also, if you have used the full-dev vagrant deployment, you need not have to do anything with Ambari UI (or the Step 3 screenshot) you have pasted.
So, let me paraphrase the steps for you so that you can give this a try once more, afresh. Let me know how it goes.
Assumption: Say your metron folder is located at: /user/gaurav/metron
* Run the following commands:
cd /user/gaurav/metron/metron-deployment/vagrant/full-dev-platform vagrant destroy -f
* The above destroy command would terminate and delete the existing running VM. You can also run 'VirtualBox' command to launch the application console, and can delete any other stray VMs that are not required.
* Run the following commands:
cd /user/gaurav/metron mvn clean compile -DskipTests
* The above command will take about 10 mins or so to complete, and should end with a "SUCCESS" message
* Run the following commands:
cd /user/gaurav/metron/metron-deployment/vagrant/full-dev-platform vagrant up
* The above command will take about 45 mins to over an hour to complete. I would recommend that you disable auto-sleep of the system in case it is enabled.
At the end of the step 2 above, you should be able to see a message saying that the deployment completed successfully.
Created 11-29-2017 07:58 AM
Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?
Cant get Metron-parsers up?
Created 11-30-2017 08:02 AM
I am facing this issue, please help.. Also I have to always do vagrant up as I am getting cannot connect to ambari-server error!!
Caused by: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [node1]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?
Created 11-30-2017 10:21 AM
Hey
@Gaurav Bapat, looks like a resource issue to me. Can you vagrant ssh
into the box and see if ambari-server is running using the command ambari-server status
? If it is running, then from browser launch Ambari UI http://node1:8080 and you will be able to see the different service status. If many of the services are showing as red or not running, then it is apparent that you might be hitting the system limits.
I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.
Created on 11-30-2017 10:25 AM - edited 08-17-2019 10:01 PM
My metron is going down frequently and I am not able to add services as it is showing red.
Also, when I do vagrant ssh it is showing ambari-server running but when I type node1:8080 and admin/admin, it is giving me ambari-server not up error. Then again I have to do all mvn clean compile and vagrant up which takes 3 hours to complete
Created 11-30-2017 10:29 AM
I would suggest that you try to find a machine with higher CPU and RAM (13 GB might not be sufficient) so that there is no resource constraints.
Created 11-30-2017 10:43 AM
And how save this configuration as, when I shutdown this VM it is giving me ambari-sever error when I enter admin/admin
Created 11-30-2017 11:01 AM
You will have to discard the existing VM and build another afresh on the new system with higher system configuration.
Created on 11-30-2017 11:21 AM - edited 08-17-2019 10:01 PM
Created 11-30-2017 12:59 PM
@Gaurav Bapat is this on the new setup with increased RAM ?
Created 12-01-2017 05:07 AM
No, current system config is i5 (4 Cores) and 13 GB RAM for VM
What is the recommended system requirements?
Created 12-01-2017 08:38 AM
I would recommend increasing to 16 GB RAM since you seem to be having issues with 13 GB.
Created on 12-01-2017 03:54 AM - edited 08-17-2019 10:00 PM
Created 12-04-2017 04:05 AM
How do I configure Apache NiFi in ambari ? I cant find the option of NiFi
Created on 12-04-2017 09:09 AM - edited 08-17-2019 10:00 PM
How do I solve this errors??
My services go down and when I restart them they fail to go up
A
Created 12-04-2017 10:07 AM
When I restarted my VM, same errors are popping up, like - mvn dependencies, do I need to enter mvn clean packages -Dskiptests everytime and which is the best directory for the same?
Also I am attaching step 3, please let me know how to setup SSH private key?
Created on 12-04-2017 11:30 AM - edited 08-17-2019 10:00 PM
I checked the logs and it seems there is a SSL connection error, please help me with the steps for the same??
Created on 12-06-2017 03:08 AM - edited 08-17-2019 10:00 PM
I have got these two logs of ambari-agent and ambari-server, please help with the steps to fix the problem.
Also, I am losing heartbeats on all components , what might be the issue ??
Created on 12-06-2017 03:28 AM - edited 08-17-2019 10:00 PM
Created 12-15-2017 12:07 PM
SELinux is preventing /usr/bin/install from read access
Also there is TLS handshake error and connection refused error on my Hbase&Metron component