Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Metron vagrant start hadoop services faiing

Solved Go to solution
Highlighted

Re: Metron vagrant start hadoop services faiing

Explorer

Not an answer, but I noticed the exception in these logs is the same as https://community.hortonworks.com/questions/19734/hortonworks-2-ambari-unable-to-log-on-to-ambari-ui...

Highlighted

Re: Metron vagrant start hadoop services faiing

Super Guru

@lgeorge could you please provide details of how you fixed the issue so it could help others as well. I am using a macbook pro so i believe I have enough resources to bring up a vm.

Highlighted

Re: Metron vagrant start hadoop services faiing

Expert Contributor

@Sunile Manjee, sure. My approach is more of a workaround than a solution, but I'll do my best to describe it here.

I followed these steps while the VM was still running with Ambari and HDP deployed (the point at which the error occurred).

  1. Make a backup copy of the Vagrantfile in incubator-metron-Metron_0.1BETA_rc7/deployment/vagrant/singlenode-vagrant/
  2. Edit Vagrantfile so that ansible uses the metron_install.yml file instead of the metron_full_install.yml file:

    Near the end of the file, change the line with ansible.playbook = "../../playbooks/metron_full_install.yml"

    to

    ansible.playbook = "../../playbooks/metron_install.yml"

    Then save your changes.

  3. From the deployment/vagrant/singlenode-vagrant directory, issue the following command:

    vagrant provision

    (If the VM is stopped/halted you'd probably want to use vagrant up instead. It shouldn't hurt to run vagrant up; if it isn't needed it will let you know.)

    At this point the Metron installation playbook stepped through nine blocks of instructions; looks they're called "plays". You can see the list in the metron_install.yml file, and you can look in the roles directory for a better understanding of the tasks associated with the role in each play (hadoop_setup, mysql-server, etc.).

When the provisioning finished I could see all four topologies in the Storm UI but I didn't see any data. I'd gotten an error during the hadoop_setup role (under hosts: hadoop_client) so I re-ran that part by making a backup copy of metron_install.yml, removing everything except the hadoop_client section from the original file, and running vagrant provision again. A little while later I started seeing data in the Metron UI -- great to see it!

I hope I've remembered everything; let me know if any of it isn't clear.

Highlighted

Re: Metron vagrant start hadoop services faiing

New Contributor

I went through the same approach and still running into a few more failures. 1) HDFS 2) HBase table creation and 3) install exited after "Build snort" task. WIll try again this mrng and update.

Re: Metron vagrant start hadoop services faiing

Explorer

Ok, I just saw with one with a member of the team here on Metron who has a new machine. I think the issue is our ansible scripts interacting negatively with ansible version 2.0.2. All of the members of the team here have 2.0.0.2. While this is corrected, I would suggest reverting to 2.0.0.2 and letting me know if it fixes the issue.

In case you might not know how to do that, what *I* do is remove ansible from homebrew (brew uninstall ansible) and then install directly via pip (pip install ansible==2.0.0.2).

Let me know and sorry for the bug!

View solution in original post

Highlighted

Re: Metron vagrant start hadoop services faiing

Rising Star

on my new mac book pro, i saw the same issue this morning. I followed casey's directions and it fixed it for me. Until we have a better fix, I have updated the documentation to instruction ansible 2.0.0.2 be installed): https://community.hortonworks.com/articles/24818/metron-tech-preview-1-install-instructions-on-sing....

Highlighted

Re: Metron vagrant start hadoop services faiing

Guru

Yes. This is the issue. Once i switched to 2.0.0.2 of ansible, I was able to go all the way. Earlier version was 2.0.2.0 and not 2.2 though. Thanks!

Highlighted

Re: Metron vagrant start hadoop services faiing

Explorer

Yes! 2.0.2, not 2.2 I misstyped. I will correct the original answer.

Don't have an account?
Coming from Hortonworks? Activate your account here