Apache Metron Single Node installation Issue: "Start the ambari cluster" task

[#1]

Hi all,

I'm trying to install apache metron on centOs but when I run "vagrant provision" command I'm getting the error below, anyone knows how to solve this ?

TASK [quick_dev : Start the ambari cluster] ************************************ task path: /home/marianne/Projects/metron/metron-deployment/roles/quick_dev/tasks/main.yml:66 <node1> ESTABLISH SSH CONNECTION FOR USER: vagrant <node1> SSH: EXEC ssh -C -q -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /home/marianne/Projects/metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/home/marianne/.ansible/cp/%h-%p-%r -tt node1 '( umask 22 && mkdir -p "$( echo $HOME/.ansible/tmp/ansible-tmp-1496757603.54-256295024586474 )" && echo "$( echo $HOME/.ansible/tmp/ansible-tmp-1496757603.54-256295024586474 )" )' <node1> PUT /tmp/tmpXHUoSB TO /home/vagrant/.ansible/tmp/ansible-tmp-1496757603.54-256295024586474/ambari_cluster_state <node1> SSH: EXEC scp -C -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /home/marianne/Projects/metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/home/marianne/.ansible/cp/%h-%p-%r /tmp/tmpXHUoSB '[node1]:/home/vagrant/.ansible/tmp/ansible-tmp-1496757603.54-256295024586474/ambari_cluster_state' <node1> ESTABLISH SSH CONNECTION FOR USER: vagrant <node1> SSH: EXEC ssh -C -q -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /home/marianne/Projects/metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/home/marianne/.ansible/cp/%h-%p-%r -tt node1 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-dsvayfawwwougicvhpiomprjvlxcslcs; LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 /usr/bin/python /home/vagrant/.ansible/tmp/ansible-tmp-1496757603.54-256295024586474/ambari_cluster_state; rm -rf "/home/vagrant/.ansible/tmp/ansible-tmp-1496757603.54-256295024586474/" > /dev/null 2>&1'"'"'"'"'"'"'"'"''"'"'' fatal: [node1]: FAILED! => {"changed": false, "failed": true, "invocation": {"module_args": {"blueprint_name": null, "blueprint_var": null, "cluster_name": "metron_cluster", "cluster_state": "started", "configurations": null, "host": "node1", "password": "admin", "port": 8080, "username": "admin", "wait_for_complete": true}, "module_name": "ambari_cluster_state"}, "msg": "Request failed with status FAILED"} PLAY RECAP ********************************************************************* node1 : ok=72 changed=15 unreachable=0 failed=1 Ansible failed to complete successfully. Any error output should be visible above. Please fix these errors and try again.

[#2]

@Marianne Andrade

Are you getting any error or exception?

[#3]

Hi jay, thanks for the quick response !! I've made a mistake and clicked on "submit" button before post the log!! Anyway I just entered above the error I'm getting

[#4]

I saw in another post that the output of metron-deployment/scripts/platform-info.sh could be useful, so I'm posting this info below:

Metron 0.4.0 -- * master -- commit e31ed2f7d2420fc9f68b0dbf5b6a9a5b53ac6453 Author: mattf-horton <mfoley@hortonworks.com> Date: Fri Jun 2 10:37:54 2017 -0700 METRON-979 markdown errors in site-book (mattf-horton) closes apache/metron#605 -- metron-deployment/ansible.cfg | 2 +- metron-deployment/pom.xml | 2 +- .../vagrant/quick-dev-platform/Vagrantfile | 3 ++- .../vagrant/quick-dev-platform/ansible.cfg | 1 + 4 files changed, 5 insertions(+), 3 deletions(-) -- ansible 2.0.0.2 config file = configured module search path = Default w/o overrides -- Vagrant 1.8.1 -- Python 2.7.13 -- Apache Maven 3.3.9 (Red Hat 3.3.9-2.8) Maven home: /opt/rh/rh-maven33/root/usr/share/maven Java version: 1.8.0_131, vendor: Oracle Corporation Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-0.b11.el6_9.x86_64/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "2.6.32-696.3.1.el6.x86_64", arch: "amd64", family: "unix" -- Docker version 1.7.1, build 786b29d/1.7.1 -- node ./platform-info.sh: line 69: node: command not found -- npm ./platform-info.sh: line 74: npm: command not found -- Linux i3 2.6.32-696.3.1.el6.x86_64 #1 SMP Tue May 30 19:52:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux -- Total System Memory = 7866.11 MB Processor Model: Intel(R) Core(TM) i3-3227U CPU @ 1.90GHz Processor Speed: 1200.000 MHz Processor Speed: 1901.000 MHz Processor Speed: 800.000 MHz Total Physical Processors: 4 Total cores: 8 Disk information: /dev/sda4 203G 34G 159G 18% / /dev/sda2 473M 79M 371M 18% /boot

[#5]

@asubramanian I could see that you're very active answering questions about metron, do you have any idea how could I solve this issue?

[#6]

Hello @Marianne Andrade, the output of your platform-info.sh seems about right to me. I don't see npm and node present on your system, but that should not hinder the deployment process.

Here is the output from my system for reference:

Metron 0.4.0
--
* master
--
commit 7d6121bfd3bd622940e9f411ac87b56d29755596
Author: cstella <cestella@gmail.com>
Date:   Fri Jun 9 00:52:34 2017 -0400
    METRON-987: Allow stellar enrichments to be specified by a list as well as a map closes apache/metron#609
--
--
ansible 2.0.0.2
  config file =
  configured module search path = Default w/o overrides
--
Vagrant 1.8.1
--
Python 2.7.12
--
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T22:11:47+05:30)
Maven home: /usr/local/Cellar/maven/3.3.9/libexec
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.6", arch: "x86_64", family: "mac"
--
Docker version 1.12.1, build 23cf638, experimental
--
node
v7.10.0
--
npm
4.2.0
--
Darwin HW12724-4.local 15.6.0 Darwin Kernel Version 15.6.0: Tue Apr 11 16:00:51 PDT 2017; root:xnu-3248.60.11.5.3~1/RELEASE_X86_64 x86_64
--
Total System Memory = 16384 MB
Processor Model: Intel(R) Core(TM) i7-4870HQ CPU
Processor Speed: 2.50GHz
Total Physical Processors: 4
Total cores: 4
Disk information:
/dev/disk1     465Gi  364Gi  100Gi    79% 95513266 26330444   78%   /

Have you attempted to re-run vagrant provision again after the failure? I have seen this to work at times.

In your next run, can you try these afresh? Also, please capture and paste the full log since it will be helpful to look.

vagrant destroy -f
vagrant up

In parallel, I am attempting to bring up a quick-dev as we speak just to rule out any issues with the master branch.

[#7]

Hi @Marianne Andrade, apparently the latest quick dev is broken. You can follow this ticket for more details and try deploying again once this is resolved - https://issues.apache.org/jira/browse/METRON-993

[#8]

Hi @asubramanian, if I use one of the the previous metron versions like 0.3.1 for example, do you think I could be able to finish the deployment?

[#9]

Hi @Marianne Andrade, as an alternative you can use the full-dev deployment, which is very similar to quick dev.

To know the differences between these metron deployments, please see the discuss thread here.