question Re: Apache Metron Single Node installation problems in Archives of Support Questions (Read Only)

Apache Metron Single Node installation problems

naveedanjum — Tue, 16 Aug 2016 13:04:54 GMT

Hi,

I am trying to setup single node via vagrant but no matter what i try it keeps up throwing error. Can you please guide what could be the solution ?

error-while-vagrantup.png

TASK [libselinux-python : Install libselinux-python] ***************************

fatal: [node1]: FAILED! => {"failed": true, "msg": "ERROR! The conditional check 'result.rc == 0' failed. The error was: ERROR! error while evaluating conditional (result.rc == 0): ERROR! 'dict object' has no attribute 'rc'"}

After this i tried vagrant provision which solved that but gave a new kind of error.

TASK [yum-update : Yum Update Packages] ****************************************

fatal: [node1]: FAILED! => {"failed": true, "msg": "ERROR! The conditional check 'result.rc == 0' failed. The error was: ERROR! error while evaluating conditional (result.rc == 0): ERROR! 'dict object' has no attribute 'rc'"}

Re: Apache Metron Single Node installation problems

nsinha — Tue, 16 Aug 2016 13:43:53 GMT

@Farrukh Anjum

Hi Farrukh,

Could you please ensure you are running the metron installation with the following versions of ansible and vagrant?

ansible= 2.0.0.2
Vagrant =1.8.1

Inorder to debug the mentioned issue,will need the log at the verbose level so would request you to run ansible provisioning by adding the following line in your Vagrantfile.(metron-deployment/vagrant/quick-dev-platform/Vagrantfile)

ansible.verbose = "vvv"

Regards,

Neha

Re: Apache Metron Single Node installation problems

asubramanian — Fri, 19 Aug 2016 14:11:15 GMT

I had earlier successfully deployed a 12-node Metron cluster on EC2 using a Ubuntu 14.04 box. Here are the steps that worked for me.

Installed Linuxbrew
Installed Java 1.8.0 and mvn 3.3.9
Python 2.7.11 with virtualenv (see this post for details)
Install Ansible ver 2.0.0.2 (after activating the virtualenv, using the command 'pip install ansible==2.0.0.2')
Install Virtualbox 5.0.16 and Vagrant 1.8.1

Can you post the output of 'incubator-metron/metron-deployment/scripts/platform-info.sh' from your setup?

Re: Apache Metron Single Node installation problems

jmeyer — Wed, 24 Aug 2016 19:40:19 GMT

On top of ansible and vagrant versions mentioned by @Neha Sinha, it is important to have Python 2.7.11. I believe this error is due to incorrect python version.

Re: Apache Metron Single Node installation problems

naveedanjum — Tue, 30 Aug 2016 12:56:19 GMT

Well I uninstalled Ubuntu and installed CentOS 6.8 on Server hopping that it will make it smooth installation but its like out of pain into the fire like situation.

I am getting this error. Any help will be appericated.

2016-08-2908:00:54,504 p=2522 u=root |  TASK [ambari_master :Install ambari server]***********************************2016-08-2909:25:57,232 p=2522 u=root |  fatal:[node1]: UNREACHABLE!=>{"changed":false,"msg":"Failed to connect to the host via ssh.","unreachable":true}

Re: Apache Metron Single Node installation problems

asubramanian — Tue, 30 Aug 2016 13:46:22 GMT

Hey @Farrukh Anjum, can you post the output of 'incubator-metron/metron-deployment/scripts/platform-info.sh' from your setup?

Re: Apache Metron Single Node installation problems

naveedanjum — Tue, 30 Aug 2016 14:38:56 GMT

Metron 0.2.0BETA fatal: Not a git repository (or any of the parent directories): .git -- ansible 2.1.1.0 config file = /etc/ansible/ansible.cfg configured module search path = Default w/o overrides -- Vagrant 1.8.1 -- Python 2.6.6 -- Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T21:41:47+05:00) Maven home: /usr/share/apache-maven Java version: 1.7.0_111, vendor: Oracle Corporation Java home: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.111.x86_64/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "2.6.32-642.el6.x86_64", arch: "amd64", family: "unix" -- Linux CentOS17 2.6.32-642.el6.x86_64 #1 SMP Tue May 10 17:27:01 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

Re: Apache Metron Single Node installation problems

asubramanian — Wed, 31 Aug 2016 12:44:31 GMT

I can see that you're missing the following because of which you're running into the issues.

- Python needs to be 2.7.x (you're having 2.6.6)

- ansible needs to be 2.0.0.2 (you're running on 2.1.1.0)

- Java needs to be 1.8.x (and you're running with 1.7.0_111)

Can you fix the above and retry?

For your reference, here's the output from my single node setup (it is from a Mac box, but nevertheless)

(testmetron) asubramanian:incubator-metron-fork asubramanian$ ./incubator-metron/metron-deployment/scripts/platform-info.sh
Metron 0.2.0BETA
fatal: Not a git repository (or any of the parent directories): .git
--
ansible 2.0.0.2
  config file =
  configured module search path = Default w/o overrides
--
Vagrant 1.8.4
--
Python 2.7.10
--
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T22:11:47+05:30)
Maven home: /usr/local/Cellar/maven/3.3.9/libexec
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.6", arch: "x86_64", family: "mac"
--
Darwin asubramanian.local 15.6.0 Darwin Kernel Version 15.6.0: Thu Jun 23 18:25:34 PDT 2016; root:xnu-3248.60.10~1/RELEASE_X86_64 x86_64

Re: Apache Metron Single Node installation problems

naveedanjum — Wed, 07 Sep 2016 12:26:06 GMT

./metron-deployment/scripts/platform-info.shMetron 0.2.0BETA
fatal: Not a git repository (or any of the parent directories): .git
--
ansible 2.0.0.2
  config file = 
  configured module search path = Default w/o overrides
--
Vagrant 1.8.1
--
Python 2.7.11
--
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T21:41:47+05:00)
Maven home: /usr/share/apache-maven
Java version: 1.8.0_45, vendor: Oracle Corporation
Java home: /usr/java/jdk1.8.0_45/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-642.el6.x86_64", arch: "amd64", family: "unix"
--
Linux CentOS17 2.6.32-642.el6.x86_64 #1 SMP Tue May 10 17:27:01 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

Re: Apache Metron Single Node installation problems

naveedanjum — Wed, 07 Sep 2016 12:30:22 GMT

Hi,

After fixings versions I am into this problem now.

I am getting this error while i am trying to install the latest apache metron using quick-dev-platform

TASK [ambari_config : Start the ambari cluster - no wait] **********************
changed: [node1]
TASK [ambari_config : Start the ambari cluster - wait] *************************
fatal: [node1]: FAILED! => {"changed": false, "failed": true, "module_stderr": "", "module_stdout": "", "msg": "MODULE FAILURE", "parsed": false}
PLAY RECAP *********************************************************************
node1                      : ok=15   changed=1    unreachable=0    failed=1  
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.

Following is the output of my platform

 ./metron-deployment/scripts/platform-info.shMetron 0.2.0BETA
fatal: Not a git repository (or any of the parent directories): .git
--
ansible 2.0.0.2
  config file = 
  configured module search path = Default w/o overrides
--
Vagrant 1.8.1
--
Python 2.7.11
--
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T21:41:47+05:00)
Maven home: /usr/share/apache-maven
Java version: 1.8.0_45, vendor: Oracle Corporation
Java home: /usr/java/jdk1.8.0_45/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-642.el6.x86_64", arch: "amd64", family: "unix"
--
Linux CentOS17 2.6.32-642.el6.x86_64 #1 SMP Tue May 10 17:27:01 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

Any help will be appreciated.

Re: Apache Metron Single Node installation problems

asubramanian — Wed, 07 Sep 2016 18:19:17 GMT

Hey @Farrukh Anjum, my guess is that you might be running out of memory on your linux box, cuz I have faced a similar situation on my Dell Vostro with Ubuntu 14.04. Can you dump the contents of /proc/meminfo and /proc/cpuinfo on your box?

Also, you can add ansible.verbose = "vvv" in your 'Vagrantfile' at incubator-metron/metron-deployment/vagrant/quick-dev-platform folder and re-run the 'run.sh'. This will increase the verbosity and will indicate what could be going wrong. Note that you might have to change 'up' to 'provision' in the run.sh if you are running the same command again.

  if ansibleSkipTags != '' or ansibleTags != ''
    config.vm.provision :ansible do |ansible|
        ansible.playbook = "../../playbooks/metron_full_install.yml"
        ansible.sudo = true
        ansible.tags = ansibleTags.split(",") if ansibleTags != ''
        ansible.skip_tags = ansibleSkipTags.split(",") if ansibleSkipTags != ''
        ansible.inventory_path = "../../inventory/full-dev-platform"
        ansible.verbose = "vvv"
    end

Re: Apache Metron Single Node installation problems

naveedanjum — Thu, 08 Sep 2016 11:57:52 GMT

Hi @asubramanian

I enabled verbosity mode. Now its giving following details

<node1> SSH: EXEC scp -C -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /root/incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r /tmp/tmpCymgCH '[node1]:/home/vagrant/.ansible/tmp/ansible-tmp-1473230983.26-243852837830618/yum'
<node1> ESTABLISH SSH CONNECTION FOR USER: vagrant
<node1> SSH: EXEC ssh -C -q -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /root/incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r -tt node1 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-zggucclqgkinuvvngryguppbglygrvng; LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 /usr/bin/python -tt /home/vagrant/.ansible/tmp/ansible-tmp-1473230983.26-243852837830618/yum; rm -rf "/home/vagrant/.ansible/tmp/ansible-tmp-1473230983.26-243852837830618/" > /dev/null 2>&1'"'"'"'"'"'"'"'"''"'"''
fatal: [node1]: FAILED! => {"failed": true, "msg": "ERROR! The conditional check 'result.rc == 0' failed. The error was: ERROR! error while evaluating conditional (result.rc == 0): ERROR! 'dict object' has no attribute 'rc'"}
PLAY RECAP *********************************************************************
node1                      : ok=34   changed=6    unreachable=0    failed=1  
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.

How can I fix this ?

Re: Apache Metron Single Node installation problems

naveedanjum — Thu, 08 Sep 2016 12:18:42 GMT

Hi @asubramanian

Its quit a strange in now this problem is comming again. Following is the log of error you asked for.

TASK [ambari_config : Start the ambari cluster - wait] *************************
task path: /root/incubator-metron/metron-deployment/roles/ambari_config/tasks/start_hdp.yml:34
<node1> ESTABLISH SSH CONNECTION FOR USER: vagrant
<node1> SSH: EXEC ssh -C -q -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /root/incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r -tt node1 '( umask 22 && mkdir -p "$( echo $HOME/.ansible/tmp/ansible-tmp-1473293699.31-125101223690255 )" && echo "$( echo $HOME/.ansible/tmp/ansible-tmp-1473293699.31-125101223690255 )" )'
<node1> PUT /tmp/tmpgcNEKd TO /home/vagrant/.ansible/tmp/ansible-tmp-1473293699.31-125101223690255/ambari_cluster_state
<node1> SSH: EXEC scp -C -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /root/incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r /tmp/tmpgcNEKd '[node1]:/home/vagrant/.ansible/tmp/ansible-tmp-1473293699.31-125101223690255/ambari_cluster_state'
<node1> ESTABLISH SSH CONNECTION FOR USER: vagrant
<node1> SSH: EXEC ssh -C -q -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /root/incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r -tt node1 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-rhyjdnwebywftmalgheffabpduagxrfz; LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 /usr/bin/python /home/vagrant/.ansible/tmp/ansible-tmp-1473293699.31-125101223690255/ambari_cluster_state; rm -rf "/home/vagrant/.ansible/tmp/ansible-tmp-1473293699.31-125101223690255/" > /dev/null 2>&1'"'"'"'"'"'"'"'"''"'"''
fatal: [node1]: FAILED! => {"changed": false, "failed": true, "invocation": {"module_args": {"blueprint_name": null, "blueprint_var": null, "cluster_name": "metron_cluster", "cluster_state": "started", "configurations": null, "host": "node1", "password": "admin", "port": 8080, "username": "admin", "wait_for_complete": true}, "module_name": "ambari_cluster_state"}, "msg": "Ambari client exception occurred: No JSON object could be decoded"}
PLAY RECAP *********************************************************************
node1                      : ok=15   changed=1    unreachable=0    failed=1  
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.

Re: Apache Metron Single Node installation problems

naveedanjum — Wed, 05 Oct 2016 14:02:34 GMT

Thanks to all, this problem was resolved when I increased the RAM to 64 GB

Re: Apache Metron Single Node installation problems

ehinkle27 — Fri, 16 Dec 2016 07:25:13 GMT

I am having this same problem doing the install. reruning the vagrant provision does not get me pass the error during the task of libselinux-python. I can tell the VM is running because I can see the login screen in python. Is there any other solutions that fixed this?

Re: Apache Metron Single Node installation problems

ehinkle27 — Fri, 16 Dec 2016 07:25:44 GMT

Re: Apache Metron Single Node installation problems

asubramanian — Fri, 16 Dec 2016 13:56:30 GMT

Hey @Earl Hinkle, please post the output of incubator-metron/metron-deployment/scripts/platform-info.sh

Re: Apache Metron Single Node installation problems

ehinkle27 — Tue, 20 Dec 2016 11:49:20 GMT

So I went through and uninstalled and reinstalled everything and tried the quick deploy verses the full deploy and got further, but I still do not have the system come completely up. I see the ambari server starts and can see the login page but it is stil failing. Below is the error. If I go to node1:8080 I do see the ambari login.

Task [ambari_config : Start the ambari cluster - no wait] changed: [Node1] Task [ambari_config : Start the ambari cluster - wait] fatal: [node1]: FAILED! => {"changed": false, "failed": true, "msg": "Request failed with status FAILED"

Here is the output of the command requested.

METRON-616: Added support for float and long literals in Stellar closes apache/incubator-metron#392 -- -- ansible 2.0.0.2 config file = /incubator-metron/metron-deployment/vagrant/quick-dev-platform/ansible.cfg configured module search path = ../../extra_modules -- Vagrant 1.8.1 -- Python 2.7.12 -- Apache Maven 3.3.9 Maven home: /usr/share/maven Java version: 1.8.0_112, vendor: Oracle Corporation Java home: /usr/local/java/jdk1.8.0_112/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "4.4.0-53-generic", arch: "amd64", family: "unix"

Re: Apache Metron Single Node installation problems

ehinkle27 — Wed, 21 Dec 2016 09:56:17 GMT

Below is the output when changing verbose to vvv

TASK [ambari_config : Start the ambari cluster - wait] ************************* task path: /incubator-metron/metron-deployment/roles/ambari_config/tasks/start_hdp.yml:34 <node1> ESTABLISH SSH CONNECTION FOR USER: vagrant <node1> SSH: EXEC ssh -C -q -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r -tt node1 '( umask 22 && mkdir -p "$( echo $HOME/.ansible/tmp/ansible-tmp-1482284789.32-204398118579253 )" && echo "$( echo $HOME/.ansible/tmp/ansible-tmp-1482284789.32-204398118579253 )" )' <node1> PUT /tmp/tmp8gjt4U TO /home/vagrant/.ansible/tmp/ansible-tmp-1482284789.32-204398118579253/ambari_cluster_state <node1> SSH: EXEC sftp -b - -C -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r '[node1]' <node1> ESTABLISH SSH CONNECTION FOR USER: vagrant <node1> SSH: EXEC ssh -C -q -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -i /incubator-metron/metron-deployment/vagrant/quick-dev-platform/.vagrant/machines/node1/virtualbox/private_key -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=vagrant -o ConnectTimeout=30 -o ControlPath=/root/.ansible/cp/%h-%p-%r -tt node1 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-pxqzgtoqufpebexymsvjohxeysursuva; LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 /usr/bin/python /home/vagrant/.ansible/tmp/ansible-tmp-1482284789.32-204398118579253/ambari_cluster_state; rm -rf "/home/vagrant/.ansible/tmp/ansible-tmp-1482284789.32-204398118579253/" > /dev/null 2>&1'"'"'"'"'"'"'"'"''"'"'' fatal: [node1]: FAILED! => {"changed": false, "failed": true, "invocation": {"module_args": {"blueprint_name": null, "blueprint_var": null, "cluster_name": "metron_cluster", "cluster_state": "started", "configurations": null, "host": "node1", "password": "admin", "port": 8080, "username": "admin", "wait_for_complete": true}, "module_name": "ambari_cluster_state"}, "msg": "Request failed with status FAILED"} PLAY RECAP ********************************************************************* node1 : ok=19 changed=3 unreachable=0 failed=1 Ansible failed to complete successfully. Any error output should be visible above. Please fix these errors and try again.

Re: Apache Metron Single Node installation problems

tony_jabbour — Fri, 12 Apr 2019 21:09:32 GMT

hello @asubramanian i need to contact you, if you allow, i have couple of questions on metron, if you could give me your email, iam student and i have metron to setup and iam in loop of installation problems