Apache Metron - Cloud Install w/ Amazon AWS - failed

[#1]

Machine: Linux 3.10.0-327.el7.x86_64

I am trying to follow the instructions to deploy Metron with Amazon AWS, but errors occur. No instances are being created on my account.

[root@r1e04 amazon-ec2]# ansible-playbook -i ec2.py playbook.yml
 [WARNING]: provided hosts list is empty, only localhost is available


PLAY ***************************************************************************

TASK [setup] *******************************************************************
ok: [localhost]

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-keypair.yml for localhost

TASK [set_fact] ****************************************************************
ok: [localhost]

TASK [Define keypair] **********************************************************
ok: [localhost] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDbudd+W1+8lWJVmE9UiSs/HfKIYUmkB4D0HH/Cr5tc1cnWKxj3wSHPlzMIy3Wid5V9FiT1KkfTzQY3gHgE5AOZtXtXZ9s/NGZnzu6PdWQVF0f3c9SqtrMMWlt3BqTOo6fc+iOmRJmRnXEnm8WwcpBf/szSCz+rq5Rql3jQO1n3FodPFXiInBf5x7dYGTP4YAYzb/oTsdoA1cD0ERk0sWiQjZjji//oZ3yhUztmUzHLki4CyYvOfwgpDu9BcwEP5MKPcAr+FowbPjSgL2/Be/c0ibGYdMerBEqP4waSjgNOqG0SRTsBHwT9ESzNgP4Ydf+k1wmKL0rt7yQbaCrugvHp root@r1e04)

TASK [debug] *******************************************************************
ok: [localhost] => {
    "msg": "Created keypair 'metron-test-metron-key' from '~/.ssh/id_rsa.pub'"
}

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-vpc.yml for localhost

TASK [metron-test:  Create virtual private cloud] ******************************
ok: [localhost]

TASK [[metron-test] Created vpc with id=vpc-e35f1987] **************************
ok: [localhost]

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-open-inbound-security-group.yml for localhost

TASK [metron-test: Define open inbound security group] *************************
ok: [localhost]

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-open-outbound-security-group.yml for localhost

TASK [metron-test: Define open outbound security group] ************************
ok: [localhost]

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-hosts.yml for localhost

TASK [metron-test: Instantiate 1 host(s) as sensors,ambari_master,metron,ec2] **
ok: [localhost]

TASK [Add host(s) to a hostgroup] **********************************************
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-242.us-west-2.compute.internal', u'public_ip': u'52.42.252.97', u'private_ip': u'10.0.0.242', u'id': u'i-08a871932341eb189', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-015e1bd6ffb0eeabf'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-07d44f745538ffd18'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0936015890361b236'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-42-252-97.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'sensors,ambari_master,metron,ec2', u'Name': u'[metron-test] sensors,ambari_master,metron,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'0', u'dns_name': u'ec2-52-42-252-97.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:12:35.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-hosts.yml for localhost

TASK [metron-test: Instantiate 4 host(s) as ambari_slave,ec2] ******************
ok: [localhost]

TASK [Add host(s) to a hostgroup] **********************************************
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-74.us-west-2.compute.internal', u'public_ip': u'52.42.213.100', u'private_ip': u'10.0.0.74', u'id': u'i-0643b50e267d98c74', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-00d571c7cfc872813'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0a17a324f1d8f44a3'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0b0dacefeeb030729'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-42-213-100.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test] ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'2', u'dns_name': u'ec2-52-42-213-100.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:13:06.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-75.us-west-2.compute.internal', u'public_ip': u'50.112.83.204', u'private_ip': u'10.0.0.75', u'id': u'i-0b20fab73c0105729', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0a405dc62a401aecd'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0485813a42a652ce4'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0c209f2de06d51616'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-50-112-83-204.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test] ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'1', u'dns_name': u'ec2-50-112-83-204.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:13:06.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-73.us-west-2.compute.internal', u'public_ip': u'52.42.206.217', u'private_ip': u'10.0.0.73', u'id': u'i-060b53cd77e69a517', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0cc876235869d030e'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-07b83cff47ed38cbd'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0416f73223dd727df'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-42-206-217.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test] ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'3', u'dns_name': u'ec2-52-42-206-217.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:13:06.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-76.us-west-2.compute.internal', u'public_ip': u'52.42.252.156', u'private_ip': u'10.0.0.76', u'id': u'i-01b07ae667a31a9df', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-02e5dfc748f6d3a2b'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0b5ed95bd8696bb38'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-09577d956ec767845'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-42-252-156.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test] ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'0', u'dns_name': u'ec2-52-42-252-156.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:13:06.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-hosts.yml for localhost

TASK [metron-test: Instantiate 1 host(s) as ambari_slave,metron_kafka_topics,metron_hbase_tables,metron,ec2,pcap_server] ***
ok: [localhost]

TASK [Add host(s) to a hostgroup] **********************************************
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-37.us-west-2.compute.internal', u'public_ip': u'52.42.240.48', u'private_ip': u'10.0.0.37', u'id': u'i-0074a499fec06e273', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-000ef00bfc3ed56e0'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0a27e42c03009cfc4'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0397a7c90a4091409'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-42-240-48.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'ambari_slave,metron_kafka_topics,metron_hbase_tables,metron,ec2,pcap_server', u'Name': u'[metron-test] ambari_slave,metron_kafka_topics,metron_hbase_tables,metron,ec2,pcap_server', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'0', u'dns_name': u'ec2-52-42-240-48.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:13:50.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-hosts.yml for localhost

TASK [metron-test: Instantiate 1 host(s) as ambari_slave,enrichment,metron,ec2] 
ok: [localhost]

TASK [Add host(s) to a hostgroup] **********************************************
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-83.us-west-2.compute.internal', u'public_ip': u'52.37.110.121', u'private_ip': u'10.0.0.83', u'id': u'i-0e84a1685440eaa4e', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-09553d3d6d6c99f44'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-062352f1434a82102'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0bba537666d4afa07'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-37-110-121.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'ambari_slave,enrichment,metron,ec2', u'Name': u'[metron-test] ambari_slave,enrichment,metron,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'0', u'dns_name': u'ec2-52-37-110-121.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:14:22.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-hosts.yml for localhost

TASK [metron-test: Instantiate 2 host(s) as search,metron,ec2] *****************
ok: [localhost]

TASK [Add host(s) to a hostgroup] **********************************************
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-178.us-west-2.compute.internal', u'public_ip': u'52.41.94.24', u'private_ip': u'10.0.0.178', u'id': u'i-0002ef62e2e76e400', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0c5301d78aaa2e581'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0c7f9e2ecc9002983'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0f5d0b72254f456e6'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-41-94-24.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'search,metron,ec2', u'Name': u'[metron-test] search,metron,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'0', u'dns_name': u'ec2-52-41-94-24.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:14:48.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-177.us-west-2.compute.internal', u'public_ip': u'52.42.144.54', u'private_ip': u'10.0.0.177', u'id': u'i-03f94cd8b4e1d93f0', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0d02567897c556c2c'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0374caca2a37b6e6f'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0965a50fcb0226130'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-42-144-54.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'search,metron,ec2', u'Name': u'[metron-test] search,metron,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'1', u'dns_name': u'ec2-52-42-144-54.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:14:48.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/create-hosts.yml for localhost

TASK [metron-test: Instantiate 1 host(s) as web,mysql,metron,ec2] **************
ok: [localhost]

TASK [Add host(s) to a hostgroup] **********************************************
changed: [localhost] => (item={u'kernel': None, u'root_device_type': u'ebs', u'private_dns_name': u'ip-10-0-0-32.us-west-2.compute.internal', u'public_ip': u'52.42.253.177', u'private_ip': u'10.0.0.32', u'id': u'i-0d595475cc2beeb4f', u'ebs_optimized': False, u'state': u'running', u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk': None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0ab551de9f433572f'}, u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-05e7a4f34f6c3bb64'}, u'/dev/sda1': {u'status': u'attached', u'delete_on_termination': True, u'volume_id': u'vol-0b8a900527ad0f7de'}}, u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265', u'tenancy': u'default', u'groups': {u'sg-71641017': u'metron-test-vpc-all-outbound', u'sg-76641010': u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'ec2-52-42-253-177.us-west-2.compute.amazonaws.com', u'state_code': 16, u'tags': {u'type': u'web,mysql,metron,ec2', u'Name': u'[metron-test] web,mysql,metron,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2b', u'ami_launch_index': u'0', u'dns_name': u'ec2-52-42-253-177.us-west-2.compute.amazonaws.com', u'region': u'us-west-2', u'launch_time': u'2016-07-26T18:15:15.000Z', u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1', u'hypervisor': u'xen'})

PLAY ***************************************************************************

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/check-hosts.yml for ec2-52-42-252-97.us-west-2.compute.amazonaws.com, ec2-52-42-213-100.us-west-2.compute.amazonaws.com, ec2-50-112-83-204.us-west-2.compute.amazonaws.com, ec2-52-42-206-217.us-west-2.compute.amazonaws.com, ec2-52-42-252-156.us-west-2.compute.amazonaws.com, ec2-52-42-240-48.us-west-2.compute.amazonaws.com, ec2-52-37-110-121.us-west-2.compute.amazonaws.com, ec2-52-41-94-24.us-west-2.compute.amazonaws.com, ec2-52-42-144-54.us-west-2.compute.amazonaws.com, ec2-52-42-253-177.us-west-2.compute.amazonaws.com

TASK [Wait for connectivity to host(s)] ****************************************
ok: [ec2-52-42-252-97.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-42-213-100.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-50-112-83-204.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-42-206-217.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-42-252-156.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-37-110-121.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-42-240-48.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-41-94-24.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-42-144-54.us-west-2.compute.amazonaws.com -> localhost]
ok: [ec2-52-42-253-177.us-west-2.compute.amazonaws.com -> localhost]

PLAY ***************************************************************************

TASK [setup] *******************************************************************
fatal: [ec2-52-42-252-97.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-42-213-100.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-50-112-83-204.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-42-206-217.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-42-252-156.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-42-240-48.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-37-110-121.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-41-94-24.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-42-144-54.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}
fatal: [ec2-52-42-253-177.us-west-2.compute.amazonaws.com]: UNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error during the connection. We recommend you re-run the command using -vvvv, which will enable SSH debugging output to help diagnose the issue", "unreachable": true}

PLAY ***************************************************************************

PLAY ***************************************************************************
skipping: no hosts matched

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************
skipping: no hosts matched

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

PLAY ***************************************************************************

TASK [setup] *******************************************************************
ok: [localhost]

TASK [include] *****************************************************************
included: /root/incubator-metron/metron-deployment/amazon-ec2/tasks/provisioning-report.yml for localhost

TASK [Known hosts groups] ******************************************************
ok: [localhost] => {
    "groups": {
        "all": [
            "localhost", 
            "ec2-52-42-252-97.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-213-100.us-west-2.compute.amazonaws.com", 
            "ec2-50-112-83-204.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-206-217.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-252-156.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-240-48.us-west-2.compute.amazonaws.com", 
            "ec2-52-37-110-121.us-west-2.compute.amazonaws.com", 
            "ec2-52-41-94-24.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-144-54.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-253-177.us-west-2.compute.amazonaws.com"
        ], 
        "ambari_master": [
            "ec2-52-42-252-97.us-west-2.compute.amazonaws.com"
        ], 
        "ambari_slave": [
            "ec2-52-42-213-100.us-west-2.compute.amazonaws.com", 
            "ec2-50-112-83-204.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-206-217.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-252-156.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-240-48.us-west-2.compute.amazonaws.com", 
            "ec2-52-37-110-121.us-west-2.compute.amazonaws.com"
        ], 
        "ec2": [
            "ec2-52-42-252-97.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-213-100.us-west-2.compute.amazonaws.com", 
            "ec2-50-112-83-204.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-206-217.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-252-156.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-240-48.us-west-2.compute.amazonaws.com", 
            "ec2-52-37-110-121.us-west-2.compute.amazonaws.com", 
            "ec2-52-41-94-24.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-144-54.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-253-177.us-west-2.compute.amazonaws.com"
        ], 
        "enrichment": [
            "ec2-52-37-110-121.us-west-2.compute.amazonaws.com"
        ], 
        "metron": [
            "ec2-52-42-252-97.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-240-48.us-west-2.compute.amazonaws.com", 
            "ec2-52-37-110-121.us-west-2.compute.amazonaws.com", 
            "ec2-52-41-94-24.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-144-54.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-253-177.us-west-2.compute.amazonaws.com"
        ], 
        "metron_hbase_tables": [
            "ec2-52-42-240-48.us-west-2.compute.amazonaws.com"
        ], 
        "metron_kafka_topics": [
            "ec2-52-42-240-48.us-west-2.compute.amazonaws.com"
        ], 
        "mysql": [
            "ec2-52-42-253-177.us-west-2.compute.amazonaws.com"
        ], 
        "pcap_server": [
            "ec2-52-42-240-48.us-west-2.compute.amazonaws.com"
        ], 
        "search": [
            "ec2-52-41-94-24.us-west-2.compute.amazonaws.com", 
            "ec2-52-42-144-54.us-west-2.compute.amazonaws.com"
        ], 
        "sensors": [
            "ec2-52-42-252-97.us-west-2.compute.amazonaws.com"
        ], 
        "ungrouped": [
            "localhost"
        ], 
        "web": [
            "ec2-52-42-253-177.us-west-2.compute.amazonaws.com"
        ]
    }
}

TASK [Sanity check Metron web] *************************************************
fatal: [localhost -> localhost]: FAILED! => {"changed": false, "elapsed": 20, "failed": true, "msg": "Timeout when waiting for ec2-52-42-253-177.us-west-2.compute.amazonaws.com:5000"}

PLAY RECAP *********************************************************************
ec2-50-112-83-204.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-37-110-121.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-41-94-24.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-42-144-54.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-42-206-217.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-42-213-100.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-42-240-48.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-42-252-156.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-42-252-97.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
ec2-52-42-253-177.us-west-2.compute.amazonaws.com : ok=2    changed=0    unreachable=1    failed=0   
localhost                  : ok=33   changed=6    unreachable=0    failed=1 

[#2]

Hi Matthew,

I think the instances are being created in the us-west-2 (Oregon) region. I've had those types of connection issues because I'm using OSX 10.10.5 and the version of OpenSSH that it uses doesn't support control_path that we use by default in Metron.

If you change your control path to :

[ssh_connection]

control_path = ~/.ssh/ansible-ssh-%%h-%%p-%%r

and re-run, it may connect.

[#3]

Ah, instances are created. I just had to change the region...

But anyway. I changed the control_path in /root/incubator-metron/metron-deployment/amazon-ec2/ansible.cfg to what you suggested, but the hosts are still unreachable.

[#4 · Accepted solution]

Follow up...I think I figured it out. I was looking to see if I could change the region of creation. So I looked through /incubator-metron/metron-deployment/amazon-ec2/conf/default.yml. Since I live on the east coast, I assume the following change is appropriate:

/incubator-metron/metron-deployment/amazon-ec2/conf/default.yml
region: us-east-1

There are no more ssh errors.