2016-04-29 09:58:33,701 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 09:58:33,701 p=28598 u=smanjee | skipping: no hosts matched 2016-04-29 09:58:33,707 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 09:58:33,822 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 09:58:34,844 p=28598 u=smanjee | ok: [node1] 2016-04-29 09:58:34,846 p=28598 u=smanjee | TASK [libselinux-python : Install libselinux-python] *************************** 2016-04-29 09:58:46,237 p=28598 u=smanjee | changed: [node1] 2016-04-29 09:58:46,239 p=28598 u=smanjee | TASK [yum-update : Yum Update Packages] **************************************** 2016-04-29 10:02:21,680 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:21,682 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:02:22,392 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:22,394 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:02:23,527 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:23,529 p=28598 u=smanjee | TASK [ntp : Install ntp] ******************************************************* 2016-04-29 10:02:33,225 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:33,227 p=28598 u=smanjee | TASK [ntp : Ensure ntp is running and enabled] ********************************* 2016-04-29 10:02:33,794 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:33,800 p=28598 u=smanjee | TASK [ambari_common : Check OS Version] **************************************** 2016-04-29 10:02:33,832 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:02:33,835 p=28598 u=smanjee | TASK [ambari_common : include] ************************************************* 2016-04-29 10:02:33,869 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/ambari_common/tasks/passwd_less_ssh.yml for node1 2016-04-29 10:02:33,892 p=28598 u=smanjee | TASK [ambari_common : Generate ssh key pair for "root"] ************************ 2016-04-29 10:02:34,268 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:34,286 p=28598 u=smanjee | TASK [ambari_common : Fetch the generated public key] ************************** 2016-04-29 10:02:34,486 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:34,488 p=28598 u=smanjee | TASK [ambari_common : Add key pairs to existing authorized_keys] *************** 2016-04-29 10:02:34,812 p=28598 u=smanjee | changed: [node1] => (item=node1) 2016-04-29 10:02:34,816 p=28598 u=smanjee | TASK [ambari_common : Remove local copy of ssh keys] *************************** 2016-04-29 10:02:35,067 p=28598 u=smanjee | changed: [node1 -> localhost] 2016-04-29 10:02:35,069 p=28598 u=smanjee | TASK [ambari_common : Ensure iptables is stopped and is not running at boot time.] *** 2016-04-29 10:02:35,344 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:35,347 p=28598 u=smanjee | TASK [ambari_common : Remove ipv4 'localhost.localdomain' from /etc/hosts] ***** 2016-04-29 10:02:35,593 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:35,595 p=28598 u=smanjee | TASK [ambari_common : Remove ipv6 'localhost.localdomain' from /etc/hosts] ***** 2016-04-29 10:02:35,824 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:35,826 p=28598 u=smanjee | TASK [ambari_common : Add localhost to /etc/hosts] ***************************** 2016-04-29 10:02:36,056 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:36,058 p=28598 u=smanjee | TASK [ambari_common : Download Ambari repo] ************************************ 2016-04-29 10:02:36,880 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:02:36,888 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:02:36,898 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:02:37,364 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:02:37,366 p=28598 u=smanjee | TASK [ambari_master : Install ambari server] *********************************** 2016-04-29 10:06:14,527 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:06:14,529 p=28598 u=smanjee | TASK [ambari_master : Set Ambari Server Max Memory] **************************** 2016-04-29 10:06:14,791 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:06:14,793 p=28598 u=smanjee | TASK [ambari_master : Setup ambari server] ************************************* 2016-04-29 10:07:50,334 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:07:50,338 p=28598 u=smanjee | TASK [ambari_master : start ambari server] ************************************* 2016-04-29 10:08:08,100 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:08:08,105 p=28598 u=smanjee | TASK [ambari_master : check if ambari-server is up on node1:8080] ************** 2016-04-29 10:10:08,395 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:10:08,403 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:10:08,413 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:10:08,843 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:10:08,846 p=28598 u=smanjee | TASK [ambari_slave : Install ambari-agent] ************************************* 2016-04-29 10:10:23,635 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:10:23,651 p=28598 u=smanjee | TASK [ambari_slave : Create ambari-agent hostname script] ********************** 2016-04-29 10:10:24,036 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:10:24,038 p=28598 u=smanjee | TASK [ambari_slave : Configure ambari-server hostname in ambari-agent configuration] *** 2016-04-29 10:10:24,506 p=28598 u=smanjee | changed: [node1] => (item={u'insertafter': u'\\[server\\]', u'regexp': u'^.*hostname=.*$', u'line': u'hostname=node1'}) 2016-04-29 10:10:24,510 p=28598 u=smanjee | changed: [node1] => (item={u'insertafter': u'\\[agent\\]', u'regexp': u'^hostname_script=.*$', u'line': u'hostname_script=/var/lib/ambari-agent/hostname.sh'}) 2016-04-29 10:10:24,513 p=28598 u=smanjee | TASK [ambari_slave : Ensure ambari-agent is running] *************************** 2016-04-29 10:10:26,885 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:10:26,887 p=28598 u=smanjee | TASK [ambari_slave : Wait for agent to register] ******************************* 2016-04-29 10:10:37,280 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:10:37,287 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:10:37,303 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:10:37,749 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:10:37,752 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:10:37,950 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:10:37,952 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:10:38,298 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:10:38,300 p=28598 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 10:10:43,213 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:10:43,215 p=28598 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 10:10:44,778 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:10:44,784 p=28598 u=smanjee | TASK [ambari_config : include_vars] ******************************************** 2016-04-29 10:10:44,881 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:10:44,883 p=28598 u=smanjee | TASK [ambari_config : Install python-requests] ********************************* 2016-04-29 10:10:48,719 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:10:48,723 p=28598 u=smanjee | TASK [ambari_config : Deploy cluster with Ambari; http://node1:8080] *********** 2016-04-29 10:24:05,861 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:24:05,866 p=28598 u=smanjee | TASK [ambari_config : include] ************************************************* 2016-04-29 10:24:05,904 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/ambari_config/tasks/start_services.yml for node1 2016-04-29 10:24:05,917 p=28598 u=smanjee | TASK [ambari_config : Start All Hadoop Services node1] ************************* 2016-04-29 10:24:07,315 p=28598 u=smanjee | ok: [node1] => (item=HDFS) 2016-04-29 10:24:07,330 p=28598 u=smanjee | ok: [node1] => (item=YARN) 2016-04-29 10:24:07,343 p=28598 u=smanjee | ok: [node1] => (item=MAPREDUCE2) 2016-04-29 10:24:07,359 p=28598 u=smanjee | ok: [node1] => (item=ZOOKEEPER) 2016-04-29 10:24:07,375 p=28598 u=smanjee | ok: [node1] => (item=HBASE) 2016-04-29 10:24:07,389 p=28598 u=smanjee | ok: [node1] => (item=STORM) 2016-04-29 10:24:07,403 p=28598 u=smanjee | ok: [node1] => (item=KAFKA) 2016-04-29 10:24:07,406 p=28598 u=smanjee | TASK [ambari_config : Wait for Service Start] ********************************** 2016-04-29 10:24:09,016 p=28598 u=smanjee | ok: [node1] => (item=HDFS) 2016-04-29 10:24:09,031 p=28598 u=smanjee | ok: [node1] => (item=YARN) 2016-04-29 10:24:09,046 p=28598 u=smanjee | ok: [node1] => (item=MAPREDUCE2) 2016-04-29 10:24:09,063 p=28598 u=smanjee | ok: [node1] => (item=ZOOKEEPER) 2016-04-29 10:24:09,080 p=28598 u=smanjee | ok: [node1] => (item=HBASE) 2016-04-29 10:24:09,095 p=28598 u=smanjee | ok: [node1] => (item=STORM) 2016-04-29 10:24:09,109 p=28598 u=smanjee | ok: [node1] => (item=KAFKA) 2016-04-29 10:24:09,112 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:24:09,113 p=28598 u=smanjee | skipping: no hosts matched 2016-04-29 10:24:09,122 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:24:09,140 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:24:09,793 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:09,797 p=28598 u=smanjee | TASK [yum-update : Yum Update Packages] **************************************** 2016-04-29 10:24:22,996 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:24:22,998 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:24:23,205 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:23,207 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:24:23,576 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:23,578 p=28598 u=smanjee | TASK [ntp : Install ntp] ******************************************************* 2016-04-29 10:24:23,886 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:23,888 p=28598 u=smanjee | TASK [ntp : Ensure ntp is running and enabled] ********************************* 2016-04-29 10:24:24,141 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:24,143 p=28598 u=smanjee | TASK [metron_common : Check OS Version] **************************************** 2016-04-29 10:24:24,167 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:24:24,169 p=28598 u=smanjee | TASK [metron_common : Check for Metron jar path] ******************************* 2016-04-29 10:24:24,348 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:24,350 p=28598 u=smanjee | TASK [metron_common : Verify Metron jars exist] ******************************** 2016-04-29 10:24:24,373 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:24:24,376 p=28598 u=smanjee | TASK [metron_common : Ensure iptables is stopped and is not running at boot time.] *** 2016-04-29 10:24:24,586 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:24,596 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:24:24,641 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:24:25,182 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:25,185 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:24:25,732 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:25,734 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:24:26,119 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:26,121 p=28598 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 10:24:26,440 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:26,442 p=28598 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 10:24:26,839 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:26,842 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 10:24:27,045 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:27,051 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:27,100 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:27,103 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 10:24:27,412 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:27,414 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:27,458 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:27,460 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 10:24:27,734 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:27,736 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:27,782 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:27,785 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 10:24:28,002 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,004 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:28,050 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,052 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 10:24:28,255 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,258 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:28,302 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,305 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 10:24:28,512 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,515 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:28,561 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,563 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:24:28,767 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,769 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:28,816 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,818 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:28,863 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:28,865 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 10:24:29,404 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:29,407 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:29,453 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:29,455 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 10:24:29,661 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:29,663 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:29,707 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:29,709 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:24:29,950 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:29,952 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:29,996 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:29,998 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:24:30,044 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:30,050 p=28598 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 10:24:30,087 p=28598 u=smanjee | ok: [node1] => { "msg": "zookeeper_port = 2181, zookeeper_hosts = [u'node1'], zookeeper_url = node1:2181, kafka_broker_port = 6667, kafka_broker_hosts = [u'node1'], kafka_broker_url = node1:6667" } 2016-04-29 10:24:30,089 p=28598 u=smanjee | TASK [hadoop_setup : Create HBase tables] ************************************** 2016-04-29 10:24:49,884 p=28598 u=smanjee | changed: [node1] => (item=pcap) 2016-04-29 10:24:49,891 p=28598 u=smanjee | changed: [node1] => (item=access_tracker) 2016-04-29 10:24:49,898 p=28598 u=smanjee | changed: [node1] => (item=malicious_ip) 2016-04-29 10:24:49,900 p=28598 u=smanjee | TASK [hadoop_setup : Create Kafka topics] ************************************** 2016-04-29 10:24:55,985 p=28598 u=smanjee | changed: [node1] => (item=pcap) 2016-04-29 10:24:55,992 p=28598 u=smanjee | changed: [node1] => (item=bro) 2016-04-29 10:24:55,999 p=28598 u=smanjee | changed: [node1] => (item=yaf) 2016-04-29 10:24:56,005 p=28598 u=smanjee | changed: [node1] => (item=snort) 2016-04-29 10:24:56,012 p=28598 u=smanjee | changed: [node1] => (item=enrichments) 2016-04-29 10:24:56,022 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:24:56,046 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:24:56,587 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:56,591 p=28598 u=smanjee | TASK [java_jdk : Check for java at "/usr/jdk64/jdk1.8.0_40"] ******************* 2016-04-29 10:24:56,767 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:56,769 p=28598 u=smanjee | TASK [java_jdk : Alternatives link for java] *********************************** 2016-04-29 10:24:57,114 p=28598 u=smanjee | changed: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) 2016-04-29 10:24:57,119 p=28598 u=smanjee | changed: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) 2016-04-29 10:24:57,121 p=28598 u=smanjee | TASK [java_jdk : Install openjdk] ********************************************** 2016-04-29 10:24:57,156 p=28598 u=smanjee | skipping: [node1] => (item=[])  2016-04-29 10:24:57,159 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:24:57,354 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:57,356 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:24:57,759 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:57,761 p=28598 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 10:24:58,089 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:58,091 p=28598 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 10:24:58,473 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:58,475 p=28598 u=smanjee | TASK [libselinux-python : Install libselinux-python] *************************** 2016-04-29 10:24:58,829 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:24:58,832 p=28598 u=smanjee | TASK [elasticsearch : Add Elasticsearch GPG key.] ****************************** 2016-04-29 10:25:00,143 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:25:00,158 p=28598 u=smanjee | TASK [elasticsearch : Add Elasticsearch repository.] *************************** 2016-04-29 10:25:00,487 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:25:00,489 p=28598 u=smanjee | TASK [elasticsearch : Install Elasticsearch.] ********************************** 2016-04-29 10:25:16,098 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:25:16,100 p=28598 u=smanjee | TASK [elasticsearch : Create Data Directories] ********************************* 2016-04-29 10:25:16,625 p=28598 u=smanjee | changed: [node1] => (item=/data1/elasticsearch) 2016-04-29 10:25:16,632 p=28598 u=smanjee | changed: [node1] => (item=/data2/elasticsearch) 2016-04-29 10:25:16,634 p=28598 u=smanjee | TASK [elasticsearch : Configure Elasticsearch.] ******************************** 2016-04-29 10:25:17,558 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'#cluster\\.name', u'line': u'cluster.name: metron'}) 2016-04-29 10:25:17,565 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'#network\\.host:', u'line': u'network.host: _eth1:ipv4_'}) 2016-04-29 10:25:17,571 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'#discovery\\.zen\\.ping\\.unicast\\.hosts', u'line': u'discovery.zen.ping.unicast.hosts: [ node1 ]'}) 2016-04-29 10:25:17,577 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'#path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'}) 2016-04-29 10:25:17,580 p=28598 u=smanjee | TASK [elasticsearch : Start Elasticsearch.] ************************************ 2016-04-29 10:25:19,237 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:25:19,239 p=28598 u=smanjee | TASK [elasticsearch : include] ************************************************* 2016-04-29 10:25:19,280 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml for node1 2016-04-29 10:25:19,296 p=28598 u=smanjee | TASK [elasticsearch : Wait for Elasticsearch Host to Start] ******************** 2016-04-29 10:25:29,521 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:25:29,523 p=28598 u=smanjee | TASK [elasticsearch : Wait for Green Index Status] ***************************** 2016-04-29 10:25:29,793 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:25:29,796 p=28598 u=smanjee | TASK [elasticsearch : Add Elasticsearch templates for topologies] ************** 2016-04-29 10:25:30,047 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:25:30,057 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:25:30,073 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:25:30,628 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:25:30,631 p=28598 u=smanjee | TASK [mysql_server : Create temporary directories] ***************************** 2016-04-29 10:25:30,860 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:25:30,862 p=28598 u=smanjee | TASK [mysql_server : Install Mysql Community Release Repo Def] ***************** 2016-04-29 10:25:32,138 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:25:32,140 p=28598 u=smanjee | TASK [mysql_server : Install Mysql Community Release Repo] ********************* 2016-04-29 10:25:33,652 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:25:33,655 p=28598 u=smanjee | TASK [mysql_server : Install MySQL] ******************************************** 2016-04-29 10:27:02,719 p=28598 u=smanjee | changed: [node1] => (item=[u'mysql-community-server', u'MySQL-python']) 2016-04-29 10:27:02,721 p=28598 u=smanjee | TASK [mysql_server : Start MySQL] ********************************************** 2016-04-29 10:27:11,436 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:11,438 p=28598 u=smanjee | TASK [mysql_server : Retrieve temporary root password] ************************* 2016-04-29 10:27:11,633 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:11,635 p=28598 u=smanjee | TASK [mysql_server : Update mysql root password] ******************************* 2016-04-29 10:27:11,807 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:11,809 p=28598 u=smanjee | TASK [mysql_server : Create .my.cnf] ******************************************* 2016-04-29 10:27:12,141 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:12,150 p=28598 u=smanjee | TASK [mysql_server : Download GeoIP databases] ********************************* 2016-04-29 10:27:22,622 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:22,624 p=28598 u=smanjee | TASK [mysql_server : Copy to MySQL import directory] *************************** 2016-04-29 10:27:22,861 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:22,864 p=28598 u=smanjee | TASK [mysql_server : Copy DDL] ************************************************* 2016-04-29 10:27:23,172 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:23,174 p=28598 u=smanjee | TASK [mysql_server : Import GeoIP DDL] ***************************************** 2016-04-29 10:27:29,850 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:27:29,861 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:27:29,870 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:27:30,470 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:30,473 p=28598 u=smanjee | TASK [mysql_client : Get Default mysql passowrd] ******************************* 2016-04-29 10:27:30,506 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:30,510 p=28598 u=smanjee | TASK [mysql_client : Allow remote login to mysql] ****************************** 2016-04-29 10:27:30,829 p=28598 u=smanjee | changed: [node1 -> node1] 2016-04-29 10:27:30,833 p=28598 u=smanjee | TASK [mysql_client : Import DB_Config] ***************************************** 2016-04-29 10:27:31,020 p=28598 u=smanjee | changed: [node1 -> node1] 2016-04-29 10:27:31,033 p=28598 u=smanjee | PLAY *************************************************************************** 2016-04-29 10:27:31,260 p=28598 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 10:27:31,797 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:31,801 p=28598 u=smanjee | TASK [tap_interface : Install tunctl] ****************************************** 2016-04-29 10:27:31,823 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:31,828 p=28598 u=smanjee | TASK [tap_interface : Create tap0] ********************************************* 2016-04-29 10:27:31,847 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:31,851 p=28598 u=smanjee | TASK [tap_interface : Bring up tap0 on 10.0.0.1] ******************************* 2016-04-29 10:27:31,870 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:31,875 p=28598 u=smanjee | TASK [tap_interface : Put tap0 in PROMISC] ************************************* 2016-04-29 10:27:31,894 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:31,897 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:27:31,943 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:31,946 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:27:32,001 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,004 p=28598 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 10:27:32,060 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,063 p=28598 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 10:27:32,105 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,109 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 10:27:32,182 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,186 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:32,245 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,249 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 10:27:32,323 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,327 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:32,385 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,389 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 10:27:32,464 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,467 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:32,524 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,528 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 10:27:32,600 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,603 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:32,662 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,665 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 10:27:32,739 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,742 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:32,801 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,804 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 10:27:32,882 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,885 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:32,945 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:32,948 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:27:33,023 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,027 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:33,086 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,090 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:33,150 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,153 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 10:27:33,231 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,234 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:33,292 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,296 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 10:27:33,398 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,401 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:33,463 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,467 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:27:33,541 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,545 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:33,606 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,610 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:33,668 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,672 p=28598 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 10:27:33,730 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,734 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:27:33,780 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,784 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:27:33,841 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,845 p=28598 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 10:27:33,900 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,904 p=28598 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 10:27:33,949 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:33,952 p=28598 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 10:27:34,004 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:34,007 p=28598 u=smanjee | TASK [pycapa : include] ******************************************************** 2016-04-29 10:27:34,066 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:34,069 p=28598 u=smanjee | TASK [pycapa : include] ******************************************************** 2016-04-29 10:27:34,126 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:34,130 p=28598 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 10:27:34,354 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:34,357 p=28598 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 10:27:34,788 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:34,791 p=28598 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 10:27:35,156 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:35,159 p=28598 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 10:27:35,593 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:35,597 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 10:27:35,675 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:35,678 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:35,765 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:35,769 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 10:27:35,848 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:35,851 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:35,912 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:35,916 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 10:27:35,998 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,002 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:36,063 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,067 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 10:27:36,144 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,147 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:36,209 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,213 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 10:27:36,290 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,293 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:36,355 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,359 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 10:27:36,437 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,441 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:36,501 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,505 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:27:36,586 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,590 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:36,650 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,654 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:36,714 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,718 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 10:27:36,795 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,799 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:36,860 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,864 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 10:27:36,942 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:36,946 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:37,024 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:37,028 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:27:37,103 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:37,107 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:37,170 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:37,173 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:27:37,237 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:37,240 p=28598 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 10:27:37,301 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:27:37,305 p=28598 u=smanjee | TASK [libselinux-python : Install libselinux-python] *************************** 2016-04-29 10:27:37,676 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:37,681 p=28598 u=smanjee | TASK [java_jdk : Check for java at "/usr/jdk64/jdk1.8.0_40"] ******************* 2016-04-29 10:27:37,885 p=28598 u=smanjee | ok: [node1] 2016-04-29 10:27:37,889 p=28598 u=smanjee | TASK [java_jdk : Alternatives link for java] *********************************** 2016-04-29 10:27:38,278 p=28598 u=smanjee | ok: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) 2016-04-29 10:27:38,296 p=28598 u=smanjee | ok: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) 2016-04-29 10:27:38,300 p=28598 u=smanjee | TASK [java_jdk : Install openjdk] ********************************************** 2016-04-29 10:27:38,375 p=28598 u=smanjee | skipping: [node1] => (item=[])  2016-04-29 10:27:38,379 p=28598 u=smanjee | TASK [build-tools : Install Build Tools] *************************************** 2016-04-29 10:28:59,714 p=28598 u=smanjee | changed: [node1] => (item=[u'@Development tools', u'libdnet-devel', u'rpm-build', u'libpcap', u'libpcap-devel', u'pcre', u'pcre-devel', u'zlib', u'zlib-devel', u'glib2-devel']) 2016-04-29 10:28:59,720 p=28598 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 10:28:59,765 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:28:59,769 p=28598 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 10:28:59,825 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:28:59,829 p=28598 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 10:28:59,904 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/dependencies.yml for node1 2016-04-29 10:28:59,918 p=28598 u=smanjee | TASK [bro : Install prerequisites] ********************************************* 2016-04-29 10:29:13,787 p=28598 u=smanjee | changed: [node1] => (item=[u'cmake', u'make', u'gcc', u'gcc-c++', u'flex', u'bison', u'libpcap', u'libpcap-devel', u'openssl-devel', u'python-devel', u'swig', u'zlib-devel', u'perl']) 2016-04-29 10:29:13,792 p=28598 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 10:29:13,868 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/librdkafka.yml for node1 2016-04-29 10:29:13,887 p=28598 u=smanjee | TASK [bro : Download librdkafka] *********************************************** 2016-04-29 10:29:15,612 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:29:15,617 p=28598 u=smanjee | TASK [bro : Extract librdkafka tarball] **************************************** 2016-04-29 10:29:16,294 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:29:16,298 p=28598 u=smanjee | TASK [bro : Compile and install librdkafka] ************************************ 2016-04-29 10:29:22,967 p=28598 u=smanjee | changed: [node1] => (item=rm -rf build/) 2016-04-29 10:29:23,044 p=28598 u=smanjee | changed: [node1] => (item=./configure --prefix=/usr/local) 2016-04-29 10:29:23,136 p=28598 u=smanjee | changed: [node1] => (item=make) 2016-04-29 10:29:23,210 p=28598 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 10:29:23,215 p=28598 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 10:29:23,292 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/bro.yml for node1 2016-04-29 10:29:23,319 p=28598 u=smanjee | TASK [bro : Download bro] ****************************************************** 2016-04-29 10:29:33,780 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:29:33,784 p=28598 u=smanjee | TASK [bro : Extract bro tarball] *********************************************** 2016-04-29 10:29:37,439 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:29:37,444 p=28598 u=smanjee | TASK [bro : Compile and Install bro] ******************************************* 2016-04-29 10:36:16,504 p=28598 u=smanjee | changed: [node1] => (item=./configure --prefix=/usr/local/bro) 2016-04-29 10:36:16,580 p=28598 u=smanjee | changed: [node1] => (item=make) 2016-04-29 10:36:16,655 p=28598 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 10:36:16,661 p=28598 u=smanjee | TASK [bro : Configure bro] ***************************************************** 2016-04-29 10:36:17,055 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:36:17,060 p=28598 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 10:36:17,138 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/bro-plugin-kafka.yml for node1 2016-04-29 10:36:17,178 p=28598 u=smanjee | TASK [bro : Distribute bro-kafka plugin] *************************************** 2016-04-29 10:36:24,385 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:36:24,390 p=28598 u=smanjee | TASK [bro : Compile and install the plugin] ************************************ 2016-04-29 10:36:29,326 p=28598 u=smanjee | changed: [node1] => (item=rm -rf build/) 2016-04-29 10:36:29,396 p=28598 u=smanjee | changed: [node1] => (item=./configure --bro-dist=/tmp/bro-2.4.1 --install-root=/usr/local/bro/lib/bro/plugins/ --with-librdkafka=/usr/local) 2016-04-29 10:36:29,468 p=28598 u=smanjee | changed: [node1] => (item=make) 2016-04-29 10:36:29,560 p=28598 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 10:36:29,565 p=28598 u=smanjee | TASK [bro : Configure bro-kafka plugin] **************************************** 2016-04-29 10:36:31,112 p=28598 u=smanjee | changed: [node1] => (item=@load Bro/Kafka/logs-to-kafka.bro) 2016-04-29 10:36:31,185 p=28598 u=smanjee | changed: [node1] => (item=redef Kafka::logs_to_send = set(HTTP::LOG, DNS::LOG);) 2016-04-29 10:36:31,254 p=28598 u=smanjee | changed: [node1] => (item=redef Kafka::topic_name = "bro";) 2016-04-29 10:36:31,324 p=28598 u=smanjee | changed: [node1] => (item=redef Kafka::tag_json = T;) 2016-04-29 10:36:31,399 p=28598 u=smanjee | changed: [node1] => (item=redef Kafka::kafka_conf = table(["metadata.broker.list"] = "node1:6667");) 2016-04-29 10:36:31,404 p=28598 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 10:36:31,482 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/start-bro.yml for node1 2016-04-29 10:36:31,530 p=28598 u=smanjee | TASK [bro : Turn on promiscuous mode for eth1] ********************************* 2016-04-29 10:36:31,831 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:36:31,836 p=28598 u=smanjee | TASK [bro : Start bro] ********************************************************* 2016-04-29 10:36:34,100 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:36:34,105 p=28598 u=smanjee | TASK [bro : Bro Cronjob] ******************************************************* 2016-04-29 10:36:34,759 p=28598 u=smanjee | changed: [node1] => (item=/usr/local/bro/bin/broctl cron) 2016-04-29 10:36:34,829 p=28598 u=smanjee | changed: [node1] => (item=rm -rf /usr/local/bro/spool/tmp/*) 2016-04-29 10:36:34,835 p=28598 u=smanjee | TASK [flume : Retrieve HDP repository definition] ****************************** 2016-04-29 10:36:35,570 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:36:35,573 p=28598 u=smanjee | TASK [flume : Install flume] *************************************************** 2016-04-29 10:37:02,722 p=28598 u=smanjee | changed: [node1] => (item=[u'flume', u'flume-agent']) 2016-04-29 10:37:02,728 p=28598 u=smanjee | TASK [flume : Create flume-env.sh] ********************************************* 2016-04-29 10:37:02,973 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:37:02,977 p=28598 u=smanjee | TASK [flume : Configure flume-env.sh] ****************************************** 2016-04-29 10:37:03,275 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'^.*export JAVA_HOME=.*$', u'line': u'export JAVA_HOME=/usr/jdk64/jdk1.8.0_40'}) 2016-04-29 10:37:03,279 p=28598 u=smanjee | TASK [flume : Create flume service] ******************************************** 2016-04-29 10:37:03,483 p=28598 u=smanjee | changed: [node1] => (item=cp /usr/hdp/current/flume-server/etc/rc.d/init.d/flume-agent /etc/init.d/) 2016-04-29 10:37:03,486 p=28598 u=smanjee | TASK [flume : Remove default flume configuration] ****************************** 2016-04-29 10:37:03,739 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:37:03,743 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 10:37:03,826 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:03,829 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:03,894 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:03,898 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 10:37:04,026 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,029 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:04,092 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,096 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 10:37:04,193 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,196 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:04,264 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,268 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 10:37:04,351 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,354 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:04,419 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,423 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 10:37:04,502 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,506 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:04,569 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,573 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 10:37:04,652 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,655 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:04,719 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,722 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:37:04,804 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,807 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:04,871 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,875 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:04,939 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:04,943 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 10:37:05,025 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,029 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:05,091 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,095 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 10:37:05,175 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,178 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:05,243 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,247 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:37:05,329 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,332 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:05,397 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,400 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:37:05,466 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,470 p=28598 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 10:37:05,537 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,542 p=28598 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 10:37:05,592 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,595 p=28598 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 10:37:05,654 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:37:05,657 p=28598 u=smanjee | TASK [snort : include] ********************************************************* 2016-04-29 10:37:05,742 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/snort/tasks/daq.yml for node1 2016-04-29 10:37:05,758 p=28598 u=smanjee | TASK [snort : Download daq] **************************************************** 2016-04-29 10:37:07,698 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:37:07,702 p=28598 u=smanjee | TASK [snort : Build daq] ******************************************************* 2016-04-29 10:37:21,307 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:37:21,312 p=28598 u=smanjee | TASK [snort : Install daq] ***************************************************** 2016-04-29 10:37:23,249 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:37:23,252 p=28598 u=smanjee | TASK [snort : include] ********************************************************* 2016-04-29 10:37:23,353 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/snort/tasks/snort.yml for node1 2016-04-29 10:37:23,386 p=28598 u=smanjee | TASK [snort : Download snort] ************************************************** 2016-04-29 10:37:26,749 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:37:26,754 p=28598 u=smanjee | TASK [snort : Build snort] ***************************************************** 2016-04-29 10:38:53,686 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:38:53,693 p=28598 u=smanjee | TASK [snort : Install snort] *************************************************** 2016-04-29 10:38:56,451 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:38:56,456 p=28598 u=smanjee | TASK [snort : Download snort community rules] ********************************** 2016-04-29 10:38:58,274 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:38:58,279 p=28598 u=smanjee | TASK [snort : Extract tarball] ************************************************* 2016-04-29 10:38:59,011 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:38:59,016 p=28598 u=smanjee | TASK [snort : Install snort rules] ********************************************* 2016-04-29 10:39:00,213 p=28598 u=smanjee | changed: [node1] => (item=cp -r community-rules/community.rules /etc/snort/rules) 2016-04-29 10:39:00,293 p=28598 u=smanjee | changed: [node1] => (item=touch /etc/snort/rules/white_list.rules) 2016-04-29 10:39:00,371 p=28598 u=smanjee | changed: [node1] => (item=touch /etc/snort/rules/black_list.rules) 2016-04-29 10:39:00,449 p=28598 u=smanjee | changed: [node1] => (item=touch /var/log/snort/alerts) 2016-04-29 10:39:00,527 p=28598 u=smanjee | changed: [node1] => (item=chown -R snort:snort /etc/snort) 2016-04-29 10:39:00,533 p=28598 u=smanjee | TASK [snort : Uncomment all snort community rules] ***************************** 2016-04-29 10:39:00,911 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:00,915 p=28598 u=smanjee |  [WARNING]: Consider using template or lineinfile module rather than running sed  2016-04-29 10:39:00,919 p=28598 u=smanjee | TASK [snort : Download snort configuration] ************************************ 2016-04-29 10:39:01,427 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:01,432 p=28598 u=smanjee | TASK [snort : Configure network] *********************************************** 2016-04-29 10:39:01,820 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:01,825 p=28598 u=smanjee | TASK [snort : Configure alerting] ********************************************** 2016-04-29 10:39:02,217 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:02,222 p=28598 u=smanjee | TASK [snort : Configure sysconfig] ********************************************* 2016-04-29 10:39:03,240 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'^ALERTMODE=.*$', u'line': u'ALERTMODE='}) 2016-04-29 10:39:03,322 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'^NO_PACKET_LOG=.*$', u'line': u'NO_PACKET_LOG=1'}) 2016-04-29 10:39:03,403 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'^INTERFACE=.*$', u'line': u'INTERFACE=eth1'}) 2016-04-29 10:39:03,409 p=28598 u=smanjee | TASK [snort : include] ********************************************************* 2016-04-29 10:39:03,490 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/snort/tasks/flume.yml for node1 2016-04-29 10:39:03,541 p=28598 u=smanjee | TASK [snort : Install flume configurations] ************************************ 2016-04-29 10:39:04,146 p=28598 u=smanjee | changed: [node1] => (item={u'dest': u'/etc/flume/conf/flume-snort.conf', u'src': u'flume-snort.conf'}) 2016-04-29 10:39:04,151 p=28598 u=smanjee | TASK [snort : Configure destination for snort alerts] ************************** 2016-04-29 10:39:05,187 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'^snort\\.sinks\\.kafka-sink\\.brokerList.*$', u'line': u'snort.sinks.kafka-sink.brokerList = node1:6667'}) 2016-04-29 10:39:05,286 p=28598 u=smanjee | ok: [node1] => (item={u'regexp': u'^snort\\.sinks\\.kafka-sink\\.topic.*$', u'line': u'snort.sinks.kafka-sink.topic = snort'}) 2016-04-29 10:39:05,365 p=28598 u=smanjee | changed: [node1] => (item={u'regexp': u'^snort.sources.exec-source.command.*$', u'line': u'snort.sources.exec-source.command = tail -F /var/log/snort/alert.csv'}) 2016-04-29 10:39:05,371 p=28598 u=smanjee | TASK [snort : Turn on promiscuous mode for eth1] ******************************* 2016-04-29 10:39:05,593 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:05,597 p=28598 u=smanjee | TASK [snort : Start snort] ***************************************************** 2016-04-29 10:39:08,225 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:08,229 p=28598 u=smanjee | TASK [snort : Start flume service to consume snort alerts] ********************* 2016-04-29 10:39:08,610 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:08,616 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 10:39:08,716 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:08,720 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:08,784 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:08,789 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 10:39:08,876 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:08,880 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:08,952 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:08,956 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 10:39:09,044 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,048 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:09,114 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,118 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 10:39:09,202 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,206 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:09,274 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,277 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 10:39:09,362 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,366 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:09,432 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,436 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 10:39:09,523 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,527 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:09,594 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,597 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:39:09,680 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,684 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:09,751 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,755 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:09,828 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,832 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 10:39:09,922 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:09,926 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:09,997 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,000 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 10:39:10,082 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,086 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:10,155 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,159 p=28598 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 10:39:10,246 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,250 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:10,316 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,320 p=28598 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 10:39:10,387 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,390 p=28598 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 10:39:10,457 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,463 p=28598 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 10:39:10,514 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,517 p=28598 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 10:39:10,577 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:39:10,581 p=28598 u=smanjee | TASK [yaf : include] *********************************************************** 2016-04-29 10:39:10,666 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/yaf/tasks/fixbuf.yml for node1 2016-04-29 10:39:10,679 p=28598 u=smanjee | TASK [yaf : Download fixbuf] *************************************************** 2016-04-29 10:39:12,378 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:12,383 p=28598 u=smanjee | TASK [yaf : Extract fixbuf tarball] ******************************************** 2016-04-29 10:39:13,108 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:13,113 p=28598 u=smanjee | TASK [yaf : Compile and Install fixbuf] **************************************** 2016-04-29 10:39:20,644 p=28598 u=smanjee | changed: [node1] => (item=./configure) 2016-04-29 10:39:20,721 p=28598 u=smanjee | changed: [node1] => (item=make) 2016-04-29 10:39:20,800 p=28598 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 10:39:20,805 p=28598 u=smanjee | TASK [yaf : include] *********************************************************** 2016-04-29 10:39:20,899 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/yaf/tasks/yaf.yml for node1 2016-04-29 10:39:20,927 p=28598 u=smanjee | TASK [yaf : Download yaf] ****************************************************** 2016-04-29 10:39:23,053 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:23,057 p=28598 u=smanjee | TASK [yaf : Extract yaf tarball] *********************************************** 2016-04-29 10:39:23,987 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:39:23,992 p=28598 u=smanjee | TASK [yaf : Compile and install yaf] ******************************************* 2016-04-29 10:40:12,056 p=28598 u=smanjee | changed: [node1] => (item=./configure --enable-applabel --enable-plugins) 2016-04-29 10:40:12,139 p=28598 u=smanjee | changed: [node1] => (item=make) 2016-04-29 10:40:12,221 p=28598 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 10:40:12,226 p=28598 u=smanjee | TASK [yaf : Create yaf home directory] ***************************************** 2016-04-29 10:40:12,668 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:12,673 p=28598 u=smanjee | TASK [yaf : Install yaf start script] ****************************************** 2016-04-29 10:40:13,147 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:13,151 p=28598 u=smanjee | TASK [yaf : Install init.d service script] ************************************* 2016-04-29 10:40:13,630 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:13,635 p=28598 u=smanjee | TASK [yaf : Register the service with systemd] ********************************* 2016-04-29 10:40:13,804 p=28598 u=smanjee | skipping: [node1] 2016-04-29 10:40:13,810 p=28598 u=smanjee | TASK [yaf : Turn on promiscuous mode for eth1] ********************************* 2016-04-29 10:40:14,146 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:14,150 p=28598 u=smanjee | TASK [yaf : Start yaf] ********************************************************* 2016-04-29 10:40:14,800 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:14,807 p=28598 u=smanjee | TASK [pcap_replay : include] *************************************************** 2016-04-29 10:40:14,865 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/tasks/tcpreplay.yml for node1 2016-04-29 10:40:14,878 p=28598 u=smanjee | TASK [pcap_replay : Download tcpreplay] **************************************** 2016-04-29 10:40:17,671 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:17,675 p=28598 u=smanjee | TASK [pcap_replay : Extract tcpreplay tarball] ********************************* 2016-04-29 10:40:18,439 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:18,443 p=28598 u=smanjee | TASK [pcap_replay : Compile and install tcpreplay] ***************************** 2016-04-29 10:40:39,860 p=28598 u=smanjee | changed: [node1] => (item=./configure --prefix=/opt) 2016-04-29 10:40:39,891 p=28598 u=smanjee | changed: [node1] => (item=make) 2016-04-29 10:40:39,924 p=28598 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 10:40:39,928 p=28598 u=smanjee | TASK [pcap_replay : include] *************************************************** 2016-04-29 10:40:39,980 p=28598 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/tasks/service.yml for node1 2016-04-29 10:40:40,000 p=28598 u=smanjee | TASK [pcap_replay : Create pcap directory] ************************************* 2016-04-29 10:40:40,306 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:40,310 p=28598 u=smanjee | TASK [pcap_replay : Install init.d service script] ***************************** 2016-04-29 10:40:40,698 p=28598 u=smanjee | changed: [node1] 2016-04-29 10:40:40,702 p=28598 u=smanjee | TASK [pcap_replay : Install example pcap file] ********************************* 2016-04-29 10:40:40,862 p=28598 u=smanjee | fatal: [node1]: FAILED! => {"failed": true, "msg": "ERROR! error while accessing the file /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/files/example.pcap, error was: [Errno 13] Permission denied: u'/Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/files/example.pcap'"} 2016-04-29 10:40:40,864 p=28598 u=smanjee | PLAY RECAP ********************************************************************* 2016-04-29 10:40:40,864 p=28598 u=smanjee | node1 : ok=189 changed=108 unreachable=0 failed=1 2016-04-29 11:15:10,224 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:15:10,224 p=30641 u=smanjee | skipping: no hosts matched 2016-04-29 11:15:10,230 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:15:10,348 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:15:11,439 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:15:11,441 p=30641 u=smanjee | TASK [libselinux-python : Install libselinux-python] *************************** 2016-04-29 11:15:35,230 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:15:35,232 p=30641 u=smanjee | TASK [yum-update : Yum Update Packages] **************************************** 2016-04-29 11:20:51,972 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:20:51,974 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:20:52,776 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:20:52,778 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:20:53,900 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:20:53,902 p=30641 u=smanjee | TASK [ntp : Install ntp] ******************************************************* 2016-04-29 11:21:03,266 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:03,268 p=30641 u=smanjee | TASK [ntp : Ensure ntp is running and enabled] ********************************* 2016-04-29 11:21:03,729 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:03,733 p=30641 u=smanjee | TASK [ambari_common : Check OS Version] **************************************** 2016-04-29 11:21:03,765 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:21:03,767 p=30641 u=smanjee | TASK [ambari_common : include] ************************************************* 2016-04-29 11:21:03,800 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/ambari_common/tasks/passwd_less_ssh.yml for node1 2016-04-29 11:21:03,823 p=30641 u=smanjee | TASK [ambari_common : Generate ssh key pair for "root"] ************************ 2016-04-29 11:21:04,244 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:04,261 p=30641 u=smanjee | TASK [ambari_common : Fetch the generated public key] ************************** 2016-04-29 11:21:04,486 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:04,488 p=30641 u=smanjee | TASK [ambari_common : Add key pairs to existing authorized_keys] *************** 2016-04-29 11:21:04,806 p=30641 u=smanjee | changed: [node1] => (item=node1) 2016-04-29 11:21:04,810 p=30641 u=smanjee | TASK [ambari_common : Remove local copy of ssh keys] *************************** 2016-04-29 11:21:05,069 p=30641 u=smanjee | changed: [node1 -> localhost] 2016-04-29 11:21:05,071 p=30641 u=smanjee | TASK [ambari_common : Ensure iptables is stopped and is not running at boot time.] *** 2016-04-29 11:21:05,326 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:05,329 p=30641 u=smanjee | TASK [ambari_common : Remove ipv4 'localhost.localdomain' from /etc/hosts] ***** 2016-04-29 11:21:05,580 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:05,582 p=30641 u=smanjee | TASK [ambari_common : Remove ipv6 'localhost.localdomain' from /etc/hosts] ***** 2016-04-29 11:21:05,993 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:05,996 p=30641 u=smanjee | TASK [ambari_common : Add localhost to /etc/hosts] ***************************** 2016-04-29 11:21:06,510 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:06,512 p=30641 u=smanjee | TASK [ambari_common : Download Ambari repo] ************************************ 2016-04-29 11:21:07,455 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:21:07,463 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:21:07,472 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:21:07,925 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:21:07,928 p=30641 u=smanjee | TASK [ambari_master : Install ambari server] *********************************** 2016-04-29 11:24:27,026 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:24:27,028 p=30641 u=smanjee | TASK [ambari_master : Set Ambari Server Max Memory] **************************** 2016-04-29 11:24:27,288 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:24:27,290 p=30641 u=smanjee | TASK [ambari_master : Setup ambari server] ************************************* 2016-04-29 11:25:48,534 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:25:48,538 p=30641 u=smanjee | TASK [ambari_master : start ambari server] ************************************* 2016-04-29 11:26:06,308 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:26:06,313 p=30641 u=smanjee | TASK [ambari_master : check if ambari-server is up on node1:8080] ************** 2016-04-29 11:28:06,579 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:28:06,587 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:28:06,596 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:28:07,185 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:28:07,189 p=30641 u=smanjee | TASK [ambari_slave : Install ambari-agent] ************************************* 2016-04-29 11:28:18,028 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:28:18,045 p=30641 u=smanjee | TASK [ambari_slave : Create ambari-agent hostname script] ********************** 2016-04-29 11:28:18,440 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:28:18,442 p=30641 u=smanjee | TASK [ambari_slave : Configure ambari-server hostname in ambari-agent configuration] *** 2016-04-29 11:28:18,916 p=30641 u=smanjee | changed: [node1] => (item={u'insertafter': u'\\[server\\]', u'regexp': u'^.*hostname=.*$', u'line': u'hostname=node1'}) 2016-04-29 11:28:18,919 p=30641 u=smanjee | changed: [node1] => (item={u'insertafter': u'\\[agent\\]', u'regexp': u'^hostname_script=.*$', u'line': u'hostname_script=/var/lib/ambari-agent/hostname.sh'}) 2016-04-29 11:28:18,921 p=30641 u=smanjee | TASK [ambari_slave : Ensure ambari-agent is running] *************************** 2016-04-29 11:28:21,237 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:28:21,239 p=30641 u=smanjee | TASK [ambari_slave : Wait for agent to register] ******************************* 2016-04-29 11:28:31,431 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:28:31,439 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:28:31,454 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:28:32,015 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:28:32,018 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:28:32,226 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:28:32,228 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:28:32,561 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:28:32,563 p=30641 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 11:28:38,223 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:28:38,225 p=30641 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 11:28:39,746 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:28:39,753 p=30641 u=smanjee | TASK [ambari_config : include_vars] ******************************************** 2016-04-29 11:28:39,846 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:28:39,848 p=30641 u=smanjee | TASK [ambari_config : Install python-requests] ********************************* 2016-04-29 11:28:43,033 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:28:43,037 p=30641 u=smanjee | TASK [ambari_config : Deploy cluster with Ambari; http://node1:8080] *********** 2016-04-29 11:41:27,184 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:41:27,187 p=30641 u=smanjee | TASK [ambari_config : include] ************************************************* 2016-04-29 11:41:27,222 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/ambari_config/tasks/start_services.yml for node1 2016-04-29 11:41:27,232 p=30641 u=smanjee | TASK [ambari_config : Start All Hadoop Services node1] ************************* 2016-04-29 11:41:28,632 p=30641 u=smanjee | ok: [node1] => (item=HDFS) 2016-04-29 11:41:28,645 p=30641 u=smanjee | ok: [node1] => (item=YARN) 2016-04-29 11:41:28,659 p=30641 u=smanjee | ok: [node1] => (item=MAPREDUCE2) 2016-04-29 11:41:28,672 p=30641 u=smanjee | ok: [node1] => (item=ZOOKEEPER) 2016-04-29 11:41:28,686 p=30641 u=smanjee | ok: [node1] => (item=HBASE) 2016-04-29 11:41:28,698 p=30641 u=smanjee | ok: [node1] => (item=STORM) 2016-04-29 11:41:28,710 p=30641 u=smanjee | ok: [node1] => (item=KAFKA) 2016-04-29 11:41:28,712 p=30641 u=smanjee | TASK [ambari_config : Wait for Service Start] ********************************** 2016-04-29 11:41:30,197 p=30641 u=smanjee | ok: [node1] => (item=HDFS) 2016-04-29 11:41:30,217 p=30641 u=smanjee | ok: [node1] => (item=YARN) 2016-04-29 11:41:30,235 p=30641 u=smanjee | ok: [node1] => (item=MAPREDUCE2) 2016-04-29 11:41:30,250 p=30641 u=smanjee | ok: [node1] => (item=ZOOKEEPER) 2016-04-29 11:41:30,265 p=30641 u=smanjee | ok: [node1] => (item=HBASE) 2016-04-29 11:41:30,281 p=30641 u=smanjee | ok: [node1] => (item=STORM) 2016-04-29 11:41:30,299 p=30641 u=smanjee | ok: [node1] => (item=KAFKA) 2016-04-29 11:41:30,302 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:41:30,302 p=30641 u=smanjee | skipping: no hosts matched 2016-04-29 11:41:30,309 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:41:30,327 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:41:30,923 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:30,926 p=30641 u=smanjee | TASK [yum-update : Yum Update Packages] **************************************** 2016-04-29 11:41:43,517 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:41:43,519 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:41:43,732 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:43,734 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:41:44,098 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:44,100 p=30641 u=smanjee | TASK [ntp : Install ntp] ******************************************************* 2016-04-29 11:41:44,420 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:44,422 p=30641 u=smanjee | TASK [ntp : Ensure ntp is running and enabled] ********************************* 2016-04-29 11:41:44,674 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:44,676 p=30641 u=smanjee | TASK [metron_common : Check OS Version] **************************************** 2016-04-29 11:41:44,699 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:41:44,702 p=30641 u=smanjee | TASK [metron_common : Check for Metron jar path] ******************************* 2016-04-29 11:41:44,877 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:44,879 p=30641 u=smanjee | TASK [metron_common : Verify Metron jars exist] ******************************** 2016-04-29 11:41:44,901 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:41:44,903 p=30641 u=smanjee | TASK [metron_common : Ensure iptables is stopped and is not running at boot time.] *** 2016-04-29 11:41:45,147 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:45,156 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:41:45,198 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:41:45,748 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:45,751 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:41:46,282 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:46,284 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:41:46,647 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:46,649 p=30641 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 11:41:46,967 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:46,969 p=30641 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 11:41:47,377 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:47,379 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 11:41:47,586 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:47,591 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:47,640 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:47,643 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 11:41:47,988 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:47,991 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:48,036 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:48,038 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 11:41:48,362 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:48,366 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:48,429 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:48,431 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 11:41:48,657 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:48,659 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:48,707 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:48,709 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 11:41:48,954 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:48,956 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:49,007 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,011 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 11:41:49,279 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,282 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:49,332 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,334 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:41:49,573 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,575 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:49,622 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,624 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:49,670 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,673 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 11:41:49,890 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,892 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:49,938 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:49,941 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 11:41:50,151 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:50,153 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:50,198 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:50,200 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:41:50,424 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:50,426 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:50,469 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:50,472 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:41:50,516 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:41:50,522 p=30641 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 11:41:50,560 p=30641 u=smanjee | ok: [node1] => { "msg": "zookeeper_port = 2181, zookeeper_hosts = [u'node1'], zookeeper_url = node1:2181, kafka_broker_port = 6667, kafka_broker_hosts = [u'node1'], kafka_broker_url = node1:6667" } 2016-04-29 11:41:50,562 p=30641 u=smanjee | TASK [hadoop_setup : Create HBase tables] ************************************** 2016-04-29 11:42:10,815 p=30641 u=smanjee | changed: [node1] => (item=pcap) 2016-04-29 11:42:10,821 p=30641 u=smanjee | changed: [node1] => (item=access_tracker) 2016-04-29 11:42:10,827 p=30641 u=smanjee | changed: [node1] => (item=malicious_ip) 2016-04-29 11:42:10,830 p=30641 u=smanjee | TASK [hadoop_setup : Create Kafka topics] ************************************** 2016-04-29 11:42:17,120 p=30641 u=smanjee | changed: [node1] => (item=pcap) 2016-04-29 11:42:17,128 p=30641 u=smanjee | changed: [node1] => (item=bro) 2016-04-29 11:42:17,134 p=30641 u=smanjee | changed: [node1] => (item=yaf) 2016-04-29 11:42:17,141 p=30641 u=smanjee | changed: [node1] => (item=snort) 2016-04-29 11:42:17,148 p=30641 u=smanjee | changed: [node1] => (item=enrichments) 2016-04-29 11:42:17,157 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:42:17,178 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:42:17,716 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:17,721 p=30641 u=smanjee | TASK [java_jdk : Check for java at "/usr/jdk64/jdk1.8.0_40"] ******************* 2016-04-29 11:42:17,903 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:17,905 p=30641 u=smanjee | TASK [java_jdk : Alternatives link for java] *********************************** 2016-04-29 11:42:18,253 p=30641 u=smanjee | changed: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) 2016-04-29 11:42:18,258 p=30641 u=smanjee | changed: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) 2016-04-29 11:42:18,260 p=30641 u=smanjee | TASK [java_jdk : Install openjdk] ********************************************** 2016-04-29 11:42:18,294 p=30641 u=smanjee | skipping: [node1] => (item=[])  2016-04-29 11:42:18,296 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:42:18,495 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:18,497 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:42:18,875 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:18,877 p=30641 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 11:42:19,210 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:19,213 p=30641 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 11:42:19,604 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:19,607 p=30641 u=smanjee | TASK [libselinux-python : Install libselinux-python] *************************** 2016-04-29 11:42:19,939 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:19,941 p=30641 u=smanjee | TASK [elasticsearch : Add Elasticsearch GPG key.] ****************************** 2016-04-29 11:42:21,143 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:42:21,160 p=30641 u=smanjee | TASK [elasticsearch : Add Elasticsearch repository.] *************************** 2016-04-29 11:42:21,512 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:42:21,514 p=30641 u=smanjee | TASK [elasticsearch : Install Elasticsearch.] ********************************** 2016-04-29 11:42:35,367 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:42:35,370 p=30641 u=smanjee | TASK [elasticsearch : Create Data Directories] ********************************* 2016-04-29 11:42:35,884 p=30641 u=smanjee | changed: [node1] => (item=/data1/elasticsearch) 2016-04-29 11:42:35,891 p=30641 u=smanjee | changed: [node1] => (item=/data2/elasticsearch) 2016-04-29 11:42:35,893 p=30641 u=smanjee | TASK [elasticsearch : Configure Elasticsearch.] ******************************** 2016-04-29 11:42:36,834 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'#cluster\\.name', u'line': u'cluster.name: metron'}) 2016-04-29 11:42:36,841 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'#network\\.host:', u'line': u'network.host: _eth1:ipv4_'}) 2016-04-29 11:42:36,847 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'#discovery\\.zen\\.ping\\.unicast\\.hosts', u'line': u'discovery.zen.ping.unicast.hosts: [ node1 ]'}) 2016-04-29 11:42:36,854 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'#path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'}) 2016-04-29 11:42:36,856 p=30641 u=smanjee | TASK [elasticsearch : Start Elasticsearch.] ************************************ 2016-04-29 11:42:38,514 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:42:38,517 p=30641 u=smanjee | TASK [elasticsearch : include] ************************************************* 2016-04-29 11:42:38,555 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml for node1 2016-04-29 11:42:38,569 p=30641 u=smanjee | TASK [elasticsearch : Wait for Elasticsearch Host to Start] ******************** 2016-04-29 11:42:48,780 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:48,782 p=30641 u=smanjee | TASK [elasticsearch : Wait for Green Index Status] ***************************** 2016-04-29 11:42:49,042 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:49,045 p=30641 u=smanjee | TASK [elasticsearch : Add Elasticsearch templates for topologies] ************** 2016-04-29 11:42:49,298 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:49,307 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:42:49,320 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:42:49,872 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:42:49,876 p=30641 u=smanjee | TASK [mysql_server : Create temporary directories] ***************************** 2016-04-29 11:42:50,116 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:42:50,118 p=30641 u=smanjee | TASK [mysql_server : Install Mysql Community Release Repo Def] ***************** 2016-04-29 11:42:51,396 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:42:51,398 p=30641 u=smanjee | TASK [mysql_server : Install Mysql Community Release Repo] ********************* 2016-04-29 11:42:52,950 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:42:52,952 p=30641 u=smanjee | TASK [mysql_server : Install MySQL] ******************************************** 2016-04-29 11:43:57,989 p=30641 u=smanjee | changed: [node1] => (item=[u'mysql-community-server', u'MySQL-python']) 2016-04-29 11:43:57,991 p=30641 u=smanjee | TASK [mysql_server : Start MySQL] ********************************************** 2016-04-29 11:44:05,497 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:05,499 p=30641 u=smanjee | TASK [mysql_server : Retrieve temporary root password] ************************* 2016-04-29 11:44:05,703 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:05,705 p=30641 u=smanjee | TASK [mysql_server : Update mysql root password] ******************************* 2016-04-29 11:44:05,892 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:05,894 p=30641 u=smanjee | TASK [mysql_server : Create .my.cnf] ******************************************* 2016-04-29 11:44:06,243 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:06,254 p=30641 u=smanjee | TASK [mysql_server : Download GeoIP databases] ********************************* 2016-04-29 11:44:19,067 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:19,071 p=30641 u=smanjee | TASK [mysql_server : Copy to MySQL import directory] *************************** 2016-04-29 11:44:19,334 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:19,336 p=30641 u=smanjee | TASK [mysql_server : Copy DDL] ************************************************* 2016-04-29 11:44:19,668 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:19,670 p=30641 u=smanjee | TASK [mysql_server : Import GeoIP DDL] ***************************************** 2016-04-29 11:44:26,298 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:44:26,307 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:44:26,316 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:44:26,884 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:26,887 p=30641 u=smanjee | TASK [mysql_client : Get Default mysql passowrd] ******************************* 2016-04-29 11:44:26,920 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:26,925 p=30641 u=smanjee | TASK [mysql_client : Allow remote login to mysql] ****************************** 2016-04-29 11:44:27,245 p=30641 u=smanjee | changed: [node1 -> node1] 2016-04-29 11:44:27,249 p=30641 u=smanjee | TASK [mysql_client : Import DB_Config] ***************************************** 2016-04-29 11:44:27,447 p=30641 u=smanjee | changed: [node1 -> node1] 2016-04-29 11:44:27,457 p=30641 u=smanjee | PLAY *************************************************************************** 2016-04-29 11:44:27,674 p=30641 u=smanjee | TASK [setup] ******************************************************************* 2016-04-29 11:44:28,210 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:28,214 p=30641 u=smanjee | TASK [tap_interface : Install tunctl] ****************************************** 2016-04-29 11:44:28,235 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,239 p=30641 u=smanjee | TASK [tap_interface : Create tap0] ********************************************* 2016-04-29 11:44:28,257 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,262 p=30641 u=smanjee | TASK [tap_interface : Bring up tap0 on 10.0.0.1] ******************************* 2016-04-29 11:44:28,281 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,286 p=30641 u=smanjee | TASK [tap_interface : Put tap0 in PROMISC] ************************************* 2016-04-29 11:44:28,306 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,309 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:44:28,354 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,358 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:44:28,414 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,417 p=30641 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 11:44:28,470 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,473 p=30641 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 11:44:28,514 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,519 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 11:44:28,593 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,597 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:28,654 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,657 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 11:44:28,730 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,734 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:28,791 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,794 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 11:44:28,865 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,869 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:28,926 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:28,930 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 11:44:29,003 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,006 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,063 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,066 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 11:44:29,137 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,141 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,201 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,204 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 11:44:29,276 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,279 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,336 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,339 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:44:29,414 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,418 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,475 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,478 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,535 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,538 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 11:44:29,611 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,615 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,672 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,676 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 11:44:29,767 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,770 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,827 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,830 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:44:29,900 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,904 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:29,963 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:29,966 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:30,023 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,027 p=30641 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 11:44:30,085 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,088 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:44:30,132 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,135 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:44:30,190 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,194 p=30641 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 11:44:30,248 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,252 p=30641 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 11:44:30,295 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,298 p=30641 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 11:44:30,346 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,350 p=30641 u=smanjee | TASK [pycapa : include] ******************************************************** 2016-04-29 11:44:30,407 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,411 p=30641 u=smanjee | TASK [pycapa : include] ******************************************************** 2016-04-29 11:44:30,468 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:30,471 p=30641 u=smanjee | TASK [epel : Get epel-repo rpm] ************************************************ 2016-04-29 11:44:30,700 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:30,703 p=30641 u=smanjee | TASK [epel : Install epel-repo rpm] ******************************************** 2016-04-29 11:44:31,136 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:31,140 p=30641 u=smanjee | TASK [python-pip : Install python-pip] ***************************************** 2016-04-29 11:44:31,500 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:31,503 p=30641 u=smanjee | TASK [httplib2 : Install python httplib2 dependency] *************************** 2016-04-29 11:44:31,937 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:31,940 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 11:44:32,016 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,019 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:32,103 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,106 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 11:44:32,184 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,187 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:32,250 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,254 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 11:44:32,331 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,334 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:32,396 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,399 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 11:44:32,476 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,480 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:32,542 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,545 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 11:44:32,624 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,627 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:32,689 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,693 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 11:44:32,772 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,775 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:32,837 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,840 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:44:32,916 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,919 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:32,981 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:32,985 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:33,046 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,050 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 11:44:33,126 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,130 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:33,191 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,195 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 11:44:33,271 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,275 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:33,350 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,353 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:44:33,428 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,431 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:33,492 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,495 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:44:33,558 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,561 p=30641 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 11:44:33,623 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:44:33,627 p=30641 u=smanjee | TASK [libselinux-python : Install libselinux-python] *************************** 2016-04-29 11:44:33,987 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:33,991 p=30641 u=smanjee | TASK [java_jdk : Check for java at "/usr/jdk64/jdk1.8.0_40"] ******************* 2016-04-29 11:44:34,192 p=30641 u=smanjee | ok: [node1] 2016-04-29 11:44:34,195 p=30641 u=smanjee | TASK [java_jdk : Alternatives link for java] *********************************** 2016-04-29 11:44:34,565 p=30641 u=smanjee | ok: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) 2016-04-29 11:44:34,583 p=30641 u=smanjee | ok: [node1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) 2016-04-29 11:44:34,586 p=30641 u=smanjee | TASK [java_jdk : Install openjdk] ********************************************** 2016-04-29 11:44:34,667 p=30641 u=smanjee | skipping: [node1] => (item=[])  2016-04-29 11:44:34,670 p=30641 u=smanjee | TASK [build-tools : Install Build Tools] *************************************** 2016-04-29 11:45:47,203 p=30641 u=smanjee | changed: [node1] => (item=[u'@Development tools', u'libdnet-devel', u'rpm-build', u'libpcap', u'libpcap-devel', u'pcre', u'pcre-devel', u'zlib', u'zlib-devel', u'glib2-devel']) 2016-04-29 11:45:47,208 p=30641 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 11:45:47,253 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:45:47,257 p=30641 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 11:45:47,311 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:45:47,315 p=30641 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 11:45:47,389 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/dependencies.yml for node1 2016-04-29 11:45:47,400 p=30641 u=smanjee | TASK [bro : Install prerequisites] ********************************************* 2016-04-29 11:46:00,105 p=30641 u=smanjee | changed: [node1] => (item=[u'cmake', u'make', u'gcc', u'gcc-c++', u'flex', u'bison', u'libpcap', u'libpcap-devel', u'openssl-devel', u'python-devel', u'swig', u'zlib-devel', u'perl']) 2016-04-29 11:46:00,109 p=30641 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 11:46:00,187 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/librdkafka.yml for node1 2016-04-29 11:46:00,205 p=30641 u=smanjee | TASK [bro : Download librdkafka] *********************************************** 2016-04-29 11:46:01,859 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:46:01,863 p=30641 u=smanjee | TASK [bro : Extract librdkafka tarball] **************************************** 2016-04-29 11:46:02,501 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:46:02,505 p=30641 u=smanjee | TASK [bro : Compile and install librdkafka] ************************************ 2016-04-29 11:46:09,443 p=30641 u=smanjee | changed: [node1] => (item=rm -rf build/) 2016-04-29 11:46:09,515 p=30641 u=smanjee | changed: [node1] => (item=./configure --prefix=/usr/local) 2016-04-29 11:46:09,602 p=30641 u=smanjee | changed: [node1] => (item=make) 2016-04-29 11:46:09,673 p=30641 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 11:46:09,677 p=30641 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 11:46:09,756 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/bro.yml for node1 2016-04-29 11:46:09,784 p=30641 u=smanjee | TASK [bro : Download bro] ****************************************************** 2016-04-29 11:46:21,960 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:46:21,965 p=30641 u=smanjee | TASK [bro : Extract bro tarball] *********************************************** 2016-04-29 11:46:25,455 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:46:25,460 p=30641 u=smanjee | TASK [bro : Compile and Install bro] ******************************************* 2016-04-29 11:53:04,800 p=30641 u=smanjee | changed: [node1] => (item=./configure --prefix=/usr/local/bro) 2016-04-29 11:53:04,878 p=30641 u=smanjee | changed: [node1] => (item=make) 2016-04-29 11:53:04,951 p=30641 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 11:53:04,956 p=30641 u=smanjee | TASK [bro : Configure bro] ***************************************************** 2016-04-29 11:53:05,354 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:05,358 p=30641 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 11:53:05,438 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/bro-plugin-kafka.yml for node1 2016-04-29 11:53:05,474 p=30641 u=smanjee | TASK [bro : Distribute bro-kafka plugin] *************************************** 2016-04-29 11:53:13,366 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:13,371 p=30641 u=smanjee | TASK [bro : Compile and install the plugin] ************************************ 2016-04-29 11:53:18,338 p=30641 u=smanjee | changed: [node1] => (item=rm -rf build/) 2016-04-29 11:53:18,408 p=30641 u=smanjee | changed: [node1] => (item=./configure --bro-dist=/tmp/bro-2.4.1 --install-root=/usr/local/bro/lib/bro/plugins/ --with-librdkafka=/usr/local) 2016-04-29 11:53:18,478 p=30641 u=smanjee | changed: [node1] => (item=make) 2016-04-29 11:53:18,566 p=30641 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 11:53:18,571 p=30641 u=smanjee | TASK [bro : Configure bro-kafka plugin] **************************************** 2016-04-29 11:53:20,132 p=30641 u=smanjee | changed: [node1] => (item=@load Bro/Kafka/logs-to-kafka.bro) 2016-04-29 11:53:20,203 p=30641 u=smanjee | changed: [node1] => (item=redef Kafka::logs_to_send = set(HTTP::LOG, DNS::LOG);) 2016-04-29 11:53:20,273 p=30641 u=smanjee | changed: [node1] => (item=redef Kafka::topic_name = "bro";) 2016-04-29 11:53:20,376 p=30641 u=smanjee | changed: [node1] => (item=redef Kafka::tag_json = T;) 2016-04-29 11:53:20,476 p=30641 u=smanjee | changed: [node1] => (item=redef Kafka::kafka_conf = table(["metadata.broker.list"] = "node1:6667");) 2016-04-29 11:53:20,480 p=30641 u=smanjee | TASK [bro : include] *********************************************************** 2016-04-29 11:53:20,555 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/bro/tasks/start-bro.yml for node1 2016-04-29 11:53:20,602 p=30641 u=smanjee | TASK [bro : Turn on promiscuous mode for eth1] ********************************* 2016-04-29 11:53:20,914 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:20,919 p=30641 u=smanjee | TASK [bro : Start bro] ********************************************************* 2016-04-29 11:53:23,138 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:23,142 p=30641 u=smanjee | TASK [bro : Bro Cronjob] ******************************************************* 2016-04-29 11:53:23,812 p=30641 u=smanjee | changed: [node1] => (item=/usr/local/bro/bin/broctl cron) 2016-04-29 11:53:23,881 p=30641 u=smanjee | changed: [node1] => (item=rm -rf /usr/local/bro/spool/tmp/*) 2016-04-29 11:53:23,887 p=30641 u=smanjee | TASK [flume : Retrieve HDP repository definition] ****************************** 2016-04-29 11:53:24,589 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:24,593 p=30641 u=smanjee | TASK [flume : Install flume] *************************************************** 2016-04-29 11:53:53,306 p=30641 u=smanjee | changed: [node1] => (item=[u'flume', u'flume-agent']) 2016-04-29 11:53:53,309 p=30641 u=smanjee | TASK [flume : Create flume-env.sh] ********************************************* 2016-04-29 11:53:53,528 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:53,531 p=30641 u=smanjee | TASK [flume : Configure flume-env.sh] ****************************************** 2016-04-29 11:53:53,812 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'^.*export JAVA_HOME=.*$', u'line': u'export JAVA_HOME=/usr/jdk64/jdk1.8.0_40'}) 2016-04-29 11:53:53,816 p=30641 u=smanjee | TASK [flume : Create flume service] ******************************************** 2016-04-29 11:53:54,040 p=30641 u=smanjee | changed: [node1] => (item=cp /usr/hdp/current/flume-server/etc/rc.d/init.d/flume-agent /etc/init.d/) 2016-04-29 11:53:54,043 p=30641 u=smanjee | TASK [flume : Remove default flume configuration] ****************************** 2016-04-29 11:53:54,309 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:54,314 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 11:53:54,396 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,399 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:54,465 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,468 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 11:53:54,592 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,595 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:54,660 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,663 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 11:53:54,757 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,760 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:54,826 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,830 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 11:53:54,912 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,915 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:54,980 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:54,983 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 11:53:55,067 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,070 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:55,134 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,137 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 11:53:55,220 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,223 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:55,288 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,291 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:53:55,374 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,377 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:55,441 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,445 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:55,510 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,514 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 11:53:55,596 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,600 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:55,665 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,669 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 11:53:55,751 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,755 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:55,822 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,825 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:53:55,906 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,910 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:55,974 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:55,977 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:53:56,043 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:56,047 p=30641 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 11:53:56,113 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:56,118 p=30641 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 11:53:56,169 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:56,173 p=30641 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 11:53:56,233 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:53:56,237 p=30641 u=smanjee | TASK [snort : include] ********************************************************* 2016-04-29 11:53:56,321 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/snort/tasks/daq.yml for node1 2016-04-29 11:53:56,336 p=30641 u=smanjee | TASK [snort : Download daq] **************************************************** 2016-04-29 11:53:58,307 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:53:58,311 p=30641 u=smanjee | TASK [snort : Build daq] ******************************************************* 2016-04-29 11:54:12,273 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:54:12,278 p=30641 u=smanjee | TASK [snort : Install daq] ***************************************************** 2016-04-29 11:54:14,321 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:54:14,325 p=30641 u=smanjee | TASK [snort : include] ********************************************************* 2016-04-29 11:54:14,427 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/snort/tasks/snort.yml for node1 2016-04-29 11:54:14,460 p=30641 u=smanjee | TASK [snort : Download snort] ************************************************** 2016-04-29 11:54:17,590 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:54:17,595 p=30641 u=smanjee | TASK [snort : Build snort] ***************************************************** 2016-04-29 11:55:46,752 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:46,757 p=30641 u=smanjee | TASK [snort : Install snort] *************************************************** 2016-04-29 11:55:49,600 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:49,604 p=30641 u=smanjee | TASK [snort : Download snort community rules] ********************************** 2016-04-29 11:55:51,281 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:51,286 p=30641 u=smanjee | TASK [snort : Extract tarball] ************************************************* 2016-04-29 11:55:51,943 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:51,948 p=30641 u=smanjee | TASK [snort : Install snort rules] ********************************************* 2016-04-29 11:55:53,167 p=30641 u=smanjee | changed: [node1] => (item=cp -r community-rules/community.rules /etc/snort/rules) 2016-04-29 11:55:53,247 p=30641 u=smanjee | changed: [node1] => (item=touch /etc/snort/rules/white_list.rules) 2016-04-29 11:55:53,323 p=30641 u=smanjee | changed: [node1] => (item=touch /etc/snort/rules/black_list.rules) 2016-04-29 11:55:53,400 p=30641 u=smanjee | changed: [node1] => (item=touch /var/log/snort/alerts) 2016-04-29 11:55:53,479 p=30641 u=smanjee | changed: [node1] => (item=chown -R snort:snort /etc/snort) 2016-04-29 11:55:53,485 p=30641 u=smanjee | TASK [snort : Uncomment all snort community rules] ***************************** 2016-04-29 11:55:53,871 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:53,875 p=30641 u=smanjee |  [WARNING]: Consider using template or lineinfile module rather than running sed  2016-04-29 11:55:53,879 p=30641 u=smanjee | TASK [snort : Download snort configuration] ************************************ 2016-04-29 11:55:54,405 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:54,410 p=30641 u=smanjee | TASK [snort : Configure network] *********************************************** 2016-04-29 11:55:54,806 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:54,811 p=30641 u=smanjee | TASK [snort : Configure alerting] ********************************************** 2016-04-29 11:55:55,207 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:55,212 p=30641 u=smanjee | TASK [snort : Configure sysconfig] ********************************************* 2016-04-29 11:55:56,258 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'^ALERTMODE=.*$', u'line': u'ALERTMODE='}) 2016-04-29 11:55:56,338 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'^NO_PACKET_LOG=.*$', u'line': u'NO_PACKET_LOG=1'}) 2016-04-29 11:55:56,419 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'^INTERFACE=.*$', u'line': u'INTERFACE=eth1'}) 2016-04-29 11:55:56,424 p=30641 u=smanjee | TASK [snort : include] ********************************************************* 2016-04-29 11:55:56,508 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/snort/tasks/flume.yml for node1 2016-04-29 11:55:56,555 p=30641 u=smanjee | TASK [snort : Install flume configurations] ************************************ 2016-04-29 11:55:57,190 p=30641 u=smanjee | changed: [node1] => (item={u'dest': u'/etc/flume/conf/flume-snort.conf', u'src': u'flume-snort.conf'}) 2016-04-29 11:55:57,195 p=30641 u=smanjee | TASK [snort : Configure destination for snort alerts] ************************** 2016-04-29 11:55:58,275 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'^snort\\.sinks\\.kafka-sink\\.brokerList.*$', u'line': u'snort.sinks.kafka-sink.brokerList = node1:6667'}) 2016-04-29 11:55:58,375 p=30641 u=smanjee | ok: [node1] => (item={u'regexp': u'^snort\\.sinks\\.kafka-sink\\.topic.*$', u'line': u'snort.sinks.kafka-sink.topic = snort'}) 2016-04-29 11:55:58,455 p=30641 u=smanjee | changed: [node1] => (item={u'regexp': u'^snort.sources.exec-source.command.*$', u'line': u'snort.sources.exec-source.command = tail -F /var/log/snort/alert.csv'}) 2016-04-29 11:55:58,461 p=30641 u=smanjee | TASK [snort : Turn on promiscuous mode for eth1] ******************************* 2016-04-29 11:55:58,690 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:55:58,693 p=30641 u=smanjee | TASK [snort : Start snort] ***************************************************** 2016-04-29 11:56:01,347 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:56:01,351 p=30641 u=smanjee | TASK [snort : Start flume service to consume snort alerts] ********************* 2016-04-29 11:56:01,741 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:56:01,747 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get cluster name] ********************** 2016-04-29 11:56:01,852 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:01,856 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:01,929 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:01,933 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode hosts] ******************** 2016-04-29 11:56:02,025 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,028 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:02,102 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,106 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site tag] ************ 2016-04-29 11:56:02,199 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,203 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:02,271 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,274 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get namenode core-site properties] ***** 2016-04-29 11:56:02,361 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,365 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:02,433 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,436 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka broker hosts] **************** 2016-04-29 11:56:02,522 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,525 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:02,607 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,611 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker tag] ************ 2016-04-29 11:56:02,707 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,710 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:02,780 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,785 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:56:02,878 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,882 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:02,954 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:02,958 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:03,036 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,039 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper hosts] ******************* 2016-04-29 11:56:03,138 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,142 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:03,214 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,218 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get zookeeper zoo.cfg tag] ************* 2016-04-29 11:56:03,305 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,309 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:03,384 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,388 p=30641 u=smanjee | TASK [ambari_gather_facts : Ambari rest get kafka kafka-broker properties] ***** 2016-04-29 11:56:03,477 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,480 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:03,548 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,552 p=30641 u=smanjee | TASK [ambari_gather_facts : set_fact] ****************************************** 2016-04-29 11:56:03,621 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,624 p=30641 u=smanjee | TASK [ambari_gather_facts : debug] ********************************************* 2016-04-29 11:56:03,692 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,698 p=30641 u=smanjee | TASK [kafka-client : Retrieve HDP repository definition] *********************** 2016-04-29 11:56:03,750 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,753 p=30641 u=smanjee | TASK [kafka-client : Install kafka] ******************************************** 2016-04-29 11:56:03,818 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:56:03,822 p=30641 u=smanjee | TASK [yaf : include] *********************************************************** 2016-04-29 11:56:03,911 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/yaf/tasks/fixbuf.yml for node1 2016-04-29 11:56:03,924 p=30641 u=smanjee | TASK [yaf : Download fixbuf] *************************************************** 2016-04-29 11:56:06,664 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:56:06,668 p=30641 u=smanjee | TASK [yaf : Extract fixbuf tarball] ******************************************** 2016-04-29 11:56:07,411 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:56:07,415 p=30641 u=smanjee | TASK [yaf : Compile and Install fixbuf] **************************************** 2016-04-29 11:56:15,472 p=30641 u=smanjee | changed: [node1] => (item=./configure) 2016-04-29 11:56:15,552 p=30641 u=smanjee | changed: [node1] => (item=make) 2016-04-29 11:56:15,631 p=30641 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 11:56:15,636 p=30641 u=smanjee | TASK [yaf : include] *********************************************************** 2016-04-29 11:56:15,731 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/yaf/tasks/yaf.yml for node1 2016-04-29 11:56:15,759 p=30641 u=smanjee | TASK [yaf : Download yaf] ****************************************************** 2016-04-29 11:56:17,858 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:56:17,863 p=30641 u=smanjee | TASK [yaf : Extract yaf tarball] *********************************************** 2016-04-29 11:56:18,777 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:56:18,782 p=30641 u=smanjee | TASK [yaf : Compile and install yaf] ******************************************* 2016-04-29 11:57:07,620 p=30641 u=smanjee | changed: [node1] => (item=./configure --enable-applabel --enable-plugins) 2016-04-29 11:57:07,704 p=30641 u=smanjee | changed: [node1] => (item=make) 2016-04-29 11:57:07,784 p=30641 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 11:57:07,790 p=30641 u=smanjee | TASK [yaf : Create yaf home directory] ***************************************** 2016-04-29 11:57:08,247 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:08,252 p=30641 u=smanjee | TASK [yaf : Install yaf start script] ****************************************** 2016-04-29 11:57:08,751 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:08,756 p=30641 u=smanjee | TASK [yaf : Install init.d service script] ************************************* 2016-04-29 11:57:09,254 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:09,259 p=30641 u=smanjee | TASK [yaf : Register the service with systemd] ********************************* 2016-04-29 11:57:09,430 p=30641 u=smanjee | skipping: [node1] 2016-04-29 11:57:09,436 p=30641 u=smanjee | TASK [yaf : Turn on promiscuous mode for eth1] ********************************* 2016-04-29 11:57:09,766 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:09,771 p=30641 u=smanjee | TASK [yaf : Start yaf] ********************************************************* 2016-04-29 11:57:10,195 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:10,201 p=30641 u=smanjee | TASK [pcap_replay : include] *************************************************** 2016-04-29 11:57:10,263 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/tasks/tcpreplay.yml for node1 2016-04-29 11:57:10,276 p=30641 u=smanjee | TASK [pcap_replay : Download tcpreplay] **************************************** 2016-04-29 11:57:12,692 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:12,696 p=30641 u=smanjee | TASK [pcap_replay : Extract tcpreplay tarball] ********************************* 2016-04-29 11:57:13,497 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:13,502 p=30641 u=smanjee | TASK [pcap_replay : Compile and install tcpreplay] ***************************** 2016-04-29 11:57:34,931 p=30641 u=smanjee | changed: [node1] => (item=./configure --prefix=/opt) 2016-04-29 11:57:34,964 p=30641 u=smanjee | changed: [node1] => (item=make) 2016-04-29 11:57:34,995 p=30641 u=smanjee | changed: [node1] => (item=make install) 2016-04-29 11:57:34,999 p=30641 u=smanjee | TASK [pcap_replay : include] *************************************************** 2016-04-29 11:57:35,052 p=30641 u=smanjee | included: /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/tasks/service.yml for node1 2016-04-29 11:57:35,073 p=30641 u=smanjee | TASK [pcap_replay : Create pcap directory] ************************************* 2016-04-29 11:57:35,378 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:35,382 p=30641 u=smanjee | TASK [pcap_replay : Install init.d service script] ***************************** 2016-04-29 11:57:35,795 p=30641 u=smanjee | changed: [node1] 2016-04-29 11:57:35,799 p=30641 u=smanjee | TASK [pcap_replay : Install example pcap file] ********************************* 2016-04-29 11:57:35,918 p=30641 u=smanjee | fatal: [node1]: FAILED! => {"failed": true, "msg": "ERROR! error while accessing the file /Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/files/example.pcap, error was: [Errno 13] Permission denied: u'/Users/smanjee/Documents/Hortonworks/Products/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/pcap_replay/files/example.pcap'"} 2016-04-29 11:57:35,920 p=30641 u=smanjee | PLAY RECAP ********************************************************************* 2016-04-29 11:57:35,920 p=30641 u=smanjee | node1 : ok=189 changed=108 unreachable=0 failed=1