Member since
02-17-2016
12
Posts
16
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1734 | 09-12-2016 06:35 AM | |
9000 | 07-07-2016 01:19 PM | |
4682 | 07-07-2016 06:30 AM |
09-16-2016
09:53 AM
1 Kudo
you can try out the following to deploy pycapa later :- Navigate to metron-deployment folder Run the following command if you deployed metron using quick-dev-deployment env earlier ansible-playbook -i inventory/full-dev-platform --tags=“pycapa” playbooks/metron_full_install -vvv
Note:- you can use the above command to run the skipped ansible tags.Just make sure to provide the tags comma separated to the --tags parameter. Hope this helps. Regards, Neha
... View more
09-16-2016
07:15 AM
4 Kudos
@Naveen Maheswaran If you want to skip the pycapa role installation , you can edit the run.sh file at /metron-deployment/vagrant/quick-dev-platform/run.sh and add "pycapa" to the list of "--ansible-skip-tags". Your edited run.sh file should look like below :- vagrant \
--ansible-tags="hdp-deploy,metron" \
--ansible-skip-tags="solr,pycapa" \
up Run the quick-dev-deployment after making the mentioned changes. Please let me know if this serves your purpose. Regards, Neha
... View more
09-12-2016
06:35 AM
1 Kudo
@Jon Zeolla Hi, You can bypass enrichment for bro by following the below steps :- 1.Establish SSH connection to the node where metron service(s) is installed. 2.On the specified node navigate to the following path :- /usr/metron/0.2.0BETA/config/zookeeper/enrichments 3.Create a backup of the existing bro.json file in some directory so that you can use it later. 4.Now edit the bro.json file and change the content to the following :- {
"index": "bro",
"batchSize": 5
} 5.Now execute the following command to push the config to the zookeeper :- /usr/metron/0.2.0BETA/bin/zk_load_configs.sh -z ZOOKEEPER_HOST:2181 -m PUSH -i /usr/metron/0.2.0BETA/config/zookeeper/
Please replace the ZOOKEEPER_HOST text with your zookeeper node hostname. 6.Perform the following command to make sure the config got pushed all good to zookeeper and no errors are seen. /usr/metron/0.2.0BETA/bin/zk_load_configs.sh -z ZOOKEEPER_HOST:2181 -m DUMP Since the current bro.json file @/usr/metron/0.2.0BETA/config/zookeeper/enrichments/bro.json does not contain any mention of enrichment so enrichment should be by passed for the the Bro logs. Please let me know if the above steps solves the issue you are facing. Regards, neha
... View more
08-16-2016
06:43 AM
1 Kudo
@Farrukh Anjum Hi Farrukh, Could you please ensure you are running the metron installation with the following versions of ansible and vagrant? ansible= 2.0.0.2
Vagrant =1.8.1 Inorder to debug the mentioned issue,will need the log at the verbose level so would request you to run ansible provisioning by adding the following line in your Vagrantfile.(metron-deployment/vagrant/quick-dev-platform/Vagrantfile) ansible.verbose = "vvv" Regards, Neha
... View more
07-14-2016
09:13 AM
@Neeraj Sabharwal Hi Neeraj, You can look up my comment for the following thread incase you still facing the same issue :- https://community.hortonworks.com/questions/45060/metron-errors-while-running-vagrant-up-provision.html#answer-45145 Regards, Neha
... View more
07-07-2016
01:19 PM
4 Kudos
@Neeraj Sabharwal Hi Neeraj, Do you see any response when you put the following url in your browser :- http://node1:9200/_cat/health For example you should see some output like this :- 1467897265 13:14:25 metron yellow 1 1 5 5 0 0 5 0 - 50.0% it might be a case where the system is slow and it's taking more time than expected. If it's due to slowness then you might have to increase the timeout in the following file and rerun the deployment :- metron-deployment/roles/metron_elasticsearch_templates/tasks/load_templates.yml Regards, Neha
... View more
07-07-2016
11:00 AM
1 Kudo
@Neeraj Sabharwal Hi Neeraj, Kindly upgrade your setuptools to a version >=11.3. In my environment I am running ansible 2.0.0.2 with setuptools (24.0.0). Regards, Neha
... View more
07-07-2016
06:30 AM
1 Kudo
@Neeraj Sabharwal Hi Neeraj, Could you please check ansible version you are running the code with?(ansible --version) For metron deployment, ansible 2.0.0.2 is required. Note :- If you perform a "pip install ansible"...It installs ansible-2.1.0.0 and we happen to come across the issue you mentioned. Incase you have a different version of ansible installed than 2.0.0.2,please perform the following steps and rerun the metron deployment :- pip uninstall ansible pip install ansible==2.0.0.2 Regards, Neha
... View more
02-18-2016
06:45 AM
1 Kudo
I am using HW Hadoop 2.6 and use distcp to transfer files to S3. I am using the following command to transfer files: hadoop distcp -D mapred.job.queue.name="somename" -Dfs.s3n.awsAccessKeyId="xxxx" -Dfs.s3n.awsSecretAccessKey="xxxx" -m "100" -update -pugp "hdfs:///path-in-hdfs" "s3n://path-to-s3" Does this command transfer the data securely using https ssl/tls over port 443? Or do I need to develop a mechanism to encrypt the data before transferring?
... View more
Labels:
- Labels:
-
Apache Hadoop