Member since
09-29-2015
19
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
698 | 04-27-2016 08:59 PM |
06-06-2019
10:49 PM
@Donny Lie Sorry for the delay in following up on your comment. Can you tell me what information is missing from the installation documentation. Was this for the actual HCP installation or the configuration and set up? I would welcome any feedback you can provide so I can improve/correct the documentation.
... View more
05-30-2017
11:21 PM
Hi @HS, Thank you for your comment on our Metron documentation. Sorry the delay in responding to you. I've raised your question to the Dev team and I hope to have an answer for you shortly.
... View more
07-15-2016
11:50 PM
I want Pig to use HCatalog in my Oozie workflow
... View more
Labels:
- Labels:
-
Apache HCatalog
-
Apache Oozie
-
Apache Pig
07-15-2016
01:05 AM
I am working on adding a Squid telemetry to an Ambari-managed cluster on AWS. I've parsed and transformed the Squid message, but I am getting the following error message when I attempt to push it to Zookeeper: [root@ip-10-0-0-90 ~]# /usr/metron/0.2.0BETA/bin/zk_load_configs.sh -i /usr/metron/0.2.0BETA/config/zookeeper -m PUSH -z ec2-xx-xx-xxx-xxx.us-west-2.compute.amazonaws.com:2181 log4j:WARN No appenders could be found for logger (org.apache.curator.framework.imps.CuratorFrameworkImpl). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. I checked the referenced Apache FAQ and found the following answer: Why do I see a warning about "No appenders found for logger" and "Please configure log4j properly"? This occurs when the default configuration files log4j.properties and log4j.xml can not be found and the application performs no explicit configuration. log4j uses Thread.getContextClassLoader().getResource() to locate the default configuration files and does not directly check the file system. Knowing the appropriate location to place log4j.properties or log4j.xml requires understanding the search strategy of the class loader in use. log4j does not provide a default configuration since output to the console or to the file system may be prohibited in some environments.
Not quite sure how to resolve this. Any help would be appreciated. Thanks!
... View more
- Tags:
- CyberSecurity
- Metron
Labels:
- Labels:
-
Apache Metron
06-03-2016
07:56 PM
@apsaltis After some research I discovered the easiest way to ensure that Squid is assigned a worker is to kill one or more of the existing topologies. The Storm Supervisor will then assign one of the free workers to Squid. You can kill a topology either in the Storm UI or in the CLI. I will add a step to cover this in the article. Thanks again for your comments.
... View more
05-25-2016
05:15 PM
@Rob Becker How did you resolve this issue? Someone suggested either deactivating or killing another of the topologies to free up a worker. I tried both and neither works. Did you add another port? If so, how? Thanks for your help.
... View more
05-13-2016
09:56 PM
@apsaltis , Thanks for your comment. I believe you're correct and we need an additional step to add a port. I'm researching the best way to add that port and I will modify that step when I have my results. Thanks for your help.
... View more
05-13-2016
09:41 PM
1 Kudo
@apsaltis I'm modifying my previous reply. To deploy the new squid parser topology, you do not need to use "sudo" anywhere except at the very beginning of the command string. I tried it twice as is and it worked perfectly both times. Thank you for your feedback though. We really appreciate you taking the time to comment on the instructions so we can improve them.
... View more
05-10-2016
05:03 PM
@apsaltis When I downloaded the tar file it was named "incubator-metron-codelab-v1.0.tar.gz" which means the example to untar the file should be correct. Would you please check your download again to confirm that it is named "codelab-v1.0.tar.gz". Thanks!
... View more
04-27-2016
08:59 PM
1 Kudo
Performed installation on desktop rather than on VM and installation succeeded.
... View more
04-22-2016
05:18 PM
@jsirota Could you point me to someone who can help with this. I'm blocked on my installation until I get this resolved. Thanks!
... View more
04-21-2016
06:42 PM
On rerunning the build application step (mvn apache-rat:check && cd metron-streaming && mvn clean integration-test && cd ..) this morning, I received the following error message: [ERROR] Failed to execute goal on project Metron-Common: Could not resolve dependencies for project org.apache.metron:Metron-Common:jar:0.1BETA: Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el6_7.x86_64/jre/../lib/tools.jar -> [Help 1] I reran the final command (mvn clean integration-test) with -e and received the following information: "Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el6_7.x86_64/jre/../lib/tools.jar" I verified that my JAVA_HOME is set correctly: [root@c6501 metron-streaming]# echo $JAVA_HOME /usr/lib/jvm/jre-1.8.0-openjdk.x86_64 The prerequisites state that JAVA 1.8 should be installed. However, the error message seems to indicate that the build is looking for Java 1.7. Do I need to install Java 1.7 rather than Java 1.8?
... View more
04-19-2016
10:38 PM
1 Kudo
I am trying to install Metron on a Vagrant single-node. I received the following error message during the application build step (mvn apache-rat:check && cd metron-streaming && mvn clean integration-test && cd ..,). I am running Maven 3.3.9. [ERROR] No plugin found for prefix 'apache-rat' in the current project and in the plugin groups [org.apache.maven.plugins, org.codehaus.mojo] available from the repositories [local (/root/.m2/repository), central (https://repo.maven.apache.org/maven2)] -> [Help 1]
... View more
Labels:
- Labels:
-
Apache Metron
04-13-2016
04:59 PM
@nallen Thanks for your help. I ran the command you provided and received the following information: /etc/init.d/ambari-server: line 53: /var/lib/ambari-server/ambari-env.sh: Permission denied
Using python /usr/bin/python2.6
Ambari-server status
Ambari Server not running. Stale PID File at: /var/run/ambari-server/ambari-server.pid Is the issue the "Permission denied" or the "Ambari Server not running"? Can you tell me how to fix this? Thanks for your help.
... View more
04-13-2016
12:54 AM
I found the EC2 Dashboard and looked at the Status check for ec2-52-38-224-98.us-west. Both the System Status Checks and the Instance Status Checks passed. So, I think I should be able to access that address. Any suggestions on how I should proceed? Thanks!
... View more
04-12-2016
08:21 PM
Thanks for your reply. How do I check to make sure the user is actually available? I've looked on the IAM site and checked the user. It appears to be active (Status=Active). And the last used date is today
... View more
04-12-2016
08:20 PM
Thanks for your reply. How do I check to make sure the user is actually available? I've looked on the IAM site and checked the user. It appears active. And the last used date is today.
... View more
04-12-2016
07:22 PM
I am getting the following error when I perform the Apache Metron deployment process: TASK [ambari_master : check if ambari-server is up on ec2-52-38-224-98.us-west-2.compute.amazonaws.com:8080] ***
fatal: [ec2-52-38-224-98.us-west-2.compute.amazonaws.com]: FAILED! => {"changed": false, "elapsed": 300, "failed": true, "msg": "Timeout when waiting for ec2-52-38-224-98.us-west-2.compute.amazonaws.com:8080"} Does this mean that one of my AWS EC2 users is not online or responsive or accessible? If so, how do I fix that?
... View more
Labels:
- Labels:
-
Apache Metron