Member since
07-05-2017
6
Posts
0
Kudos Received
0
Solutions
08-05-2017
06:15 AM
@Matt Foley and @Sebastien Lehuede Thanks for sharing the details. I have gone through it. In fact, I have worked on the Squid proxy logs and got it through. In this case, the Grok parser was already there. I want to understand if I have a custom log source and I want to use a Java parser, Where do I need to place my parser (.java) file and what should be my .json file. If there is any document, It would be helpful for me. Regards.
... View more
07-29-2017
08:25 AM
Hello All, I am new to Metron. I have few log samples and I need to bring those logs to Metron. I want to understand how can I build a parser based on those logs. Where can I find a document about how to create a Grok or Java parser and how to can I use those in Metron? Would appreciate the help. Regards.
... View more
Labels:
07-25-2017
04:43 AM
@dbains Thanks for your answer. As of now, the request.timeout.ms=30000 and linger.ms=1 PublishKafka processor properties are as following:
Kafka Brokers: 10.2.2.10:6667 Security Protocol: PLAINTEXT Topic Name: test_topic Delivery Guarantee: Best Effort Key Attribute Encoding: UTF-8 Encoded Max Request Size: 1 MB Acknowledgement Wait Time: 5 secs Max Metadata Wait Time: 5 secs Yes, we see same issue for all the topics we tried. Thanks.
... View more
07-25-2017
04:39 AM
Hi dbains, Thanks for your answer. As of now, the request.timeout.ms=30000 and linger.ms=1 PublishKafka processor properties are as following:
Kafka Brokers: 10.2.2.10:6667 Security Protocol: PLAINTEXT Topic Name: test_topic Delivery Guarantee: Best Effort Key Attribute Encoding: UTF-8 Encoded Max Request Size: 1 MB Acknowledgement Wait Time: 5 secs Max Metadata Wait Time: 5 secs Yes, we see same issue for all the topics we tried. Thanks.
... View more
07-24-2017
05:38 PM
Hello All, We are sending some data from Nifi to Kafka topic using PublishKafka processor. We are getting the following error: PublishKafka Failed to send all messages for StandardFlowFileRecord to Kafka; routing to failure due to org.apache.kafka.common.errors.TimeoutException: Expiring 10 record(s) for test_topic:30011 ms has passed since batch creation plus linger time We have tried increasing the linger time and request.timeout.ms but still facing the issue. Any help would be appreciated.
... View more
Labels:
07-09-2017
12:11 PM
Hello, We have been using Nifi to collect syslogs from various devices. Now, we want to collect the Windows Event Viewer logs using Nifi. Is there any Nifi processor available which can dial a connection to remote Windows machine and pull the logs from event viewer? Thanks.
... View more
Labels: