About ravi_vagadiya4

ravi_vagadiya4 · ‎08-05-2017

@Matt Foley and @Sebastien Lehuede Thanks for sharing the details. I have gone through it. In fact, I have worked on the Squid proxy logs and got it through. In this case, the Grok parser was already there. I want to understand if I have a custom log source and I want to use a Java parser, Where do I need to place my parser (.java) file and what should be my .json file. If there is any document, It would be helpful for me. Regards.

ravi_vagadiya4 · ‎07-29-2017

Hello All, I am new to Metron. I have few log samples and I need to bring those logs to Metron. I want to understand how can I build a parser based on those logs. Where can I find a document about how to create a Grok or Java parser and how to can I use those in Metron? Would appreciate the help. Regards.

ravi_vagadiya4 · ‎07-25-2017

@dbains Thanks for your answer. As of now, the request.timeout.ms=30000 and linger.ms=1 PublishKafka processor properties are as following: Kafka Brokers: 10.2.2.10:6667 Security Protocol: PLAINTEXT Topic Name: test_topic Delivery Guarantee: Best Effort Key Attribute Encoding: UTF-8 Encoded Max Request Size: 1 MB Acknowledgement Wait Time: 5 secs Max Metadata Wait Time: 5 secs Yes, we see same issue for all the topics we tried. Thanks.

ravi_vagadiya4 · ‎07-25-2017

Hi dbains, Thanks for your answer. As of now, the request.timeout.ms=30000 and linger.ms=1 PublishKafka processor properties are as following: Kafka Brokers: 10.2.2.10:6667 Security Protocol: PLAINTEXT Topic Name: test_topic Delivery Guarantee: Best Effort Key Attribute Encoding: UTF-8 Encoded Max Request Size: 1 MB Acknowledgement Wait Time: 5 secs Max Metadata Wait Time: 5 secs Yes, we see same issue for all the topics we tried. Thanks.

ravi_vagadiya4 · ‎07-24-2017

Hello All, We are sending some data from Nifi to Kafka topic using PublishKafka processor. We are getting the following error: PublishKafka Failed to send all messages for StandardFlowFileRecord to Kafka; routing to failure due to org.apache.kafka.common.errors.TimeoutException: Expiring 10 record(s) for test_topic:30011 ms has passed since batch creation plus linger time We have tried increasing the linger time and request.timeout.ms but still facing the issue. Any help would be appreciated.

ravi_vagadiya4 · ‎07-09-2017

Hello, We have been using Nifi to collect syslogs from various devices. Now, we want to collect the Windows Event Viewer logs using Nifi. Is there any Nifi processor available which can dial a connection to remote Windows machine and pull the logs from event viewer? Thanks.

Online	Offline
Last Visited	‎08-05-2017 06:15 AM

Date Registered	‎07-05-2017 12:03 PM
Last Visited	‎08-05-2017 06:15 AM
Total Messages Posted	6

Re: How to use Grok and Java parsers in Metron?

How to use Grok and Java parsers in Metron?

Re: TimeoutException while sending data from Nifi ...

Re: TimeoutException while sending data from Nifi ...

TimeoutException while sending data from Nifi to K...

Collect Windows Event Viewer Logs using Nifi