Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to stream conn, weird and notice log.gz files from NiFi to Metron?

How to stream conn, weird and notice log.gz files from NiFi to Metron?

Explorer

Hello,


I currently have about 15GB of data that is split into conn, weird, and notice log.gz files. I am trying to figure out how to stream this data into Metron. Currently I have a NiFi Processor setup using ListSFTP, FetchSFTP and then decompressing the files. I am not sure what to do next to get the data enriched through Metron. Am I supposed to create Kibana indexes for the logs? Please help me to proceed further with this.

 

Thanks

Don't have an account?
Coming from Hortonworks? Activate your account here