Support Questions

Find answers, ask questions, and share your expertise

Log Analysis - Data Ingestion

avatar
Expert Contributor

Hi,

We are planning to do a prototype of Hadoop Log Analysis and not sure which Data ingestion tool should we select - Nifi or Flume. Can anyone suggest me which one we select and why - pros and cons

Thanks,

Chandra

1 ACCEPTED SOLUTION

avatar
Master Mentor

Apache Nifi is more feature-rich, battle tested and servers many purposes. Simply, it has bidirectional flow whereas Flume only moves data to HDFS. There's also visual UI for real time command and control as opposed to Flume with only configuration property files to deal with. If you are in the beginning stages, do yourself a favor and go with Nifi.

View solution in original post

1 REPLY 1

avatar
Master Mentor

Apache Nifi is more feature-rich, battle tested and servers many purposes. Simply, it has bidirectional flow whereas Flume only moves data to HDFS. There's also visual UI for real time command and control as opposed to Flume with only configuration property files to deal with. If you are in the beginning stages, do yourself a favor and go with Nifi.