Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Process Streaming data by maintaining the order

Process Streaming data by maintaining the order

New Contributor

We have a requirement where in we fetch the log information real time from linux servers via Nifi.(streaming data)

We need to do some business calculation where in we have to substract 2 subsequent time stamps. So it becomes very important to maintain the order. We put the data in Kafka (topic has one partition to maintain ordering) and fetch it from there.

Once data is in Kafka, I would like to know what should I use (Spark Streaming or Storm) to process the data by maintaining the order.

Don't have an account?
Coming from Hortonworks? Activate your account here