https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Structured-Streaming-vs-NIFI/m-p/129757#M34758 <P><A rel="user" href="https://community.cloudera.com/users/2375/skondapalli.html" nodeid="2375">@Satya KONDAPALLI</A></P><P>Fundamentally, Spark is a data processing engine while NiFi is a data movement tool. Spark is intended for doing complex computations on large amounts of data, combining data sets, applying analytical models, etc. Spark Streaming provides micro batch processing of data to bring this processing closer to real time. NiFi is intended to collect data and move it to the place for it to be processed with some certain modifications or computations on the data as it flows to its final destination.</P> Fri, 15 Jul 2016 02:29:53 GMT emaxwell 2016-07-15T02:29:53Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Structured-Streaming-vs-NIFI/m-p/129756#M34757 <P>Hi </P><P>Spark 2.0 now had structured streaming. How it is different from NIFI file streaming. </P> Fri, 15 Jul 2016 01:15:41 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Structured-Streaming-vs-NIFI/m-p/129756#M34757 ambariCloud 2016-07-15T01:15:41Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Structured-Streaming-vs-NIFI/m-p/129757#M34758 <P><A rel="user" href="https://community.cloudera.com/users/2375/skondapalli.html" nodeid="2375">@Satya KONDAPALLI</A></P><P>Fundamentally, Spark is a data processing engine while NiFi is a data movement tool. Spark is intended for doing complex computations on large amounts of data, combining data sets, applying analytical models, etc. Spark Streaming provides micro batch processing of data to bring this processing closer to real time. NiFi is intended to collect data and move it to the place for it to be processed with some certain modifications or computations on the data as it flows to its final destination.</P> Fri, 15 Jul 2016 02:29:53 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Structured-Streaming-vs-NIFI/m-p/129757#M34758 emaxwell 2016-07-15T02:29:53Z