question Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? in Archives of Support Questions (Read Only) https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94971#M8245 <P><A rel="user" href="https://community.cloudera.com/users/189/jramakrishnan.html" nodeid="189">@jramakrishnan</A> Do you plan to support Sqoop2 in the near future?</P> Sat, 12 Dec 2015 04:25:22 GMT dorio 2015-12-12T04:25:22Z Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94965#M8239 <P>I want to ingest data from Oracle database to Kafka using Logstash. Wondering if NiFi can perform the ingestion from relational database to Kafka ?</P> Tue, 21 Apr 2026 12:35:39 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94965#M8239 Jagatheeshr 2026-04-21T12:35:39Z Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94966#M8240 <P>Hi, let me make sure I understand the environment. According to <A href="https://www.elastic.co/guide/en/logstash/2.0/plugins-inputs-jdbc.html">https://www.elastic.co/guide/en/logstash/2.0/plugins-inputs-jdbc.html</A> there's nothing in the jdbc plugin to track incremental runs (e.g. only pick up data added/changed since the last run). This has to be built into the query itself (a generic mechanism).</P><P>For this matter NiFi can absolutely serve the purpose, not sure there would be much that LogStash would bring on top.</P><P>There is also another use case, when Oracle transaction log is being followed for real-time replication, which is a very different architecture. E.g. Oracle GoldenGate is one of the best products in its class (I think it works with other DBs as well).</P> Tue, 06 Oct 2015 19:43:35 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94966#M8240 andrewg 2015-10-06T19:43:35Z Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94967#M8241 <P>Have you looked at : <A href="http://www.slideshare.net/gwenshap/kafka-for-dbas" target="_blank">http://www.slideshare.net/gwenshap/kafka-for-dbas</A></P><P>Olivier</P> Tue, 06 Oct 2015 19:58:25 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94967#M8241 orenault 2015-10-06T19:58:25Z Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94968#M8242 <P>Thanks <A rel="user" href="https://community.cloudera.com/users/173/agrande.html" nodeid="173">@agrande@hortonworks.com</A>. Yes. the source data is just a logs of event. Customer do not want to use any paid software(eg GG )</P> Tue, 06 Oct 2015 22:37:20 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94968#M8242 Jagatheeshr 2015-10-06T22:37:20Z Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94969#M8243 <P>@orenault@hortonworks.com. yes but doesnt appear to provide any opensource options.</P> Tue, 06 Oct 2015 22:38:22 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94969#M8243 Jagatheeshr 2015-10-06T22:38:22Z Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94970#M8244 <P>Sqoop2 can do the move to kafka.But we are not there yet to support it .</P> Tue, 06 Oct 2015 22:39:05 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94970#M8244 Jagatheeshr 2015-10-06T22:39:05Z Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94971#M8245 <P><A rel="user" href="https://community.cloudera.com/users/189/jramakrishnan.html" nodeid="189">@jramakrishnan</A> Do you plan to support Sqoop2 in the near future?</P> Sat, 12 Dec 2015 04:25:22 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94971#M8245 dorio 2015-12-12T04:25:22Z Re: Can NiFi be used to pipe the data from Oracle Database to Kafka ? https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94972#M8246 <P>Keep in mind also there is no upgrade path from Sqoop (HDP included) to Sqoop2</P> Fri, 15 Jan 2016 21:57:03 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Can-NiFi-be-used-to-pipe-the-data-from-Oracle-Database-to/m-p/94972#M8246 dcave 2016-01-15T21:57:03Z