What types of data ingestion I can use ?

[#1]

Can I use Kafka without nifi for data ingestion ?

[#2]

@max mouse

YES, you can use Kafka connectors to read from or write to external systems, manage data flow, and scale the system—all without writing new code. The most popular use case is ETL pipelines. Kafka is a perfect tool for building data pipelines as it’s reliable, scalable, and efficient.
Check https://www.confluent.io/product/confluent-platform/

[#3]

thank you, so I do not need NiFi in this case scenario ?

[#4 · Accepted solution]

In the above Architecture, there is no nifi !! Apache NiFi and Apache Kafka are two different tools with different use-cases that may slightly overlap.

Combining tools may appear wasteful, as it seems to introduce some overlap in functionality. For example, both NiFi and Kafka provide brokers to connect producers and consumers. However, they do so differently: in NiFi, the bulk of the data flow logic lays not inside the producer/consumer, but lives in the broker, allowing for centralized control.

NiFi was built to do one important thing well: data flow management. With both tools combined, NiFi can take advantage of Kafka’s reliable stream data storage, while taking care of the data flow challenges that Kafka was not designed to solve.

HTH

If you found this answer addressed your question, please take a moment to log in and click the "accept" link on the answer.

[#5]

@max mouse

There isn’t a one-and-only tool that can do everything equally well and address all of your requirements. Combining tools that do different things in better ways allows for a buildup in functionality and increased flexibility in handling a larger set of scenarios. Depending on your needs, both NiFi and Flume can act as Kafka producers and/or consumers.

HTH