Is it possible to ingest data into kafka from REST API calls?

[#1]

HDP 2.3.2

We have data sitting on prem and we are planning to ingest data into Kafka using REST calls? Kafka will be running in the cloud.

[#2]

Nifi is not the option yet.

[#3]

@Neeraj Sabharwal nifi example working with csv does that https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates

[#4]

@Neeraj Sabharwal OK I see your nifi comment

[#5]

@Guilherme Braccialli

Guil shared some ideas on using Flume.

[#6]

please close @Neeraj Sabharwal

[#7]

@Artem Ervits updated...feel free to accept my answer

[#8 · Accepted solution]

@Artem Ervits

This is the answer that I got from the client https://github.com/confluentinc/kafka-rest

That's the answer without buying HDF.

[#9]

Does Confluent Inc Support cost extra if someone wants to install this in Production? Is there a hortonworks out of the box solution to get RESTful APIs data to be ingested into HDFS.

[#10]

Nifi and Kafka example for pulling REST API end point data -

https://dzone.com/articles/real-time-stock-processing-with-apache-nifi-and-ap