Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Is it possible to ingest data into kafka from REST API calls?

avatar
Master Mentor

HDP 2.3.2

We have data sitting on prem and we are planning to ingest data into Kafka using REST calls? Kafka will be running in the cloud.

1 ACCEPTED SOLUTION

avatar
Master Mentor
@Artem Ervits

This is the answer that I got from the client https://github.com/confluentinc/kafka-rest

That's the answer without buying HDF.

View solution in original post

10 REPLIES 10

avatar
Master Mentor

Nifi is not the option yet.

avatar
Master Mentor

avatar
Master Mentor

@Neeraj Sabharwal OK I see your nifi comment

avatar
Master Mentor
@Guilherme Braccialli

Guil shared some ideas on using Flume.

avatar
Master Mentor

please close @Neeraj Sabharwal

avatar
Master Mentor

@Artem Ervits updated...feel free to accept my answer

avatar
Master Mentor
@Artem Ervits

This is the answer that I got from the client https://github.com/confluentinc/kafka-rest

That's the answer without buying HDF.

avatar
Super Collaborator

Does Confluent Inc Support cost extra if someone wants to install this in Production? Is there a hortonworks out of the box solution to get RESTful APIs data to be ingested into HDFS.

avatar

Nifi and Kafka example for pulling REST API end point data -

https://dzone.com/articles/real-time-stock-processing-with-apache-nifi-and-ap