Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

KAFKA KSQL within NIFI flow

Explorer

Hi,

We need to execute KSQL querier to filter our KAFKA streams within NiFi.

How can we achive this . Should we implement custom processor.

Regards,

4 REPLIES 4

Hi @yazeed salem

NiFi has a processor call QueryRecord that can be used to do SQL on data coming from Kafka : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.7.1/org.apache...

This is not KSQL.

Thanks

Abdelkrim

Explorer

Hi @Abdelkrim Hadjidj
So for KSQL, should we implement custom NiFi's processor.

Thanks,

Why would you like to have KSQL in NiFi ?

Explorer

Hi @Abdelkrim Hadjidj

In our NiFi flow we need to store some flow files which represent UN-completed messages to KAFKA Topic, after that we need to query our KAFKA topic from NiFi Flow to check the messaged is completed or not, if the messages completed we will continue the NiFi flow.
So we need to use the KSQL to query the KAFKA TOPIC for the messages completed to process them.
Your feedback is highly appreciated.