KAFKA KSQL within NIFI flow

[#1]

Hi,

We need to execute KSQL querier to filter our KAFKA streams within NiFi.

How can we achive this . Should we implement custom processor.

Regards,

[#2]

Hi @yazeed salem

NiFi has a processor call QueryRecord that can be used to do SQL on data coming from Kafka : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.7.1/org.apache...

This is not KSQL.

Thanks

Abdelkrim

[#3]

Hi @Abdelkrim Hadjidj
So for KSQL, should we implement custom NiFi's processor.

Thanks,

[#4]

Why would you like to have KSQL in NiFi ?

[#5]

Hi @Abdelkrim Hadjidj

In our NiFi flow we need to store some flow files which represent UN-completed messages to KAFKA Topic, after that we need to query our KAFKA topic from NiFi Flow to check the messaged is completed or not, if the messages completed we will continue the NiFi flow.
So we need to use the KSQL to query the KAFKA TOPIC for the messages completed to process them.
Your feedback is highly appreciated.