How to integrate Nifi with delta table (delta lake) to read data?

1 reply
3367 views
Translate All

Hello experts,

One of our client has data stored in delta table(delta lake), I am totally new to delta lake part.
Do we have any option in nifi to read data from delta lake or is there any sample 3rd party implementation available for the same for nifi?

Thanks,

Mahendra

Apache NiFi

MattWhoAnswer

Titanium ⭐️⭐️⭐️

@hegdemahendra

There currently are no NiFi processors for ingesting from Delta Lake. There is an existing Apache Jira for creating such list/fetch processors for Delta Lake, but it is still open and does not look to be actively being worked on:
https://issues.apache.org/jira/browse/NIFI-7093

I am not aware of any open source 3rd party options here as well.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

MattWhoAnswer

Titanium ⭐️⭐️⭐️

@hegdemahendra

There currently are no NiFi processors for ingesting from Delta Lake. There is an existing Apache Jira for creating such list/fetch processors for Delta Lake, but it is still open and does not look to be actively being worked on:
https://issues.apache.org/jira/browse/NIFI-7093

I am not aware of any open source 3rd party options here as well.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

Translate

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.