How to integrate Nifi with delta table (delta lake) to read data?

hegdemahendra — Mon, 10 Jul 2023 18:10:12 GMT

Hello experts,

One of our client has data stored in delta table(delta lake), I am totally new to delta lake part.
Do we have any option in nifi to read data from delta lake or is there any sample 3rd party implementation available for the same for nifi?

Thanks,

Mahendra

Re: How to integrate Nifi with delta table (delta lake) to read data?

MattWho — Mon, 10 Jul 2023 20:01:59 GMT

@hegdemahendra

There currently are no NiFi processors for ingesting from Delta Lake. There is an existing Apache Jira for creating such list/fetch processors for Delta Lake, but it is still open and does not look to be actively being worked on:
https://issues.apache.org/jira/browse/NIFI-7093

I am not aware of any open source 3rd party options here as well.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

question Re: How to integrate Nifi with delta table (delta lake) to read data? in Support Questions

How to integrate Nifi with delta table (delta lake) to read data?

Re: How to integrate Nifi with delta table (delta lake) to read data?