Support Questions

Find answers, ask questions, and share your expertise

How to integrate Nifi with delta table (delta lake) to read data?

avatar
Master Collaborator

Hello experts,

 

One of our client has data stored in delta table(delta lake), I am totally new to delta lake part.
Do we have any option in nifi to read data from delta lake or is there any sample 3rd party implementation available for the same for nifi?

 

Thanks,

Mahendra

1 ACCEPTED SOLUTION

avatar
Master Mentor

@hegdemahendra 

There currently are no NiFi processors for ingesting from Delta Lake.  There is an existing Apache Jira for creating such list/fetch processors for Delta Lake, but it is still open and does not look to be actively being worked on:
https://issues.apache.org/jira/browse/NIFI-7093

I am not aware of any open source 3rd party options here as well.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

View solution in original post

1 REPLY 1

avatar
Master Mentor

@hegdemahendra 

There currently are no NiFi processors for ingesting from Delta Lake.  There is an existing Apache Jira for creating such list/fetch processors for Delta Lake, but it is still open and does not look to be actively being worked on:
https://issues.apache.org/jira/browse/NIFI-7093

I am not aware of any open source 3rd party options here as well.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt