- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to integrate Nifi with delta table (delta lake) to read data?
- Labels:
-
Apache NiFi
Created ‎07-10-2023 11:10 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello experts,
One of our client has data stored in delta table(delta lake), I am totally new to delta lake part.
Do we have any option in nifi to read data from delta lake or is there any sample 3rd party implementation available for the same for nifi?
Thanks,
Mahendra
Created ‎07-10-2023 01:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@hegdemahendra
There currently are no NiFi processors for ingesting from Delta Lake. There is an existing Apache Jira for creating such list/fetch processors for Delta Lake, but it is still open and does not look to be actively being worked on:
https://issues.apache.org/jira/browse/NIFI-7093
I am not aware of any open source 3rd party options here as well.
If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.
Thank you,
Matt
Created ‎07-10-2023 01:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@hegdemahendra
There currently are no NiFi processors for ingesting from Delta Lake. There is an existing Apache Jira for creating such list/fetch processors for Delta Lake, but it is still open and does not look to be actively being worked on:
https://issues.apache.org/jira/browse/NIFI-7093
I am not aware of any open source 3rd party options here as well.
If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.
Thank you,
Matt
