Support Questions

Find answers, ask questions, and share your expertise

What is the Best Practice for Querying NiFi 1.0.0 REST API for Provenance Events

avatar
Master Guru

I would like to get a list of all provenance events

https://nifi.apache.org/docs/nifi-docs/rest-api/index.html

Ideally I would like to ingest them with NIFI and store them in HDFS.

Is there an example of POST /provenance?

1 ACCEPTED SOLUTION

avatar

Hi @Timothy Spann, take a look at this answer I just provided for a similar question.

Although, you should also look at SiteToSiteProvenanceReportingTask, which allows you "export" them from the NiFi provenance repository and ingest them into a NiFi instance (could be remote, could be same) as pure data and then manipulate them as you would any other data (e.g. feed to PutHDFS).

View solution in original post

2 REPLIES 2

avatar

Hi @Timothy Spann, take a look at this answer I just provided for a similar question.

Although, you should also look at SiteToSiteProvenanceReportingTask, which allows you "export" them from the NiFi provenance repository and ingest them into a NiFi instance (could be remote, could be same) as pure data and then manipulate them as you would any other data (e.g. feed to PutHDFS).

avatar
Expert Contributor

Hi @Timothy Spann, this is an old post of yours, but I've a similar need as you posted here; I wanted to know if you were able to come up with a working version of a dataflow that queries NiFi API provenance events; if you did, I appreciate if you could share some info about that. Thanks in advance.