Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What is the Best Practice for Querying NiFi 1.0.0 REST API for Provenance Events

Solved Go to solution
Highlighted

What is the Best Practice for Querying NiFi 1.0.0 REST API for Provenance Events

Super Guru

I would like to get a list of all provenance events

https://nifi.apache.org/docs/nifi-docs/rest-api/index.html

Ideally I would like to ingest them with NIFI and store them in HDFS.

Is there an example of POST /provenance?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: What is the Best Practice for Querying NiFi 1.0.0 REST API for Provenance Events

Hi @Timothy Spann, take a look at this answer I just provided for a similar question.

Although, you should also look at SiteToSiteProvenanceReportingTask, which allows you "export" them from the NiFi provenance repository and ingest them into a NiFi instance (could be remote, could be same) as pure data and then manipulate them as you would any other data (e.g. feed to PutHDFS).

View solution in original post

2 REPLIES 2
Highlighted

Re: What is the Best Practice for Querying NiFi 1.0.0 REST API for Provenance Events

Hi @Timothy Spann, take a look at this answer I just provided for a similar question.

Although, you should also look at SiteToSiteProvenanceReportingTask, which allows you "export" them from the NiFi provenance repository and ingest them into a NiFi instance (could be remote, could be same) as pure data and then manipulate them as you would any other data (e.g. feed to PutHDFS).

View solution in original post

Highlighted

Re: What is the Best Practice for Querying NiFi 1.0.0 REST API for Provenance Events

Rising Star

Hi @Timothy Spann, this is an old post of yours, but I've a similar need as you posted here; I wanted to know if you were able to come up with a working version of a dataflow that queries NiFi API provenance events; if you did, I appreciate if you could share some info about that. Thanks in advance.

Don't have an account?
Coming from Hortonworks? Activate your account here