question Re: Reporting NiFi lineage to Atlas in Archives of Support Questions (Read Only)

Reporting NiFi lineage to Atlas

joe_harvyy — Fri, 16 Sep 2022 13:01:39 GMT

Hello,

I thought that NiFi 1.5 can report lineage to Atlas but I couldn't find how to it. I've checked the reporting tasks but couldn't find Atlas reporting task. Does anyone succeeded in using this new feature?

Thanks

Joe

Re: Reporting NiFi lineage to Atlas

ahadjidj — Sun, 25 Mar 2018 05:05:16 GMT

Hello @Joe Harvy

The Atlas reporting task requires building NiFi with a specific profil. If you downloaded NiFi from Apache site, it's normal that the reporting task is not available. You have 2 options:

Use NiFi from HDF that already has this reporting task
Download NiFi code from Apache and rebuild with the Atlas profil using the following command

mvn clean install -Pinclude-atlas -DskipTests

Re: Reporting NiFi lineage to Atlas

dansteu — Mon, 04 Oct 2021 12:24:12 GMT

Hello Team, @ahadjidj

Running this suggested command

mvn clean install -Pinclude-atlas -DskipTests

referrinng to the pom xml file here located:

/work/nar/framework/nifi-framework-nar-1.14.0.nar-unpacked/META-INF/maven/org.apache.nifi/nifi-framework-nar/pom.xml

I get this error message :

[WARNING] The requested profile "include-atlas" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.nifi:nifi-nar-maven-plugin:1.3.1:nar (default-nar) on project nifi-evtx-nar: The plugin org.apache.nifi:nifi-nar-maven-plugin:1.3.1 requires Maven vers
ion 3.1.0 -> [Help 1]

I got this message:

The requested profile "include-atlas" could not be activated because it does not exist.

Could you please provide any hint?

As we need to introduce the lineage into Atlas with info coming from Nifi, this area in currently on priority as we are stucked on this.

Thanks a lot!

Daniele.