Member since
11-09-2022
2
Posts
1
Kudos Received
0
Solutions
09-30-2024
04:00 AM
1 Kudo
Hi, I am trying to understand what is the optimal development lifecycle of Apache Nifi flows that should be ported from dev to qa to prod. I read some articles such as https://community.cloudera.com/t5/Support-Questions/Hortonworks-HDF-Apache-Nifi-how-to-deploy-a-flow-from-dev/m-p/158288 and I usually use export/import template in my flows but it's having some big drawback than I am not sure how they can be overcomed. In particular the issue is that the template/flow definition contains inside "code" and "logic" information together with "environment configurations" that shouldn't be exported and imported. With that I mean information such as number of threads per processor that should not be exported because obviously usualy prod environments have more resources so can support more threads and cron configurations that obviously can change between a dev/qa and prod environment. It seems like Apache Nifi was not designed well following the 12 factor principles https://12factor.net/ as obviously it actually stores some configurations that should be outside the flow/template inside it. Can somebody please help me clear this point and explain if I am misuderstanding the tool? Thanks in advance!
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
11-09-2022
03:42 AM
Hi, I am trying to create a custom apache nifi processor using maven archetype: GroupId: org.apache.nifi ArtifactId: nifi-processor-bundle-archetype Version: 1.18.0 If I add in my processor maven dependency <dependency> <groupId>org.json</groupId> <artifactId>json</artifactId> <version>20220924</version> <scope>compile</scope> </dependency> and then try to run maven install I receive the following error: [ERROR] Rule 3: org.apache.maven.plugins.enforcer.BannedDependencies failed with message: Found Banned Dependency: org.json:json:jar:20220924 Use 'mvn dependency:tree' to locate the source of the banned dependencies. Looking at parent nifi dependencies I am seeing this section in nifi.1.18.0 pom.xml file <bannedDependencies> <excludes> <!-- Cat-X Deps --> <exclude>org.json:json:*:*:compile</exclude> ... Why org.json dependency is explicitly banned? If it's expected how a custom processor can use classes and functionalities from org.json package such as JSONObject ? Thank you in advance, Roman
... View more
Labels:
- Labels:
-
Apache NiFi