Member since
12-03-2017
147
Posts
24
Kudos Received
11
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1162 | 11-03-2023 12:17 AM | |
2893 | 12-12-2022 09:16 PM | |
1100 | 07-14-2022 03:25 AM | |
1751 | 07-28-2021 04:42 AM | |
2023 | 06-23-2020 10:08 PM |
08-04-2021
09:36 AM
Hello Experts, I have a requirement where nifi flows imp log information should be written to MongDB, so that another application can read mongodb and display those interesting logs info on web UI. I am looking for best way to do this. One way I am thinking of is tail nifi log (using tail file processor) and filter for imp log and put into MongoDb using native processor. Please suggest if any other better approaches, thanks in advance. Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
07-28-2021
04:42 AM
Update : Below commands worked : git config user.name "myemailuser" git config user.email "myemail@myorg.com" Need to run this inside the cloned repo folder and then start nifi registry.
... View more
07-28-2021
02:17 AM
Hello @alim , Thanks for the detailed explanation. Do you know any solution for this problem - https://community.cloudera.com/t5/Support-Questions/NiFi-registry-commits-templates-to-git-with-default-email/td-p/321648 Thanks Mahendra
... View more
07-27-2021
10:55 PM
Hello Experts, I have configured Git as FlowPersisteceProvider for nifi registry. Tested with test repo and worked fine, but now pointed to my company repo and getting error in push/commit. The error is due to the policy is set in my org git repo, it accepts push/commit from the accout with email as *@myorg.com only. But Even though I configured my credentials (user & PAT) which belongs to my org for Git access from registry, NiFi registry pushes the code to Git with email as "nifiregistry@<hostname>". As its org level git repo ops team cant change this policy, so is there any way I can override this default "nifiregistry@<hostname>" to "my-user@myorg.com" so that git push will not be rejected ? This is how nifi reg is pushing and comitting, Authored and Committed Identity should be changed from default Tried this : https://docs.cloudera.com/HDPDocuments/HDF3/HDF-3.2.0/administering-nifi-registry/content/git-user-configuration.html But did not solve Error in registry log : Caused by: org.eclipse.jgit.errors.TransportException: https://o9git.visualstudio.com/CoreDev/_git/nifi-registry-dev: error occurred during unpacking on the remote end: error VS403702: The push was rejected because one or more commits contain author email 'nifiregistry@nifi-test-poc.*****.com' which does not match the policy-specified patterns. at org.eclipse.jgit.transport.BasePackPushConnection.readStatusReport(BasePackPushConnection.java:382) at org.eclipse.jgit.transport.BasePackPushConnection.doPush(BasePackPushConnection.java:222) at org.eclipse.jgit.transport.TransportHttp$SmartHttpPushConnection.doPush(TransportHttp.java:1112) at org.eclipse.jgit.transport.BasePackPushConnection.push(BasePackPushConnection.java:170) at org.eclipse.jgit.transport.PushProcess.execute(PushProcess.java:172) at org.eclipse.jgit.transport.Transport.push(Transport.java:1344) at org.eclipse.jgit.api.PushCommand.call(PushCommand.java:169) ... 8 common frames omitted Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
-
NiFi Registry
07-08-2021
10:51 PM
@Ven5 - Login to git in browser and create branch called 'develop'. - Login to server(node) where registry is running, got to '/versioned_flows' directory - Clone git repo with newly created specific branch >git clone -b develop https://github.com/myrepo-name.git Thats it. you should see your templates committing to 'develop' branch instead of default master branch.
... View more
06-01-2021
08:29 AM
Hello experts, I have nifi registry with MySQL db as metadata store and FileSystem as Persistence provider. And this registry has 10+ flows with multiple versions. Now I am trying to integrate registry to GIT, that is trying to change persistence provider from FileSystem to GIT. I referred some docs (below urls) and steps to switch persistence provider etc, those all help for fresh GIT integration set and they wont carry/migrate already created buckets/flows/versions from FileSystem to GIT https://nifi.apache.org/docs/nifi-registry-docs/html/administration-guide.html#switching-from-other-flow-persistence-provider https://community.cloudera.com/t5/Community-Articles/Storing-Apache-NiFi-Versioned-Flows-in-a-Git-Repository/ta-p/248713 Any help on this would be much appreciated. Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
-
NiFi Registry
06-01-2021
07:45 AM
Thanks for the great explanation Matt, much appreciated.
... View more
05-26-2021
09:26 PM
Hello, I am trying to migrate my Nifi registry from one server to another. Used niFi toolkit CLI for the same. Below are the commands used - On source registry server : registry list-buckets registry list-flows On target registr server: registry create-flow registry sync-flow-versions Flows with versions got migrated properly, but one issues noticed is the version date on target server. Instead of actual date of version it shows migrated date for all versions in target server after migration. Find the attached screnn shot for ref. Is there any way to fix this? Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
-
NiFi Registry
05-24-2021
10:07 AM
Hello, I am trying to use nifi toolkit cli to list the bucket in Nifi registry using below command - /usr/hdf/3.4.1.1-4/nifi-toolkit/bin/cli.sh registry list-buckets -u http://<ip>:<port> But getting below error : /usr/hdf/3.4.1.1-4/nifi-toolkit$ /usr/hdf/3.4.1.1-4/nifi-toolkit/bin/cli.sh registry list-buckets -u http://<ip>:<port> cli.sh: JAVA_HOME not set; results may vary Exception in thread "main" java.lang.NoClassDefFoundError: javax/annotation/Priority at org.glassfish.jersey.model.internal.ComponentBag.modelFor(ComponentBag.java:551) at org.glassfish.jersey.model.internal.ComponentBag.lambda$registerModel$10(ComponentBag.java:477) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:229) at org.glassfish.jersey.model.internal.ComponentBag.registerModel(ComponentBag.java:469) at org.glassfish.jersey.model.internal.ComponentBag.register(ComponentBag.java:380) at org.glassfish.jersey.model.internal.CommonConfig.register(CommonConfig.java:454) at org.glassfish.jersey.client.ClientConfig$State.register(ClientConfig.java:242) at org.glassfish.jersey.client.ClientConfig.register(ClientConfig.java:619) at org.apache.nifi.registry.client.impl.JerseyNiFiRegistryClient.<init>(JerseyNiFiRegistryClient.java:110) at org.apache.nifi.registry.client.impl.JerseyNiFiRegistryClient.<init>(JerseyNiFiRegistryClient.java:54) at org.apache.nifi.registry.client.impl.JerseyNiFiRegistryClient$Builder.build(JerseyNiFiRegistryClient.java:226) at org.apache.nifi.toolkit.cli.impl.client.NiFiRegistryClientFactory.createClient(NiFiRegistryClientFactory.java:96) at org.apache.nifi.toolkit.cli.impl.client.NiFiRegistryClientFactory.createClient(NiFiRegistryClientFactory.java:39) at org.apache.nifi.toolkit.cli.impl.command.registry.AbstractNiFiRegistryCommand.doExecute(AbstractNiFiRegistryCommand.java:55) at org.apache.nifi.toolkit.cli.impl.command.AbstractPropertyCommand.execute(AbstractPropertyCommand.java:74) at org.apache.nifi.toolkit.cli.impl.command.CommandProcessor.processCommand(CommandProcessor.java:251) at org.apache.nifi.toolkit.cli.impl.command.CommandProcessor.processGroupCommand(CommandProcessor.java:232) at org.apache.nifi.toolkit.cli.impl.command.CommandProcessor.process(CommandProcessor.java:187) at org.apache.nifi.toolkit.cli.CLIMain.runSingleCommand(CLIMain.java:145) at org.apache.nifi.toolkit.cli.CLIMain.main(CLIMain.java:72) Caused by: java.lang.ClassNotFoundException: javax.annotation.Priority at jdk.internal.loader.BuiltinClassLoader.loadClass(java.base@9-internal/BuiltinClassLoader.java:366) at jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(java.base@9-internal/ClassLoaders.java:184) at java.lang.ClassLoader.loadClass(java.base@9-internal/ClassLoader.java:419) ... 22 more u This machine has Java 9 openJDK. java -version openjdk version "9-internal" OpenJDK Runtime Environment (build 9-internal+0-2016-04-14-195246.buildd.src) OpenJDK 64-Bit Server VM (build 9-internal+0-2016-04-14-195246.buildd.src, mixed mode) Any help would be appreciated. Thanks, Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
-
NiFi Registry
06-23-2020
10:08 PM
2 Kudos
@AJ121 - Please try this : ${datestring:toDate("yyyyMMdd","GMT"):format("yyyy-MM-dd")} Please accept if it helped/solved your problem.
... View more