question Re: nifi cluster custom processor not work,nifi custom processor does not show up in cluster in Archives of Support Questions (Read Only)

nifi cluster custom processor not work,nifi custom processor does not show up in cluster

mark_lin — Fri, 09 Feb 2018 20:01:37 GMT

I created a custom processor and it is deployed successfully to standalone 1.4 and 1.5 nifi. It works very well in standalone. I copied the same processor to a cluster of two servers and restarted both servers. The log shows no errors and I can see that the new processor is unpacked to the work dir. However, I can not find the new processor from nifi ui.

Is there any other setup required to make it available through nifi ui in a cluster?

Thanks,

Mark

I have a custom processor that is written in 1.6 snapshot. It is successfully deployed to standalone nifi instance of 1.5 and 1.5. All works fine in 1.5 and 1.4 standalone instances. However, the same .nar simply does not work after it is deployed to a nifi 1.4 cluster(copied the nar to all servers) and restarted all servers. There is no erro in log. After restart, we are not able to locate the new customer processor through filter.

Is there any extra setup for a cluster deployment of a custom processor?

Thanks,

Mark

Re: nifi cluster custom processor not work,nifi custom processor does not show up in cluster

MattWho — Fri, 09 Feb 2018 20:29:22 GMT

@Mark Lin

Make sure you added your custom nar to every node in the cluster and that the ownership and permissions on the nar on each Nifi cluster node is correct. It sounds like at least one of the nodes is missing the nar or was unable to read/unpack it to the work directory. Also make sure that every node sis running the same version of your nar.

You could also try stopping NiFi on all you nodes and removing the entire "work" directory and restarting.

Thanks,

Matt

Re: nifi cluster custom processor not work,nifi custom processor does not show up in cluster

TimothySpann — Fri, 09 Feb 2018 21:16:13 GMT

1. Check logs after restart.

2. Make sure the nar is in the lib (and it's the correct nar)

3. Check file ownership and permission

4. Perhaps the name has a collision.

5. 1.6 Snapshot? Can you recompile in 1.5? What's in the pom.xml can you share that.

6. Can you send some screenshots?

7. Are you running same JDK? JDK 8? JDK 9?

8. Does it require any files, permissions, kerberos, etc...?

Re: nifi cluster custom processor not work,nifi custom processor does not show up in cluster

mark_lin — Fri, 09 Feb 2018 22:46:09 GMT

Thanks Tim, Matt and All.

Figured out the root cause. Our cluster has 3 nodes instead of two nodes that is my wrong assumption. By comparing the cluster nifi.properties against the standalone nifi.properties, I found we actually have 3 nodes in the cluster. After deploying it to the third node, everything works fine.

Thank for your help.

Mark

Re: nifi cluster custom processor not work,nifi custom processor does not show up in cluster

arkumari — Tue, 27 Sep 2022 08:54:40 GMT

How you deployed it to the third node?

Re: nifi cluster custom processor not work,nifi custom processor does not show up in cluster

DianaTorres — Tue, 27 Sep 2022 15:26:54 GMT

@arkumari As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.