About ankit_jain

ankit_jain · ‎09-22-2016

I am using the official 1.0.0 release.

ankit_jain · ‎09-22-2016

yes.. i tried restarting multiple times, it throws same exception every time. One thing i notice is that it generate new flow.xml .gz file on all nodes but file size always differs. on one node its 0 B while on other two its of 262 B. when I extract this it has only flow.xml file that contain below structure - <?xml version="1.0" encoding="UTF-8" standalone="no"?> <flowController encoding-version="1.0"> <maxTimerDrivenThreadCount>10</maxTimerDrivenThreadCount> <maxEventDrivenThreadCount>5</maxEventDrivenThreadCount> <rootGroup> <id>4d43098d-0157-1000-27c1-1f86dcd5acf0</id> <name>NiFi Flow</name> <position x="0.0" y="0.0"/> <comment/> </rootGroup> <controllerServices/> <reportingTasks/> </flowController>

ankit_jain · ‎09-21-2016

Hi, @Bryan Bende i am following below post to set nifi cluster - http://bryanbende.com/development/2016/08/17/apache-nifi-1-0-0-authorization-and-multi-tenancy nifi-error.png I am trying to set 3 node cluster using nifi 1.0.0. i have made the configuration changes as per the above post. but when i start all nodes in first go itself it threw "org.apache.nifi.controller.Uninheritable Flow Exception: Failed to connect node to cluster because local flow is different than cluster flow." To solve this i deleted the flow.xml.gz file from all the nodes but it didn't solve the issue. Please check the attached screenshot of error. i have encountered this issue in NIFI .0.7.0 clustering as well. it came when one of the node was not in sync with NCM. so at that time deleted flow.xml.gz file from child node only. and later after restarting it replicated the NCM's flow.xml.gz. But in NIFI 1.0.0 as i'm not aware which node has elected as coordinator node so i had to delete flow.xml.gz file from all the nodes.

ankit_jain · ‎09-07-2016

Thanks for your quick response. Although i have already added all transitive dependencies still i would again have a look. i just had one question where does this external config files will go by default when i prepare a NAR. i unzipped my NAR, it have all the jars but no sign of config files.

ankit_jain · ‎09-07-2016

nifi-nar-pom.xml nifi-processor-pom.xml @Bryan Bende Attached are nar-pom and custom-processor-pom xmls. My processor is calling some method from other modules and these modules are part of a complete product. so i have to deploy all the common-lib,conf-files and module libs inside nifi setup so that it is accessible for all. I am still not able to understand while building NAR project how all this will get wrapped inside a single NAR.

ankit_jain · ‎09-06-2016

Hi Bryan, I have similar Nifi project structure as shown in link above. I have already tried the way you suggested but didn't make any progress. please check attached screenshot this is how my program flow goes. Likewise i have 4 to 5 modules which are dependent on each other. i have added dependency of each module in my NAR pom.xml and i am not having any compilation issue. i am not sure how Nifi will collect all dependent jars along with third party and cluster specific jars and bundle in a NAR.

ankit_jain · ‎08-31-2016

Is that mean NIFI works independently and can't be integrated with other maven projects? In my use case i have created a NAR project which has a custom processor class and from here i am trying to call some functions which are available in other existing modules. These modules have a lot of third party jars and config property files. i am unable to find where should i keep these external modules/jars in NIFI deployment setup on server so that my each nifi instance of cluster can access it. I have tried putting all jars in ./lib and ./conf folder with other nar and conf files but no luck.

ankit_jain · ‎08-30-2016

Can we set classpath using "java -classpath " command in Nifi like we do in other CLI hadoop component. If not than Is it possible to set this in bootstrap.conf file or Nifi.sh script. I have seen a way in this post https://issues.apache.org/jira/browse/NIFI-416 however not sure this is possible or not.

ankit_jain · ‎08-11-2016

@mclark @PJ Moutrie @Pierre Villard I have created a custom processor which accept messages from getKafka processor and store in hadoop data lake. This is data lake is a existing project. having multiple third party jars, config files and scripts. my question is where should deploy this project under nifi setup and how to set classpath for that so that my custom processor can easily access all required jars/classes.

ankit_jain · ‎08-03-2016

Thanks @mclark i was not setting these two properties. # Site to Site properties nifi.remote.input.socket.host=<--Set to the FQDN for the Node musty be resolvable by all other instances. nifi.remote.input.socket.port=<--Set to unused port on Node. Now my nifi cluster is up. Thanks for you help.

Online	Offline
Last Visited	‎06-20-2017 09:13 AM

Member Since	‎06-23-2016 03:15 PM
Last Visited	‎06-20-2017 09:13 AM
Posts	43
Kudos received	3

Cloudera Community

Re: unable to set up nifi cluster using NIFI 1.0.0

Re: unable to set up nifi cluster using NIFI 1.0.0

unable to set up nifi cluster using NIFI 1.0.0

Re: Is there any command to set classpath in Apach...

Re: Is there any command to set classpath in Apach...

Re: Is there any command to set classpath in Apach...

Re: Is there any command to set classpath in Apach...

Is there any command to set classpath in Apache Ni...

where to add external jars in nifi setup.

Re: Issue in nifi clustering