Member since
03-06-2017
45
Posts
4
Kudos Received
0
Solutions
06-08-2017
02:23 PM
image0.pngimage1.pngHello, I am getting error in my custom processor, second time when I am going to start it is not starting and showing error not eligible component is selected, but I have selected processor and then trying to start. For your reference I have attached two images, in Image1 all processor are stopped and in Image2 I have selected my customprocessor and trying to start but getting message not eligible components are selected. Please let me know where I am doing mistake. Thankyou
... View more
05-29-2017
03:15 PM
Thanks Timothy I have find out the way to read template's xml file in onTrigger method of my custom processor, but I am getting some issues. I am using getTemplates() method of StandardNiFiServiceFacade class that implements NiFiServiceFacade interface, and I make object of that interface like this -- private NiFiServiceFacade serviceFacade = new StandardNiFiServiceFacade(); in my custom processor's code. But when I am going to up my nifi server, I got error on this line. Below are the error I am getting: java.util.ServiceConfigurationError: org.apache.nifi.processor.Processor: Provider org.apache.nifi.processors.hadoop.SparkConnector could not be instantiated
at java.util.ServiceLoader.fail(ServiceLoader.java:232) ~[na:1.8.0_111]
at java.util.ServiceLoader.access$100(ServiceLoader.java:185) ~[na:1.8.0_111]
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384) ~[na:1.8.0_111]
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) ~[na:1.8.0_111]
at java.util.ServiceLoader$1.next(ServiceLoader.java:480) ~[na:1.8.0_111]
at org.apache.nifi.nar.ExtensionManager.loadExtensions(ExtensionManager.java:116) ~[nifi-nar-utils-1.1.2.jar:1.1.2]
at org.apache.nifi.nar.ExtensionManager.discoverExtensions(ExtensionManager.java:97) ~[nifi-nar-utils-1.1.2.jar:1.1.2]
at org.apache.nifi.NiFi.<init>(NiFi.java:139) ~[nifi-runtime-1.1.2.jar:1.1.2]
at org.apache.nifi.NiFi.main(NiFi.java:262) ~[nifi-runtime-1.1.2.jar:1.1.2] Caused by: java.lang.NoClassDefFoundError: org/apache/nifi/web/revision/RevisionClaim
at org.apache.nifi.processors.hadoop.SparkConnector.<init>(SparkConnector.java:53) ~[nifi-hdfs-processors-1.1.2.jar:1.1.2]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_111]
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_111]
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_111]
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_111]
at java.lang.Class.newInstance(Class.java:442) ~[na:1.8.0_111]
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:380) ~[na:1.8.0_111]
... 6 common frames omitted Caused by: java.lang.ClassNotFoundException: org.apache.nifi.web.revision.RevisionClaim
at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[na:1.8.0_111]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[na:1.8.0_111]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[na:1.8.0_111]
... 13 common frames omitted
I wont able to understand what exactly is the problem, as I have already added all required jar files in nar. Still I am getting this error. Please suggest me what I am doing wrong here or tell me some alternate way if you know that how I get all template object in TemplateEntity class in my onTrigger method of customProcessor. Thanks in advance
... View more
05-24-2017
08:17 AM
1 Kudo
Hello, I am going to make a custom processor which needs NIFI template xml file's data(existing saved template) in run time, is this possible in nifi to read existing nifi template file's data in run time. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
05-11-2017
03:54 PM
@Thanks Wynner I have successfully setup cluster using 3 nodes. Now I have one query regarding cluster architecture. In my flow I use getSFTP processor to get file and for distributing on cluster I am using Remote Process Group. Now I according to my flow only one primary node can get file and keep on their local content repository untill RPG distribute files on different nodes. so is there any way to make this content repository common between all three nodes because right now if in any case my primary node have low memory then what happen with files.
... View more
04-14-2017
02:52 PM
Hello I am trying to setup the Nifi Cluster....is there any way to setup and run clusters without using zookeeper and with which version of nifi [currently using(1.1.2)]?
... View more
Labels:
- Labels:
-
Apache NiFi
03-15-2017
08:31 AM
I have data in my xls files and i want to process it in nifi but i am unable to find any processor which would help me with this. Is there any solution for it?
... View more
Labels:
- Labels:
-
Apache NiFi
03-15-2017
08:11 AM
Hi....I have data in various kinds of files and i want to insert them into database but i don't want it to convert them first into JSON and then to SQL as it is very time consuming.Is there any way so that i can put my data into database from different kinds of files like CSV,Avro etc directly?
... View more
Labels:
- Labels:
-
Apache NiFi
03-09-2017
12:06 PM
Hi.. I am using a flow which is like GetFile--->SplitText---->ExtractText---->RouteOnAttribute----->PutFile. In this I have defined certain conditions in extract text as mentioned in the file extracttext.png. It is working fine but i want that after filtering the text from extracttext processor i want to make separate directories depends on the condition like i want for condition1 i want to put it in Folder1, for condition2 i want it on Folder2 and Folder3 for unmatched files.For that i used RouteOnAttribute with following properties as shown in file routeonattribute.png. But it is not working as i am not getting any file in the folders.Can you please tell me what am i doing wrong in it. Here is my flow after routeOnAttribute routingflowbyrouteonattribute.png.
... View more
03-07-2017
02:30 PM
Thanks alot @Matt Burgess .It finally worked for me. But can we directly convert the column names coming from the CSV or any other files including JSON using replace text processor only ? so it would not take so much processing time, like X-A,Y-B,Z-C,W-D and insert directly into the database.
... View more
03-07-2017
10:35 AM
Thanks @Matt Burgess for the help, I did what you mention but i am getting null after the transformation.Can you please tell me what am i doing wrong.jolttransformationjson.png
... View more
- « Previous
-
- 1
- 2
- Next »