Member since
12-03-2017
156
Posts
26
Kudos Received
11
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2074 | 11-03-2023 12:17 AM | |
4137 | 12-12-2022 09:16 PM | |
1562 | 07-14-2022 03:25 AM | |
2389 | 07-28-2021 04:42 AM | |
3318 | 06-23-2020 10:08 PM |
01-19-2022
08:35 AM
Hi @ckumar - thanks for the reply. I think that screenshot lacked info may be due to my permission issue. Same issue has been posted by team mate here - https://community.cloudera.com/t5/Support-Questions/NiFi-Node-showing-2-nodes-and-not-respecting-node-down-fault/td-p/334221 Please take a look at the screenshot attachment there which has more info. And i can login from all 3 nodes ui, and in all nodes it shows up only 1 & 2.
... View more
01-19-2022
07:34 AM
Hello Experts, I have a 3 node nifi cluster with host name as nifi-hatest-01, nifi-hatest-02, nifi-hatest-03. nifi-hatest-01 is primary node at the moment and I can see (in logs) it is receiving heartbeats from 02 & 03. And if I create flows in any one of the 3 nodes it gets sycned to all nodes. But the problem now is the 3rd node (nifi-hatest-03) does not show up in the "cluster" tab of Nifi UI. Any idea what could be the issue? any suggestion would be much appreciated. @MattWho @GangWar @smdas Thanks Mahendra
... View more
Labels:
- Labels:
-
Ambari Blueprints
-
Apache NiFi
11-18-2021
02:40 AM
Below is the app log - 2021-11-18 16:07:13,819 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.util.ServiceConfigurationError: org.apache.nifi.processor.Processor: Provider org.apache.nifi.processors.windows.event.log.ConsumeWindowsEventLog could not be instantiated java.util.ServiceConfigurationError: org.apache.nifi.processor.Processor: Provider org.apache.nifi.processors.windows.event.log.ConsumeWindowsEventLog could not be instantiated at java.util.ServiceLoader.fail(ServiceLoader.java:232) at java.util.ServiceLoader.access$100(ServiceLoader.java:185) at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384) at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) at java.util.ServiceLoader$1.next(ServiceLoader.java:480) at org.apache.nifi.nar.StandardExtensionDiscoveringManager.loadExtensions(StandardExtensionDiscoveringManager.java:156) at org.apache.nifi.nar.StandardExtensionDiscoveringManager.discoverExtensions(StandardExtensionDiscoveringManager.java:131) at org.apache.nifi.nar.StandardExtensionDiscoveringManager.discoverExtensions(StandardExtensionDiscoveringManager.java:117) at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1042) at org.apache.nifi.NiFi.<init>(NiFi.java:158) at org.apache.nifi.NiFi.<init>(NiFi.java:72) at org.apache.nifi.NiFi.main(NiFi.java:301) Caused by: java.lang.NoSuchFieldError: SIZE at com.sun.jna.platform.win32.WinBase.<clinit>(WinBase.java:52) at com.sun.jna.platform.win32.Kernel32Util.getComputerName(Kernel32Util.java:60) at org.apache.nifi.processors.windows.event.log.ConsumeWindowsEventLog.<init>(ConsumeWindowsEventLog.java:178) at org.apache.nifi.processors.windows.event.log.ConsumeWindowsEventLog.<init>(ConsumeWindowsEventLog.java:164) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at java.lang.Class.newInstance(Class.java:442) at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:380) ... 9 common frames omitted 2021-11-18 16:07:13,820 INFO [Thread-19] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2021-11-18 16:07:13,820 INFO [Thread-19] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise).
... View more
11-15-2021
10:09 AM
I tried to change the package name of these 2 dependencies with the help of maven shade plugin, shade has places these dependencies classes in new package. Still whenever I add any of these dependenies to maven/jar nifi is failing to start !!!
... View more
11-12-2021
07:49 AM
Hello Experts, I have implemented a custom log appender which inserts log messages to ElasticSearch. Custom appender class works fine when it is run independently as executable jar. But when I add this custom appender jar file to nifi "lib" directory, nifi stopped working - its not able to start. I have below 2 dependencies in my appender jar - <dependency> <groupId>org.elasticsearch</groupId> <artifactId>elasticsearch</artifactId> <version>7.15.0</version> </dependency> <dependency> <groupId>org.elasticsearch.client</groupId> <artifactId>elasticsearch-rest-high-level-client</artifactId> <version>7.15.0</version> </dependency> And Nifi has multiple processors related to ElasticSearch so the nar files of these processors also have same classes which are present in above 2 dependencies. This looks to be the issue. I need these ElasticSearch dependencies classes at bootstrap level for logger to get initialised. But the nar files get loaded at later point, so I cant depend on the classes which are part of nar files. What is the better approach to solve this issue ? Any suggestion would be much appreciated. Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
09-20-2021
05:26 AM
Hello, We are running single node nifi in 8 core machine and configured 'Maxmum Timer driven thread count' as 300. Once in a while Nifi get totally stuck (wont accept flowfiles) and also no app log will generate till we restart nifi manually. So wondering if its due to nifi thread starvation... In below article 'NiFi Thread starvation' section its mention that system will stuck in resource competition cycle. https://community.cloudera.com/t5/Community-Articles/NiFi-HDF-Dataflow-Optimization-Part-2-of-2/ta-p/245113 So any idea if nifi needs more threads than system available core then will there be any chance of nifi to get stuck ? @Wynner Thanks, Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
09-17-2021
04:16 AM
You can write a simple custom processor which uses local caching (like Caffeine cache implementation) with cache expiry time as ur window time and build the logic. May be you can store words in cache and keep updating the count or something like that
... View more
08-08-2021
11:51 PM
@Green_ - Can I have a custom appender configured in logback.xml to collect logs and put that in MongoDB ? would that be possible with nifi logs ?
... View more
08-04-2021
10:43 PM
@Green_ Filtering means I may need to ignore some INFO level logs and consider only DEBUG or ERROR level logs... and I dont have to be using native nifi processors only.. but right way of doing is importtant. Please suggest if you see an other way
... View more
08-04-2021
09:36 AM
Hello Experts, I have a requirement where nifi flows imp log information should be written to MongDB, so that another application can read mongodb and display those interesting logs info on web UI. I am looking for best way to do this. One way I am thinking of is tail nifi log (using tail file processor) and filter for imp log and put into MongoDb using native processor. Please suggest if any other better approaches, thanks in advance. Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi