Member since
07-29-2020
574
Posts
320
Kudos Received
175
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
248 | 12-20-2024 05:49 AM | |
285 | 12-19-2024 08:33 PM | |
294 | 12-19-2024 06:48 AM | |
246 | 12-17-2024 12:56 PM | |
238 | 12-16-2024 04:38 AM |
05-16-2024
07:40 PM
3 Kudos
Hi, Anyone Unlucky enough to run into this problem (at least as it happens on version M2.0.0-M2) when you try to run run-nifi.bat file to start nifi to be welcomed with this error: Could not find or load main class org.apache.nifi.bootstrap.RunNiFi At this point the nifi-app.log file has not been created so you are out of luck in determining what caused this error. Solution: I'm not saying this is the only reason you could encounter this error. After spending some time researching this error , Idid not find the exact match of this error message but I found something close (Example: https://community.cloudera.com/t5/Support-Questions/Error-Error-Could-not-find-or-load-main-class-org-apache/td-p/141006 ) In my case you need to watch for the full error message which is : 'F:\NIFI' is not recognized as an internal or external command,
operable program or batch file.
The JAVA_HOME environment variable is not defined correctly.
Instead the PATH will be used to find the java executable.
Error: Could not find or load main class org.apache.nifi.bootstrap.RunNiFi
Caused by: java.lang.ClassNotFoundException: org.apache.nifi.bootstrap.RunNiFi
Press any key to continue . . . Noticed the first line where it says 'F:\NIFI' is not recognized as an internal or external command..." . This is my installation path for Nifi and it turns out the full path is "NIFI 2.0.0M2" with white space between NIIF and the version and that is basically the problem. Once I removed the whitespace from the folder name it worked at least to where I can see the log file and continue from there. Hope that will help someone out there running into the same situation. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
05-16-2024
07:23 PM
1 Kudo
Hi, Anyone knows if there is compatibility issue for using python exntension with the latest python version 3.12. To me the 3.12 doesnt seem to work well with the python extension and I keep getting the following error : AttributeError: 'FileFinder' object has no attribute 'find_module' 2024-05-16 22:12:52,884 ERROR python.ExtensionManager Failed to load Python extensions from module file <Unknown Module File>. This module will be ignored. Traceback (most recent call last): File "F:\NIFI-PORD-ENV-2.0.0-M2\python\framework\ExtensionManager.py", line 186, in __discover_extensions_from_paths module = finder.find_module(name) The error seems to go away when using 3.11.*
... View more
Labels:
- Labels:
-
Apache NiFi
05-08-2024
09:01 AM
Hi @AsifArmanRahman , No I have not figured it out and I dont believe its possible with the current implementation. May I ask what is that you are trying to do ?
... View more
05-07-2024
10:29 PM
2 Kudos
There is not really a comprehensive Jolt tutorial that I could find out there. Two important references I frequently use to learn is : 1- The Jolt code in github where you can see how things work under the hood and what are the available functions: https://github.com/bazaarvoice/jolt 2- A site that talks about the fundamental of jolt: https://docs.digibee.com/documentation/components/tools/transformer-jolt/transformer-getting-to-know-jolt#cardinality The rest is practice, practice and more practice. Its the only way you can get some depth in the understanding of jolt and its capabilities. You can do that by trying to help and learn from others posts in this community forum or other forums like the below where you can find tons of jolt problems\solutions: https://stackoverflow.com/questions/tagged/jolt Hope that helps and thanks for accepting the solution.
... View more
05-06-2024
02:21 PM
2 Kudos
Based on the provided new input and the expected output as I was able to understand where you always want to consider the last element of both DEFECT_ROOT_CAUSE & SPRINT_LIST which both may or may not be an array of values, I would take a different approach to the jolt spec which is much simpler as follows: [
// First spec is convert everything into list regardless
{
"operation": "cardinality",
"spec": {
"*": {
"SPRINT_LIST": "MANY",
"DEFECT_ROOT_CAUSE": "MANY"
}
}
}
,
// From the generated list above return last element
{
"operation": "modify-overwrite-beta",
"spec": {
"*": {
"SPRINT_LIST": "=lastElement",
"DEFECT_ROOT_CAUSE": "=lastElement"
}
}
}
]
... View more
05-06-2024
07:05 AM
1 Kudo
The reason its not working because there is mismatch in the list name 3rd spec where its using "DEFECT_ROOT_CAUSE_LIST" and the 4th spec where its using "DIRECT_ROOT_CAUSE_LIST" . If you fix this it should work. If you find this is helpful please accept solution. Thanks
... View more
05-05-2024
04:41 PM
Its, what kind of exe? take a look at the ExecuteStreamCommand processor: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.5.0/org.apache.nifi.processors.standard.ExecuteStreamCommand/index.html
... View more
04-26-2024
08:41 AM
1 Kudo
Awesome @MattWho . That is great information. However as you said this is going to help moving forward but what about past information? Is there still a way to search the provenance data outside the search feature which doesnt provide capability to search by custom attribute or content? My guess is not based on your answer but I just wanted to confirm.
... View more
04-26-2024
06:29 AM
1 Kudo
Hi, I'm not sure if this has been asked before but Im finding it strange that there is not much info or discussion about it. Basically I have scenario where at some point of time I believe I was getting some corrupted data from an API call. When I went to verify that by executing the API call after few hours from the error I dont see the corrupted data. How do I prove\disapprove this? if I can search the data provenance for that particular response flowfile I would be able to see what did i get at that time after the call. The problem is the out of the box search provenance criteria doesn't provide a way to search against the content or the flowfile custom attributes and it only allows to search against system fields attributes that I dont store. Is there a way to perform such search even by creating some dataflow using certain processors in nifi or using some scripting language? @MattWhoor any body who can help with I would really appreciated.
... View more
Labels:
- Labels:
-
Apache NiFi
04-23-2024
03:59 PM
1 Kudo
Based on my json spec above: 1- customfield_* with multiple records list 2- customfield_* with single records list: 3- customfield_* with no list: The asterisk in customfield_* means anything as long there is a customfield , underscore (_) and whatever comes after.
... View more