Member since
07-29-2020
574
Posts
323
Kudos Received
176
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2479 | 12-20-2024 05:49 AM | |
| 2861 | 12-19-2024 08:33 PM | |
| 2525 | 12-19-2024 06:48 AM | |
| 1699 | 12-17-2024 12:56 PM | |
| 2365 | 12-16-2024 04:38 AM |
05-16-2024
07:23 PM
1 Kudo
Hi, Anyone knows if there is compatibility issue for using python exntension with the latest python version 3.12. To me the 3.12 doesnt seem to work well with the python extension and I keep getting the following error : AttributeError: 'FileFinder' object has no attribute 'find_module' 2024-05-16 22:12:52,884 ERROR python.ExtensionManager Failed to load Python extensions from module file <Unknown Module File>. This module will be ignored. Traceback (most recent call last): File "F:\NIFI-PORD-ENV-2.0.0-M2\python\framework\ExtensionManager.py", line 186, in __discover_extensions_from_paths module = finder.find_module(name) The error seems to go away when using 3.11.*
... View more
Labels:
- Labels:
-
Apache NiFi
05-08-2024
09:01 AM
Hi @AsifArmanRahman , No I have not figured it out and I dont believe its possible with the current implementation. May I ask what is that you are trying to do ?
... View more
05-07-2024
10:29 PM
2 Kudos
There is not really a comprehensive Jolt tutorial that I could find out there. Two important references I frequently use to learn is : 1- The Jolt code in github where you can see how things work under the hood and what are the available functions: https://github.com/bazaarvoice/jolt 2- A site that talks about the fundamental of jolt: https://docs.digibee.com/documentation/components/tools/transformer-jolt/transformer-getting-to-know-jolt#cardinality The rest is practice, practice and more practice. Its the only way you can get some depth in the understanding of jolt and its capabilities. You can do that by trying to help and learn from others posts in this community forum or other forums like the below where you can find tons of jolt problems\solutions: https://stackoverflow.com/questions/tagged/jolt Hope that helps and thanks for accepting the solution.
... View more
05-06-2024
02:21 PM
2 Kudos
Based on the provided new input and the expected output as I was able to understand where you always want to consider the last element of both DEFECT_ROOT_CAUSE & SPRINT_LIST which both may or may not be an array of values, I would take a different approach to the jolt spec which is much simpler as follows: [
// First spec is convert everything into list regardless
{
"operation": "cardinality",
"spec": {
"*": {
"SPRINT_LIST": "MANY",
"DEFECT_ROOT_CAUSE": "MANY"
}
}
}
,
// From the generated list above return last element
{
"operation": "modify-overwrite-beta",
"spec": {
"*": {
"SPRINT_LIST": "=lastElement",
"DEFECT_ROOT_CAUSE": "=lastElement"
}
}
}
]
... View more
05-06-2024
07:05 AM
1 Kudo
The reason its not working because there is mismatch in the list name 3rd spec where its using "DEFECT_ROOT_CAUSE_LIST" and the 4th spec where its using "DIRECT_ROOT_CAUSE_LIST" . If you fix this it should work. If you find this is helpful please accept solution. Thanks
... View more
05-05-2024
04:41 PM
Its, what kind of exe? take a look at the ExecuteStreamCommand processor: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.5.0/org.apache.nifi.processors.standard.ExecuteStreamCommand/index.html
... View more
04-26-2024
08:41 AM
1 Kudo
Awesome @MattWho . That is great information. However as you said this is going to help moving forward but what about past information? Is there still a way to search the provenance data outside the search feature which doesnt provide capability to search by custom attribute or content? My guess is not based on your answer but I just wanted to confirm.
... View more
04-26-2024
06:29 AM
1 Kudo
Hi, I'm not sure if this has been asked before but Im finding it strange that there is not much info or discussion about it. Basically I have scenario where at some point of time I believe I was getting some corrupted data from an API call. When I went to verify that by executing the API call after few hours from the error I dont see the corrupted data. How do I prove\disapprove this? if I can search the data provenance for that particular response flowfile I would be able to see what did i get at that time after the call. The problem is the out of the box search provenance criteria doesn't provide a way to search against the content or the flowfile custom attributes and it only allows to search against system fields attributes that I dont store. Is there a way to perform such search even by creating some dataflow using certain processors in nifi or using some scripting language? @MattWhoor any body who can help with I would really appreciated.
... View more
Labels:
- Labels:
-
Apache NiFi
04-23-2024
03:59 PM
1 Kudo
Based on my json spec above: 1- customfield_* with multiple records list 2- customfield_* with single records list: 3- customfield_* with no list: The asterisk in customfield_* means anything as long there is a customfield , underscore (_) and whatever comes after.
... View more
04-23-2024
06:39 AM
I think the issue here is stating what the problem is vs the actual problem. since you starting posting the issue, I noticed the json input has changed 3 times. Remember as someone said "Asking the right question is half way the path to finding the right solution". Allow me give you some pointers: 1- Please specify the different json input for all possible scenarios and the expected output\s. 2- If you have compound problem then divide and conqueror. Break the big problem into smaller one where each is isolated to its own input, output and assertions.. 3- Simplify if you can, for example if you have complex json input and you are only facing issue with particular field or nested object then you dont have to post the whole json , instead you isolate where the issue is and provide that part only or create new one that mimic the same structure. 4- If you have code or some formatted data please use the code block "</>" from the menu item for better visibility and readability. Dont post code\data as screenshot. 5- Use screenshots for when suitable , like showing nifi flow, processor configuration ..etc. 6- Refer to the community guidelines for more info: https://community.cloudera.com/t5/custom/page/page-id/Community_Guidelines Hope that helps.
... View more