Member since
02-01-2022
281
Posts
103
Kudos Received
60
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1120 | 05-15-2025 05:45 AM | |
| 4948 | 06-12-2024 06:43 AM | |
| 7920 | 04-12-2024 06:05 AM | |
| 5821 | 12-07-2023 04:50 AM | |
| 3203 | 12-05-2023 06:22 AM |
04-05-2022
09:15 AM
1 Kudo
@mbraunerde Before GetSFTP, you need this processor first: ListSFTP ListSFTP will send GetSFTP the the list of files to get. Be sure to search in your NiFi Processor window, SFTP, to see all matching processors. This works for any keyword, and I use it often. Docs here: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.16.0/org.apache.nifi.processors.standard.ListSFTP/index.html
... View more
03-23-2022
02:29 PM
@Nifi_Al Use getFile/putFile to read and write in your flow. Then If you use unpackContent against a zipped flowfile it should create individual artifacts flowfiles which can be additionally unzipped further. Alternatively, if you can create a script to unzip recursively, you can use nifi to executeScript. Maybe even use executeProcess too.
... View more
03-23-2022
02:10 PM
@azg Yes, just add the values you want in the processor configuration tab. Click + to add new key/value pairs.
... View more
03-16-2022
06:30 AM
@bdworld2 Being that HDP is EOL (End of Life) and M1 chip is new and breaking anything with linux amd/64 I would recommend a different learning path. Check out CDP and build new clusters to learn the asf components you are familiar with from HDP.
... View more
03-11-2022
05:24 AM
1 Kudo
@kumsath Yes, when i saw your post I started digging around too. The issue here is number manipulation and type casting a "number" versus a "string". That easy gets complicated in attributes and with nifi expression language functions. The solution i referenced would take the "number" and make a number in which the visual representation should then be correct. Its worth a try since that execute script should be very easy to test. The alternative is to do your "math" upstream or in an execute script processor not in updateattribute.
... View more
03-10-2022
10:47 AM
@kumsath This may not be the best way, but check out this solution here: https://community.cloudera.com/t5/Support-Questions/How-correct-convert-from-Decimal-with-E-to-float-in-Apache/m-p/236511
... View more
03-09-2022
06:12 AM
@snm1523 This may not be the direction you want to take, but I cannot help but wonder what the environment spec is. Starting/reStarting services should work nicely. Instead of trying to create logic around start/finish race conditions, maybe focus on why any certain services are not restarting quickly. This may identify that one or more nodes are doing too much, creating the race condition.
... View more
02-11-2022
08:24 AM
Right, you need another processor to extract the values to an attribute for it to work like this ${attribute}
... View more
02-11-2022
07:54 AM
Excellent progress. Can you try doing a single select to get both values? Like this: SELECT MAX(ID),MIN(ID) FROM FLOWFILE If you could do that, then you could extract those values into 2 separate attributes, then feed that flowfile to the next processor in the flow. Another alternative is to extractText for each value to an attribute, then MERGE 2 flowfiles into 1.
... View more
02-11-2022
06:09 AM
Ok great, then the issue is the QueryRecord. In your flow I can see that min and max are both routes to PutSQ, not attributes of a single flowfile. Have you inspected these flowfiles to see if they contain the correct values you need? Does it send 2 flowfiles to PutSQL? ${min} and ${max} is an attribute syntax. I believe you will need to get the min and max into a single flowfile and extracted as attributes to send to PutSQL
... View more
- « Previous
- Next »