1973
Posts
1225
Kudos Received
124
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
773 | 04-03-2024 06:39 AM | |
1424 | 01-12-2024 08:19 AM | |
771 | 12-07-2023 01:49 PM | |
1326 | 08-02-2023 07:30 AM | |
1920 | 03-29-2023 01:22 PM |
03-25-2024
12:31 PM
2 Kudos
That is a scam not affiliated with Cloudera. Do not work with them. Do not use that website. Do not email them. Do not visit that website. This is not from Cloudera.
... View more
02-20-2024
05:55 AM
1 Kudo
file-login-provider is no longer a thing, maybe do single user https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#user_authentication https://community.cloudera.com/t5/Support-Questions/Apache-NiFi-user-authentication-creation-of-multiple-users/m-p/378285 nifi.security.user.login.identity.provider=single-user-provider
... View more
01-12-2024
08:19 AM
1 Kudo
make sure you are running 1.24 or 2.0 nifi. Add more connections in your pool, maybe 32 make sure you mysql has enough ram and cores, also make sur eyou have a fast network between them restart after you update the conf/bootstrap.conf java.arg.2=-Xms64G java.arg.3=-Xmx128G change lookup
... View more
01-11-2024
08:05 AM
How many nodes? How much RAM and CPUs per node? Which version of NiFi? Which version of JDK? I recommend 128GB RAM, 32cores, 6 nodes+, JDK 21. Also for that many rows you probably want to use a real database and not the tiny cache server. I would say Redis could work.
... View more
12-07-2023
01:49 PM
1 Kudo
You can't listen for RSS, you have to call them since it's regular HTTP https://github.com/tspannhw/FLaNK-TravelAdvisory If there's no way to know when the page changes then you can't know. you can read it once an hour and keep the entire results in a cache (like HBase) and if it doesn't change throw it away
... View more
12-06-2023
06:56 AM
Did you try @MattWho https://community.cloudera.com/t5/Support-Questions/NiFi-upgrade-1-9-2-to-1-23-0/m-p/376353#M242873 solution. I think best course is to always start fresh after updates and restarts to ensure nothing is lost.
... View more
11-28-2023
07:45 AM
You may need to update the JDK you are running NiFi with. What version are you using? What operating System? Where did you download NiFi? Move to NiFi 1.23.2, 1.24 or Cloudera's 1.23.1 version. Bare metal? VMs? Docker? K8? Cloud?
... View more
10-13-2023
06:53 AM
it's very hard to format a long call like that without wrapping it. also you will need to fully list out directories so not /test.pdf but /the/actual/location/even/if/it/s/giant/test.pdf. it may work. you may also need to do /usr/bin/sshpass. it is always easier to just write a simple runme.sh with the text in it, make it executable and test it. also make sure nifi user has permissions to sshpass and if you are running on a cluster that all machines have that binary and have permissions
... View more
10-12-2023
03:56 AM
put your command in a shell script named yourscript.sh and make sure NiFi has execute permissions. rsync can be very slow so make sure you have a long timeout on the command. i have seen rsync take 5 minutes to 20 hours.
... View more
09-14-2023
05:32 AM
1 Kudo
You need to work with a contractor or Cloudera support as that is four years of massive updates. ListFile will lose tracking. Redis will remain cache (though it's in memory). I would move away old files or grab the meta data as a checker. It may require some updates to your coding style. Any state that is critical to long term processing should be stored in a permanent store and use so you can move to new versions. Say store in Postgresql or Kudu. Kudu makes a better cache.
... View more