Member since
06-14-2023
87
Posts
27
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1524 | 12-29-2023 09:36 AM | |
1465 | 12-28-2023 01:01 PM | |
488 | 12-27-2023 12:14 PM | |
258 | 12-08-2023 12:47 PM | |
880 | 11-21-2023 10:56 PM |
12-08-2023
12:47 PM
A similar question was recently asked. Kafka connections are meant to be persistent. If you want to handle what you're asking, you'll have to custom build a solution that monitors the queues and stop/starts the processors. All of these can be achieved via NiFi REST API.
... View more
12-07-2023
04:05 PM
Have you tried playing with these settings? Or perhaps an instance with faster disk since that might be the bottleneck?
... View more
11-30-2023
03:19 PM
Yes https://en.m.wikipedia.org/wiki/Syslog
... View more
11-30-2023
07:54 AM
@MattWho you can find some examples of those Python processors here: nifi/nifi-nar-bundles/nifi-py4j-bundle/nifi-python-test-extensions/src/main/resources/extensions at main · apache/nifi · GitHub
... View more
11-30-2023
07:07 AM
A gotcha, you can do what you already do in your JOLT and use & instead of using 1
... View more
11-28-2023
03:54 PM
You don't have to put it back into an array [] if you don't want.
... View more
11-28-2023
03:42 PM
@steven-matison actually commented on another post NiFi 2.0 and I was just starting to read up on it...glad you got a head start on this @SAMSAL Don't recall where but I did see Java 21 was the minimum requirement. Also, could be Jython is gone because of the "Native" support @steven-matison mentioned in that other post. Release Notes - Apache NiFi - Apache Software Foundation New Features of 2.0.0-M1 Initial version of native Python API for Processors Stateless Execution mode for Process Groups Flow Analysis Rules API Kubernetes-based Leader Election and State Management extensions Python-based Processors for interacting with ChatGPT and Vector Databases ListenOTLP Processor for collecting OpenTelemetry ListenSlack and ConsumeSlack Processors for handling messages from Slack EncryptContentAge and DecryptContentAge Processors supporting age-encryption.org specification Schema Registry Services for Amazon Glue and Apicurio Parameter Provider for 1Password Vault YamlTreeReader for YAML as Records PackageFlowFile Processor for writing file streams and attributes as FlowFile Version 3 Migrated from H2 Database Engine to JetBrains Xodus for storing Flow Configuration History Now I want to go and try the shiny new toy...
... View more
11-28-2023
09:40 AM
Did you try what the error says? Possible solutions: scan(org.springframework.data.redis.core.KeyScanOptions)
... View more
11-27-2023
08:10 AM
Your original example had everything at +0000 but the error has +0700 so perhaps change the pattern to yyyy-MM-dd'T'HH:mm:ssZ
... View more
11-26-2023
05:54 PM
1 Kudo
Yes, the regular expression it's asking for is that of the attribute containing the value you want... It's not asking for the value. Since you want the value of the attribute kafka.topic (name/key) then this is what the regular expression you need to match. Have you tried just putting what I previously recommended "kafka\.topic"?
... View more