Member since
07-29-2020
574
Posts
323
Kudos Received
176
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3585 | 12-20-2024 05:49 AM | |
| 3831 | 12-19-2024 08:33 PM | |
| 3631 | 12-19-2024 06:48 AM | |
| 2366 | 12-17-2024 12:56 PM | |
| 3115 | 12-16-2024 04:38 AM |
07-31-2023
07:09 AM
Hi @MihaiMaranduca , You can use the "Run Schedule" Property to control how often a given processor runs. You can access this property by opening process Configuration, then select the Scheduling tab: The Run Schedule can be configured using the Scheduling Strategy: 1- Timer Driven (Default): Run processor based on interval. the Zero value indicates that its running continuously. 5 secs mean every 5 seconds, 5 mins mean every 5 minutes and so on. 2- CRON Driven: Processor runs based on a schedule specified by CRON string. More info on Scheduling: https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#scheduling-tab If you find this is helpful please accept solution. Thanks
... View more
07-26-2023
05:39 AM
1 Kudo
Hi @mandychen , Have you tried removing the double quotes from "ACPMA" in the Table Name property of the PutDatabaseRecord? I dont think you need it there. If that helps please accept solution. Thanks
... View more
07-25-2023
11:14 AM
Hi @brajeshreddy , I dont think you can achieve this using the ControlRate processor. Instead I recommend the solution mentioned here: https://stackoverflow.com/questions/69893107/nifi-activate-a-flow-file-after-a-previous-flow-file-goes-through-the-downstre If you have a cluster then make sure that the top processor is executing on the Primary node. hope that helps. Thanks
... View more
07-25-2023
06:30 AM
1 Kudo
Hi @Diga , Here are some videos to help you get started with the InvokeHttp Processor: https://www.youtube.com/watch?v=aNrdWYy4i34 https://www.youtube.com/watch?v=SZhX_gce63E https://www.youtube.com/watch?v=Jk7H8w3evN0 As far as logging in and authentication, it depends what kind of authentication the Rest API has. If it has simple authentication (username & password) you can enter those in the Basic Authentication Username & Basic Authentication Password properties. If you need to get Access Token (OAuth2) then you either obtain this through another InvokeHttp processor and pass it to the actual rest api invokehttp as "Authorization" header property (dynamically added to the processor), or second option is to take advantage of the "OAuth2 Access Token provider" in the InvokeHttp processor by setting up "StandardOauth2AccessTokenProvider" service and provide the credentials and the access token url there. Hope that helps. Thanks
... View more
07-24-2023
02:29 PM
1 Kudo
Hi @maglinvinn , To get the expected result, you need to convert the string type datetime to datetime type before calling the toNumber() function. The conversion can be done using the toDate() function (see: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#todate ), For example the arrivaltimeinmillis will have the following value: ${timearrival:toDate("yyyy-MM-dd'T'HH:mm:ss.SSS'Z'"):toNumber()} If you find this is helpful, please accept solution. Thanks
... View more
07-24-2023
06:36 AM
1 Kudo
Hi @VaibhavK , You can try the following spec: [
{
"operation": "shift",
"spec": {
"cells": {
"*:*": "&(0,2)"
}
}
}
] ref: https://community.cloudera.com/t5/Support-Questions/Dynamically-renaming-JSON-field-names-in-NiFi/td-p/226223 If you find this is helpful please accept solution. Thanks
... View more
07-21-2023
07:49 AM
Hi @CommanderLaus , If you do anything manually with the processor you are trying to change its Running State through the API, then yes the revision will be updated. In my case what I do is basically the first API InvokeHttp is to get the latest revision using the following GET API: https://localhost:8443/nifi-api/processors/${pipeline.start.processor.id} This will give the following response where you can parse the latest "version" value using something like EvaluateJsonPath processor and store the value in an attribute: {
"revision": {
"clientId": "value",
"version": 0,
"lastModifier": "value"
},
"id": "value",
"uri": "value",
"position": {…},
"permissions": {…},
"bulletins": [{…}],
"disconnectedNodeAcknowledged": true,
"component": {…},
"inputRequirement": "value",
"status": {…},
"operatePermissions": {…}
} Then use extracted version attribute to build the next API post Body , for example in my case I use ReplaceText processor to generate the post body : {
"revision": {
"clientId": "${pipeline.start.processor.id}",
"version": ${processorVersion}
},
"state": "...",
"disconnectedNodeAcknowledged": true
} Hope that helps.
... View more
07-21-2023
06:28 AM
1 Kudo
Hi @CommanderLaus , Are you sure that your post data is correct? It needs to be in the following format: {
"revision": {
"clientId": "value",
"version": 0,
"lastModifier": "value"
},
"state": "value",
"disconnectedNodeAcknowledged": true
} yours looks like this: {
"revision": {
"version": 18,
"clientId": "01891026-da00-199f-9dc9-ae3a37dce067"
},
"status": {
"runStatus": "RUNNING"
},
"component": {
"id": "0189100e-1e29-115c-ec96-b857cd155f4a",
"state": "RUNNING"
},
"id": "0189100e-1e29-115c-ec96-b857cd155f4a"
} refer to : https://nifi.apache.org/docs/nifi-docs/rest-api/index.html If that helps please accept solution. Thanks
... View more
07-20-2023
08:33 AM
@MattWho, @steven-matison , @cotopaul ...Can you guys help with this?
... View more
07-20-2023
07:15 AM
1 Kudo
Hi @Paulito, I noticed you are using JsonPathReader vs JsonTreeReader which what I used. I'm not if the Path Reader is the right choice and if so how to configure correctly. I tried it in my test environment against your input with different JSONPath config and it did not work for me. Can you use JsonTreeReader instead?
... View more