I have a use case, where i wants to capture threshold value of a 'Maximum Threads' size in an HandlehttpRequest processor and notification should send to bulletin board  or any event form message.  the maximum value we can set is 1000 (one thousand) and if it's reached to 700 then a flowfile/event/bulletin board message would initiate with this information that Maximum threads limit about to breach. ... View more

I need to retrieve all flowfiles in a specific queue in NiFi, but the API only returns up to 100 results at a time. My queue contains 358 flowfiles, so I need a way to retrieve all of them Below are the API am using for get the flowfiles. API : https://myserver.com:myport/nifi-api/flowfile-queues/ba619122-3c65-3279-a2ba-b3ad89f8a429/listing-requests/903d485f-d4aa-102a-0000-0112e4a15ea   { "listingRequest": { "id": "903d485f-d4aa-102a-0000-0112e4a15ea", "uri": "https://myserver.com:myport/nifi-api/flowfile-queues/ba619122-3c65-3279-a2ba-b3ad89f8a429/listing-requests/903d485f-d4aa-102a-0000-0112e4a15ea", "submissionTime": "10/18/2023 17:07:57.632 IST", "lastUpdated": "17:07:57 IST", "percentCompleted": 1, "finished": true, "maxResults": 100, "state": "Completed successfully", "queueSize": { "byteCount": 3792, "objectCount": 350 }, "flowFileSummaries": [ { "HERE IS THE FLOW FILES TILL 100TH POSITIONS": 100 } ] } } ... View more

I have a usecase, where i have to read file from the remote windows server, my NiFi is deployed on linux machine and I have tried to use GetSFTP, FetchSFTP and ExecuteProcess but didn't able to even reach the server.  ... View more

I'm getting error response on InvokeAWSGatewayApi 1.17.0 processor, i have filled both the Access Key ID and Secret Access Key correctly, Same is working fine in Postman, as in Postman we have additional fields available in Authorization as Service Name and Session Token . Please suggest   Response Message <ErrorResponse xmlns="https://sts.amazonaws.com/doc/2011-06-15/"> <Error> <Type>Sender</Type> <Code>SignatureDoesNotMatch</Code> <Message>Credential should be scoped to correct service: 'sts'. </Message> </Error> <RequestId>c23dd227-647b-46e2-b7bc-d0eea8f8ca33</RequestId> </ErrorResponse>   Processor Screenshot   ... View more

Hi, I have a use case, where we're getting JSON data in complicated fashion, i have translate this object as JSON array and now am unable to extract the key/value from the array, and also there is no guarantee that every time we'll receive the Tags.   Please suggest how we can extract this from array.   Input JSON : [ { "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "Name\": \"OMapplication\",\"Owner\": \"Breily", "Tagscopy": [ "Name\": \"OMapplication\"", "\"Owner\": \"Breily" ], "ResourceName": "omapps" }, { "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "mobile-source-usage\": \"apple-cloud", "Tagscopy": [ "mobile-source-usage\": \"apple-cloud" ], "ResourceName": "omapps" } ]   Need to do operation on "Tagscopy", we're getting random data in this. Desired JSON : [{ "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "Name\": \"OMapplication\",\"Owner\": \"Breily", "Name": "OMapplication", "Owner": "Breily", "ResourceName": "omapps" }, { "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "mobile-source-usage\": \"apple-cloud", "mobile-source-usage": "apple-cloud", "ResourceName": "omapps" } ]   Jolt Spec Used : [ { "operation": "modify-overwrite-beta", "spec": { "*": { "SourceIdcopy": "=split('/', @(1,SourceId))", "Tagscopy": "=split(',', @(1,Tags))", "SourceName": "=lastElement(@(1,SourceIdcopy))" } } }, { "operation": "remove", "spec": { "*": { "SourceIdcopy": "" } } }, { "operation": "modify-default-beta", "spec": { "*": { "*": "&", "Tagscopy": { "*": "&" } } } } ] ... View more

Can anybody let me know, How i can configure NiFi ReportingTask 'SiteToSiteBulletinReportingTask 1.17.0' using NiFi CLI command. ... View more

Hi Team,  Am getting error on JoinEnrichment and don't know why it is coming, Please suggest. My query in JoinEnrichment : SELECT original.*, enrichment.* FROM original FULL JOIN enrichment ON original.name = enrichment.name Error receiving JoinEnrichment[id=a17b1f06-f80c-3641-945f-c2ff331f8028] Failed to join 'original' FlowFile FlowFile[filename=cmdbci-mtaas] and 'enrichment' FlowFile FlowFile[filename=cmdbci-mtaas]; routing to failure: java.sql.SQLException: Error while preparing statement [SELECT original., enrichment. FROM original FULL JOIN enrichment ON original.name = enrichment.name] Caused by: org.apache.calcite.runtime.CalciteContextException: From line 4, column 4 to line 4, column 34: Cannot apply '=' to arguments of type '<JAVATYPE(CLASS JAVA.LANG.OBJECT)> = <JAVATYPE(CLASS JAVA.LANG.STRING)>'. Supported form(s): '<COMPARABLE_TYPE> = <COMPARABLE_TYPE>' Caused by: : Corg.apache.calcite.sql.validate.SqlValidatorExceptionannot apply '=' to arguments of type '<JAVATYPE(CLASS JAVA.LANG.OBJECT)> = <JAVATYPE(CLASS JAVA.LANG.STRING)>'. Supported form(s): '<COMPARABLE_TYPE> = <COMPARABLE_TYPE>' Sample input from Original Location,Environment,ip_address,category,name,dv_sys_updated_on "",,,Hardware,Ndiggan,2022-12-17 22:37:28 "",,,Hardware,class,2022-12-31 22:37:38 "",,,,Vlan2,2022-12-27 02:17:13 Sample input from Enrichment Location,Environment,ip_address,category,name,dv_sys_updated_on "",,,Hardware,vpna,2022-12-17 22:36:02 "",,,Hardware,dlcccno,2022-12-17 22:37:04 "",,,Hardware,Ndiggan,2022-12-17 22:37:28  ... View more