Member since
07-28-2022
22
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
527 | 02-03-2023 01:57 AM |
08-03-2023
07:32 AM
I have a usecase, where i have to read file from the remote windows server, my NiFi is deployed on linux machine and I have tried to use GetSFTP, FetchSFTP and ExecuteProcess but didn't able to even reach the server.
... View more
Labels:
- Labels:
-
Apache NiFi
03-14-2023
11:34 PM
I'm getting error response on InvokeAWSGatewayApi 1.17.0 processor, i have filled both the Access Key ID and Secret Access Key correctly, Same is working fine in Postman, as in Postman we have additional fields available in Authorization as Service Name and Session Token . Please suggest Response Message <ErrorResponse xmlns="https://sts.amazonaws.com/doc/2011-06-15/"> <Error> <Type>Sender</Type> <Code>SignatureDoesNotMatch</Code> <Message>Credential should be scoped to correct service: 'sts'. </Message> </Error> <RequestId>c23dd227-647b-46e2-b7bc-d0eea8f8ca33</RequestId> </ErrorResponse> Processor Screenshot
... View more
Labels:
- Labels:
-
Apache NiFi
02-10-2023
09:05 AM
Hi, I have a use case, where we're getting JSON data in complicated fashion, i have translate this object as JSON array and now am unable to extract the key/value from the array, and also there is no guarantee that every time we'll receive the Tags. Please suggest how we can extract this from array. Input JSON : [ { "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "Name\": \"OMapplication\",\"Owner\": \"Breily", "Tagscopy": [ "Name\": \"OMapplication\"", "\"Owner\": \"Breily" ], "ResourceName": "omapps" }, { "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "mobile-source-usage\": \"apple-cloud", "Tagscopy": [ "mobile-source-usage\": \"apple-cloud" ], "ResourceName": "omapps" } ] Need to do operation on "Tagscopy", we're getting random data in this. Desired JSON : [{ "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "Name\": \"OMapplication\",\"Owner\": \"Breily", "Name": "OMapplication", "Owner": "Breily", "ResourceName": "omapps" }, { "SourceId": "/Apple/bb842437dd4/sourceGroups/ALPHABAT/providers/Mobile.com/phone/isp", "Tags": "mobile-source-usage\": \"apple-cloud", "mobile-source-usage": "apple-cloud", "ResourceName": "omapps" } ] Jolt Spec Used : [ { "operation": "modify-overwrite-beta", "spec": { "*": { "SourceIdcopy": "=split('/', @(1,SourceId))", "Tagscopy": "=split(',', @(1,Tags))", "SourceName": "=lastElement(@(1,SourceIdcopy))" } } }, { "operation": "remove", "spec": { "*": { "SourceIdcopy": "" } } }, { "operation": "modify-default-beta", "spec": { "*": { "*": "&", "Tagscopy": { "*": "&" } } } } ]
... View more
Labels:
- Labels:
-
Apache NiFi
02-03-2023
01:57 AM
Hi Everyone, the API would be : GET https://<URL>/nifi-api/flowfile-queues/<id>/flowfiles/<flowfile-uuid>/content?clusterNodeId=<clusterNodeId> You'll get the content of the FlowFile in the queue.
... View more
02-02-2023
08:13 AM
@steven-matison Yes, I have the clusterNodeId , but not understand where to fit in this API. Can you please share the dummy API
... View more
02-02-2023
04:25 AM
Hi, I have a use case, where i have to see the content of each FlowFiles by triggering the API call. API i have explored so far : https://<URL>/nifi-api/flowfile-queues/<Queue-ID>/flowfiles/<FlowFile-UUID>/content I got the response as below : "The id of the node in the cluster is required." Note : My NiFi is setting up in three node cluster. Please suggest.
... View more
Labels:
- Labels:
-
Apache NiFi
01-11-2023
03:04 AM
Can anybody let me know, How i can configure NiFi ReportingTask ' SiteToSiteBulletinReportingTask 1.17.0 ' using NiFi CLI command.
... View more
Labels:
- Labels:
-
Apache NiFi
01-04-2023
02:49 AM
Hi Team, Am getting error on JoinEnrichment and don't know why it is coming, Please suggest. My query in JoinEnrichment : SELECT original.*, enrichment.* FROM original FULL JOIN enrichment ON original.name = enrichment.name Error receiving JoinEnrichment[id=a17b1f06-f80c-3641-945f-c2ff331f8028] Failed to join 'original' FlowFile FlowFile[filename=cmdbci-mtaas] and 'enrichment' FlowFile FlowFile[filename=cmdbci-mtaas]; routing to failure: java.sql.SQLException: Error while preparing statement [SELECT original., enrichment. FROM original FULL JOIN enrichment ON original.name = enrichment.name] Caused by: org.apache.calcite.runtime.CalciteContextException: From line 4, column 4 to line 4, column 34: Cannot apply '=' to arguments of type '<JAVATYPE(CLASS JAVA.LANG.OBJECT)> = <JAVATYPE(CLASS JAVA.LANG.STRING)>'. Supported form(s): '<COMPARABLE_TYPE> = <COMPARABLE_TYPE>' Caused by: : Corg.apache.calcite.sql.validate.SqlValidatorExceptionannot apply '=' to arguments of type '<JAVATYPE(CLASS JAVA.LANG.OBJECT)> = <JAVATYPE(CLASS JAVA.LANG.STRING)>'. Supported form(s): '<COMPARABLE_TYPE> = <COMPARABLE_TYPE>' Sample input from Original Location,Environment,ip_address,category,name,dv_sys_updated_on "",,,Hardware,Ndiggan,2022-12-17 22:37:28 "",,,Hardware,class,2022-12-31 22:37:38 "",,,,Vlan2,2022-12-27 02:17:13 Sample input from Enrichment Location,Environment,ip_address,category,name,dv_sys_updated_on "",,,Hardware,vpna,2022-12-17 22:36:02 "",,,Hardware,dlcccno,2022-12-17 22:37:04 "",,,Hardware,Ndiggan,2022-12-17 22:37:28
... View more
Labels:
- Labels:
-
Apache NiFi
12-21-2022
07:53 AM
@MattWho Thanks for the response, Below is the inline comments and my scenario. 1. Is this a one time execution flow? -Not 2. if not, how do you differentiate between different complete batches (when does new one merge bundle end and another begin?)? - I'm calling the same rest-api with the record limit of 1000, and let suppose my attribute " X-Total-Count " is 5600 (record), then am going to call the rest-api 6 times. (1000*6) to capture the complete record. so till reach to 5600 records i want "Wait" processor before merge it all. 3. Are all 1000 records from each rest-api call going into a single NiFi FlowFile or 1 FlowFile per record? -One FlowFile per record, as after "invokeHTTP" am using "splitjson". 4. Is there some correlation identifier as a rest of rest-api call that identifies all 1000 Record batch pulls as part of same complete bundle? -i'm using offset for this. What I have : rest-api with limit set to 1000, total number of records is not always same, capturing from " X-Total-Count ". What am looking for : Before merge the whole data, i want "Wait" processor for waiting the completion of API (api could be run 2 times or 15times) after getting the whole data that "FlowFile" (fragment.count) is equals to "X-Total-Count" i.e ${fragment.count:equals(${X-Total-Count})}. then it notify to pass all data "MergerRecord" and a single FlowFile would generates.
... View more
12-21-2022
06:07 AM
I have a scenario where am triggering API in batches (1000 records in each). from the first API I get the value of total records in attribute list X-Total-Count , i wants to merge them all. Please let me know how i can leverage the wait processor in it to wait until we get the whole data till value of X-Total-Count . Wait Processor properties, i have configured.
... View more
Labels:
- Labels:
-
Apache NiFi