@MattWho Thanks for your reply 👍 ... View more

@joseomjr  Thanks for the reply. So you are reading the file from local using Groovy processor which is invoked  in InvokeScriptedProcessor ?? ... View more

@MattWho  Thanks for you response. Use case is basically to only upload file using API, and not to download.  We have an UI which is used upload a file, On click of choose file we were planning to call our backend API which inturn calls NiFi HandleHTTPRequest API.  Authorization will part of UI and API. Also, NiFi API will not be directly exposed externally.      Since we were exploring our options in Nifi, we are trying this approach. If you feel this is not achievable or not the right approach, we can drop this and look into other options. Thank you ... View more

Thanks Matt,  Was able to resolve the issue with your putFile solution. ... View more

For the record Able to resolve the fetching issue, there was port number missing in the overridden URL. However, now i get a different error when writing the file to local disk. PutFile[id=07413ab5-d3d2-1e9a-99b0-c0f57682f17c] Penalizing FlowFile[filename=20242323/year/year.txt] and transferring to failure: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to export StandardFlowFileRecord[uuid=35019b7d-1e33-44db-8432-6a54b2f6586e,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1729535188764-436, container=default, section=436], offset=70, length=16],offset=0,name=20242323/year/year.txt,size=16] to /apps/fex/shared/mina/archive/.20242323/year/year.txt due to java.io.FileNotFoundException: /apps/fex/shared/mina/archive/.20242323/year/year.txt (No such file or directory) - Caused by: java.io.FileNotFoundException: /apps/fex/shared/mina/archive/.20242323/year/year.txt (No such file or directory)   ... View more

Credentials and region are correct as I'm able to fetch the file if they are directly under home directory (20242323) of the bucket. The issue is fetching files that are under folder/subfolders like "month" or "year" in this case.     ListS3 Properties       FetchS3Object Properties     ... View more

Thank you for your reply. 1. In ListS3, Im able to list the files, no issues here. Issue is with the next step of FetchS3Object which gives me below error. ERROR FetchS3Object[id=99843c65-eeb7-1140-824f-1258d088506d] Failed to retrieve S3 Object for FlowFile[filename=20242323/year/year.txt]; routing to failure: com.amazonaws.services.s3.model.AmazonS3Exception: null (Service: Amazon S3; Status Code: 404; Error Code: NoSuchKey; Request ID: tx00000631cd5ef67d0d1fd-006716305c-c9f4b0-ttce-stage-singlesite-zone; S3 Extended Request ID: c9f4b0-ttce-stage-singlesite-zone-ttce-stage-singlesite-zonegroup; Proxy: null), S3 Extended Request ID: c9f4b0-ttce-stage-singlesite-zone-ttce-stage-singlesite-zonegroup 2. Yes, we do have access to the bucket. We are able to recursively get it from Shell script using AWS S3 commands.   ... View more