- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Delete File inside AWS S3 bucket path
- Labels:
-
Apache NiFi
Created on ‎06-10-2022 07:43 AM - edited ‎06-10-2022 07:44 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi, I 'am trying to delete all the files that there are into the path from S3 Bucket. For example I have Buketname/Input_file and on this I have:
File1.txt
File2.txt
File2.txt
....
I need to delete all the files but not the bucket.
If I conect ListS3 process to DeleteS3Objet process I can delete all the files but it delete the path too.
If I connect ListS3 process --> FetchS3Object-->RouteonAttribute (to obtain the file name and discard the path that came as file name too using matched and not matched) -->DeleteS3Object to do the delete action. All the process work well and I don't have error but the files is not delete.
Could somebody tell me, how can resolve this issue?
There are some topic that talk about how delete the files in s3 but without delete the path?
Thanks
Created ‎06-14-2022 03:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I was able to solve this problem.
I will sahre the way to delete the files that there are inside the specific path.
First I list the files as show in the first picture.
I had to set the bucket name, delimiter and prefix as shown in the second and third images.
The prefix is used to filter the files from the path.
(In this case
Buketname/To_Proccess/Input/
File1.txt
File2.txt
File3.txt
)
The delimeter is '/'
After that I use RouteOnAttribute and set it to filter the '/' as is showed in the picture:
And the last step is configure DeleteS3Object process where only have to set the name of the bucket. In my case 'Bucketname'.
All these proccess delete File1.txt, File2.txt, File3.txt but not delete the path '/To_Proccess/Input/' inside the bucket.
Created ‎06-14-2022 03:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I was able to solve this problem.
I will sahre the way to delete the files that there are inside the specific path.
First I list the files as show in the first picture.
I had to set the bucket name, delimiter and prefix as shown in the second and third images.
The prefix is used to filter the files from the path.
(In this case
Buketname/To_Proccess/Input/
File1.txt
File2.txt
File3.txt
)
The delimeter is '/'
After that I use RouteOnAttribute and set it to filter the '/' as is showed in the picture:
And the last step is configure DeleteS3Object process where only have to set the name of the bucket. In my case 'Bucketname'.
All these proccess delete File1.txt, File2.txt, File3.txt but not delete the path '/To_Proccess/Input/' inside the bucket.
