Created on 06-10-2022 07:43 AM - edited 06-10-2022 07:44 AM
Hi, I 'am trying to delete all the files that there are into the path from S3 Bucket. For example I have Buketname/Input_file and on this I have:
File1.txt
File2.txt
File2.txt
....
I need to delete all the files but not the bucket.
If I conect ListS3 process to DeleteS3Objet process I can delete all the files but it delete the path too.
If I connect ListS3 process --> FetchS3Object-->RouteonAttribute (to obtain the file name and discard the path that came as file name too using matched and not matched) -->DeleteS3Object to do the delete action. All the process work well and I don't have error but the files is not delete.
Could somebody tell me, how can resolve this issue?
There are some topic that talk about how delete the files in s3 but without delete the path?
Thanks
Created 06-14-2022 03:01 PM
I was able to solve this problem.
I will sahre the way to delete the files that there are inside the specific path.
First I list the files as show in the first picture.
I had to set the bucket name, delimiter and prefix as shown in the second and third images.
The prefix is used to filter the files from the path.
(In this case
Buketname/To_Proccess/Input/
File1.txt
File2.txt
File3.txt
)
The delimeter is '/'
After that I use RouteOnAttribute and set it to filter the '/' as is showed in the picture:
And the last step is configure DeleteS3Object process where only have to set the name of the bucket. In my case 'Bucketname'.
All these proccess delete File1.txt, File2.txt, File3.txt but not delete the path '/To_Proccess/Input/' inside the bucket.
Created 06-14-2022 03:01 PM
I was able to solve this problem.
I will sahre the way to delete the files that there are inside the specific path.
First I list the files as show in the first picture.
I had to set the bucket name, delimiter and prefix as shown in the second and third images.
The prefix is used to filter the files from the path.
(In this case
Buketname/To_Proccess/Input/
File1.txt
File2.txt
File3.txt
)
The delimeter is '/'
After that I use RouteOnAttribute and set it to filter the '/' as is showed in the picture:
And the last step is configure DeleteS3Object process where only have to set the name of the bucket. In my case 'Bucketname'.
All these proccess delete File1.txt, File2.txt, File3.txt but not delete the path '/To_Proccess/Input/' inside the bucket.