About Iltano

Iltano · ‎06-14-2022

I was able to solve this problem. I will sahre the way to delete the files that there are inside the specific path. First I list the files as show in the first picture. I had to set the bucket name, delimiter and prefix as shown in the second and third images. The prefix is used to filter the files from the path. (In this case Buketname/To_Proccess/Input/ File1.txt File2.txt File3.txt ) The delimeter is '/' After that I use RouteOnAttribute and set it to filter the '/' as is showed in the picture: And the last step is configure DeleteS3Object process where only have to set the name of the bucket. In my case 'Bucketname'. All these proccess delete File1.txt, File2.txt, File3.txt but not delete the path '/To_Proccess/Input/' inside the bucket.

Iltano · ‎06-10-2022

Hi, I 'am trying to delete all the files that there are into the path from S3 Bucket. For example I have Buketname/Input_file and on this I have: File1.txt File2.txt File2.txt .... I need to delete all the files but not the bucket. If I conect ListS3 process to DeleteS3Objet process I can delete all the files but it delete the path too. If I connect ListS3 process --> FetchS3Object-->RouteonAttribute (to obtain the file name and discard the path that came as file name too using matched and not matched) -->DeleteS3Object to do the delete action. All the process work well and I don't have error but the files is not delete. Could somebody tell me, how can resolve this issue? There are some topic that talk about how delete the files in s3 but without delete the path? Thanks

Online	Offline
Last Visited	‎06-16-2022 09:53 AM

Member Since	‎06-10-2022 06:06 AM
Last Visited	‎06-16-2022 09:53 AM
Posts	2

Cloudera Community

Re: Delete File inside AWS S3 bucket path

Re: Delete File inside AWS S3 bucket path

Delete File inside AWS S3 bucket path