Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Execute Stream Command - Unable to remove files using Wilcards

avatar
Contributor

Hello,

hope someone can point me in the right direction.

I need to delete all files starting with some attributes value, so based on Linux way it should be something like this:

 

rm -f /opt/my_path/myfile_*

 

I decided to use Execute Stream Command in this way:

 

Ray82_0-1678900528929.pngRay82_1-1678900558212.png

The path seem correct, the command generated, pasted into a Linux shell is working fine, however the processor did not delete the files.

If i try with a specific file it works fine.

Seems that * is not permitted, any clue?

 

Many Thanks to everybody...

 

2 ACCEPTED SOLUTIONS

avatar

hmmm, try maybe with:
Command Path = bash
Command Arguments = -c;"rm -f /home/bigdata/testFolder/myfile_*"
I tried this on my local machine and it seems to be working accordingly.

cotopaul_1-1678959773167.png

 

View solution in original post

avatar
Contributor

This should work, in the past i've tried the same command with ExecuteProcess but it didn't accept upstream connections.

 

Your solution is working great!

 

Many thabks for your supporto.

View solution in original post

4 REPLIES 4

avatar

Hi @Ray82 , I am shooting here in the blind, but have you tried setting the command Path = /usr/bin only and the Command arguments = rm -f and_everytyhing_else?
I am asking because I am using the ExecuteStreamCommand similar as you are but with python and within the command path i set python and the entire thing I have to execute under the command arguments and it works like a charm. It might not be the recommended way of using this processor but at least I got my things running.

avatar
Contributor

Hi,

tried your suggestion, however in that case this is the error:

Ray82_0-1678956949728.png

 

avatar

hmmm, try maybe with:
Command Path = bash
Command Arguments = -c;"rm -f /home/bigdata/testFolder/myfile_*"
I tried this on my local machine and it seems to be working accordingly.

cotopaul_1-1678959773167.png

 

avatar
Contributor

This should work, in the past i've tried the same command with ExecuteProcess but it didn't accept upstream connections.

 

Your solution is working great!

 

Many thabks for your supporto.