Programatically upload files to Cloudera Workbench Project

ask_bill_brooks · ‎12-02-2019

Hi all,

Is there any API for us to programmatically upload / put files onto a Cloudera Workbench Project? Thanks.

GangWar · ‎02-05-2020

I am not aware of any, but you could do it by ssh like we use to upload other files.

Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Royles · ‎02-07-2020

We would suggest using the Jobs function. Jobs have an API, so they can be tasked externally to CDSW.

https://docs.cloudera.com/documentation/data-science-workbench/1-6-x/topics/cdsw_rest_apis.html

You can then wrap a shell script or python script with a Job to perform data file operations for example using wget, s3 sync etc.

Would this meet your requirements? If not can you expand on your requirements further please?