question Re: REST API command to upload Tez tar files in Support Questions

REST API command to upload Tez tar files

aggo — Wed, 16 Aug 2023 12:33:55 GMT

Hello,

I'm trying to upload the tez tar files using a rest api command, but I'm not able to find any in the swagger documentation (maybe I just missed it..)

I've tried replicating the url that is pointed at when using the button through the UI, but I require the Tez service ID for it, and I couldn't find an API call to get that neither..

Is there an easier way to do this perhaps? Or if you know about one of the api calls I'm missing from the swagger docs mentioned above, that would help me as well.

Thanks!

Re: REST API command to upload Tez tar files

DianaTorres — Wed, 16 Aug 2023 17:36:53 GMT

@aggo Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Tez experts @Shmoo @cravani who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: REST API command to upload Tez tar files

aggo — Thu, 17 Aug 2023 17:59:47 GMT

After looking some more in the forums, I realise that to do this I can enable WebHDFS and use the Snakebite library. However, that's not how i will go about this.
I'm trying to get it working using hdfs in the command line, but so far I'm not being able to replicate what the UI does. I will report back when I have a working solution. (sorry for the edits)

Re: REST API command to upload Tez tar files

aggo — Fri, 18 Aug 2023 11:48:02 GMT

tez_version="0.9.1.7.1.3.0-100" export HADOOP_USER_NAME=hdfs hdfs dfs -mkdir -p /user/tez/$tez_version hdfs dfs -chown tez:hadoop /user/tez/$tez_version hdfs dfs -chmod 0755 /user/tez/$tez_version hdfs dfs -put /opt/cloudera/parcels/CDH/lib/tez/tez.tar.gz /user/tez/$tez_version/tez.tar.gz hdfs dfs -chown tez:hadoop /user/tez/$tez_version/tez.tar.gz hdfs dfs -chmod 0644 /user/tez/$tez_version/tez.tar.gz

These are the commands I ended up using.