I'm trying to execute some existing examples using the Rest API (with or without using the Knox gateway)
It seems to work, but the task is always marked as failed in the Yarn Web UI.
I Use the hadoop-mapreduce-examples.jar to launch a wordcount example. It creates a sub task which is properly executed, it creates all the expected files in /user/yarn/output10.
But the parent task always failed with an exit code = 0 ( looks like a success
I send a POST request on this URL (I did the new-application command before to get my application-id)
(I tried also without knox : http://serverip:8088/ws/v1/cluster/apps, with the same result)
And I transmit this JSON command :
"command":"yarn jar /usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-examples.jar wordcount /user/yarn/input /user/yarn/output10"
I tried a lot of other JSON config with the same result (this one is the simpliest I tried)
Do you have any idea what I did wrong ?
Thanks in advance
I forgot this :
Ambari version : Version 220.127.116.11
Hadoop version 18.104.22.168-1245 installed from Ambari (not a sandbox)
Hi @dvt isoft,
You cannt actually submit MR / Tez job via Yarn Webservices. Can you please try with Distributed Shell application if you want to use REST api? Or you can store your job in HDFS and use OOZIE workflow over it or use SPARK.