POST with Content-Type: text/plain Helped in my case Thanks ... View more

@Jose Luis Navarro Vicente This is the working Spark Pi example for your reference. curl -X POST -H "Content-Type: application/json"  localhost:8998/batches --data '{ "conf": {"spark.master":"yarn-cluster"}, "file": "file:///usr/hdp/current/spark-client/lib/spark-examples-1.6.1.2.5.0.0-817-hadoop2.7.1.2.5.0.0-817.jar", "className": "org.apache.spark.examples.SparkPi", "name": "Scala Livy Pi Example", "executorCores":1, "executorMemory":"512m", "driverCores":1, "driverMemory":"512m", "queue":"default", "args":["100"]}' ... View more

@Jose Luis Navarro Vicente you can try https://github.com/spark-jobserver/spark-jobserver, once submitted check the status of job and if it got killed resubmit it. ... View more

I am able to connect using kafka-console-producer from other machine and I am also able to connect using kafka-console-consumer. In fact, other machines can keep connecting and sending messages over topics, the only problem is when I try to submit a spark job, I have specified the port change for this spark job but it just fails. ... View more

Hello sbhat, Thanks for your answer, this seems to be closer the answer. They are not registered, indeed. However the ambari-agent.ini contains the correct fqdn of ambari server, and it can be resolved. In fact, even the ambari-agent in the same machine where ambari-server is is not shown as registered. Any idea? The agent is running on all hosts, double checked. ... View more

So as far as I can see here, this issue only happens if I directly clone the git repo to the desired location. If I clone the repo in any other directory then copy the content, there are no issues. Any idea why this happens? ... View more