Member since
07-15-2018
4
Posts
0
Kudos Received
0
Solutions
07-18-2018
01:41 PM
@Felix Albani I have tried below curl commands- curl -X POST -d
'{"className": "com.company.scala.ScyllaSpanByTest" ,
"file":
"hdfs://dhdfsserver:8020/user/spark/jars/Test-assembly-0.1.jar"}'
-H "Content-Type: application/json" -H "X-Requested-By:
user" http://livyserver:8999/batches
curl -X POST -d
'{"conf": {"kind": "spark"
,"className": "com.company.scala.ScyllaSpanByTest" ,
"jars":
"hdfs://hdfsserver:8020/user/spark/jars/Test-assembly-0.1.jar"
}}' -H "Content-Type: application/json" -H "X-Requested-By:
user" http://livyserver:8999/sessions
... View more
07-16-2018
04:51 AM
Thanks @Felix Albani I will try that. Is it possible to upload jar file which is present locally on my server from where I executing curl?
... View more
07-15-2018
03:35 PM
Thanks for your quick reply @Felix Albani Suppose me Livy Server IP is on X.X.X.X (port 8999) and I am executing CURL from server with Y.Y.Y.Y My jar file is present on server Y.Y.Y.Y at location /home/app/work Does below command looks good to you? curl -X POST -d '{"conf": {"kind": "spark" , "jars": "hdfs://Y.Y.Y.Y:8020/home/app/work/scalajar/helloworld.jar"}}' -H "Content-Type: application/json" -H "X-Requested-By: user" http://X.X.X.X:8999/sessions Also can I specify "kind": "spark" as above in my curl command?
... View more
07-15-2018
01:00 PM
I am new to Livy. I am able to run scala code through Livy api POST statement as described here - https://livy.incubator.apache.org/examples/ How can I submit a Jar file using API?
... View more
Labels:
- Labels:
-
Apache Spark