<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Error while submitting PySpark Application through Livy REST API in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/Error-while-submitting-PySpark-Application-through-Livy-REST/m-p/287376#M213015</link>
    <description>&lt;P&gt;Hi,&lt;/P&gt;
&lt;P&gt;&amp;nbsp; &amp;nbsp; I want to submit a Pyspark application to Livy through REST API to invoke HiveWarehouse Connector. Based on this answer in the community&lt;/P&gt;
&lt;P&gt;&lt;A href="https://community.cloudera.com/t5/Community-Articles/How-to-Submit-Spark-Application-through-Livy-REST-API/ta-p/247502" target="_blank" rel="noopener"&gt;https://community.cloudera.com/t5/Community-Articles/How-to-Submit-Spark-Application-through-Livy-REST-API/ta-p/247502&lt;/A&gt;&lt;/P&gt;
&lt;P&gt;I created a test1.json as follows&lt;/P&gt;
&lt;P&gt;{&lt;BR /&gt;"jars": ["hive-warehouse-connector-assembly-1.0.0.3.1.0.0-78.jar"],&lt;BR /&gt;"pyFiles": ["pyspark_hwc-1.0.0.3.1.0.0-78.zip"],&lt;BR /&gt;"files": ["test1.py"]&lt;BR /&gt;}&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;I use GetFile to get the json file and call InvokeHTTP to POST the request. I get the following error in HTTP Response&lt;/P&gt;
&lt;DIV&gt;This is HTTP response
&lt;DIV&gt;invokehttp.response.body&lt;/DIV&gt;
&lt;DIV&gt;"requirement failed: File is required."&lt;/DIV&gt;
&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;DIV&gt;I am not sure whether the field "files" should have the pyspark script or whether the pyspark script should be listed against 'pyFiles'. I tried this also but I get the same error. Please let me know what I am missing?&lt;/DIV&gt;
&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;
&lt;DIV&gt;Thanks&lt;/DIV&gt;
&lt;DIV&gt;Ganesh&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Fri, 10 Jan 2020 15:51:58 GMT</pubDate>
    <dc:creator>TVGanesh</dc:creator>
    <dc:date>2020-01-10T15:51:58Z</dc:date>
  </channel>
</rss>

