Created 02-02-2018 06:23 AM
We are trying to build web application using spark for various web applications , i.e returning the result in json which is processed by spark engine or Impala.
Created 02-02-2018 09:45 PM
I believe you meant Spark "Thrift Server" @kgautam
http://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
The alternative would be to use Apache Livy
Created 02-02-2018 03:24 PM
Yes you can defintely spawn a Spark application from webservice.
SparkServer2 is meant for this purpose, It provides a JDBC connection through which you can submit a spark job.
* Do remember sparks jobs are not meant for a key value lookup. Please think in terms of Hbase, solr for such use cases.
Created 02-02-2018 09:45 PM
I believe you meant Spark "Thrift Server" @kgautam
http://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
The alternative would be to use Apache Livy