- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Can I run the spark for the web application?
- Labels:
-
Apache Hadoop
-
Apache Spark
Created ‎02-02-2018 06:23 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We are trying to build web application using spark for various web applications , i.e returning the result in json which is processed by spark engine or Impala.
Created ‎02-02-2018 09:45 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I believe you meant Spark "Thrift Server" @kgautam
http://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
The alternative would be to use Apache Livy
Created ‎02-02-2018 03:24 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes you can defintely spawn a Spark application from webservice.
SparkServer2 is meant for this purpose, It provides a JDBC connection through which you can submit a spark job.
* Do remember sparks jobs are not meant for a key value lookup. Please think in terms of Hbase, solr for such use cases.
Created ‎02-02-2018 09:45 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I believe you meant Spark "Thrift Server" @kgautam
http://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
The alternative would be to use Apache Livy
