@Raghavendran Chellappa Tableau or any other BI tool for that matter can't connect directly to Spark Streaming. Spark Streaming only processes the data -- you still need to persist it in HDFS or somewhere else before Tableau or anything else can connect to it. In case you need to do interactive analysis with a very short SLA, you need a system which can index the data. Pure row scans won't cut it. One example would be to connect Spark Streaming to Solr. Solr will index the data as it is inserted. You can then build a read-only dashboard using Banana, or build a custom app which queries Solr for user-defined queries. So the flow is: Streaming Data -> Spark Streaming -> Solr -> Banana Dashboard (or a custom app if interactivity is desired) Look here for an example of streaming Tweets from Spark into Solr: https://doc.lucidworks.com/lucidworks-hdpsearch/2....
... View more
