I would like to develop a custom web application to visualise results from HDP.
Is there any component that allows me to access data (from Hbase, HDFS) in real-time (or near real time).
@Zaher Mahdhi, Taking OpenSOC / Apache Metron as an example, The data gets ingested into HDFS through Kafka and Flume and with Storm Topologies processes the input messages/events from the Kafka Topics and enriches them and pushes the data back to HDFS/Hive and also to Elasticsearch(Kibana) , You can visualise the enriched data via Kibana.
Storm is an near real time strem processing engine.
There are various tools in the market to visualise the data sitting in HDFS/Hive. E.g Splunk.
I think this question answer might help. Kibana is an option but personally I like to have my application go against a proper SQL interface. There are tons of possibilities there/ And both Hive and Phoenix can provide this depending on your usecase. on to use something like BIRT or Pentaho.