Code Repositories

Find and share code repositories
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.
Labels (1)
Repo Description

This Demo is built for Hortonworks HDP 2.3 Sandbox.

This is based on the Hortonworks Twitter Demo

Purpose: Monitor Twitter stream for the procided Hastags & act on unexpected increases in tweet volume

  • Ingest: Listen for Twitter streams related to Hashtags input in NiFi Garden Hose (GetHTTP) processor
  • Processing:
    • Monitor tweets for unexpected volume
    • Volume thresholds managed in HBASE
  • Persistence:
    • HDFS (for future batch processing)
    • Hive (for interactive query)
    • HBase (for realtime alerts)
    • Solr/Banana (for search and reports/dashboards)
  • Refine:
    • Update threshold values based on historical analysis of tweet volumes
  • Demo setup:
    • Either download and start prebuilt VM
    • Start HDP 2.3 sandbox and run provided scripts to setup demo
Repo Info
Github Repo URL
Github account name vedantja
Repo name hdp_nifi_twitter_demo
0 Kudos
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.
Version history
Last update:
‎02-02-2017 04:26 PM
Updated by: