Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

how to apply sentiment analysis algorithms on data stored in hive by using spark ?

avatar
New Contributor

Hello everyone, I'm streaming data from twitter in json format by using apache flume and storing it then in HDFS, then i load json files from hdfs into an external hive table, but the problem is that tweets texts aren't classified, i need to extract only profils who are against the issue i'm working on , and i was wondering how can i use apache spark to extract these data from my hive table and then apply sentiment analysis algorithms on extraxted tweets texts.

Thanks.

1 ACCEPTED SOLUTION

avatar
Master Mentor
@oumayma ajengui

See this demo https://community.hortonworks.com/articles/7819/apache-zeppelin-hive-spark-demo.html

You will have to write your process to make it work for your usecase but above demo can be a good starting point.

View solution in original post

1 REPLY 1

avatar
Master Mentor
@oumayma ajengui

See this demo https://community.hortonworks.com/articles/7819/apache-zeppelin-hive-spark-demo.html

You will have to write your process to make it work for your usecase but above demo can be a good starting point.