sentiment analysis with HDP

[#1]

Hi all

I am a master student I want work my thesis in sentiment analysis with hadoop in arabic language, so my question is here support this language ?

Thanks

[#2 · Accepted solution]

Depends what you want to do. By itself Hadoop doesn't support any sentiment analysis. So you need to use a sentiment analytics package. HAdoop is mostly written on Java so pretty much all Java packages will work. Java itself handles strings as UTF so arabic is supported by itself.

The biggest ones are

Stanford NLP

OpenNLP

and Gate

From a quick google search both gate and stanford support some arabic features:

https://gate.ac.uk/gate/plugins/Lang_Arabic/src/arabic/

http://nlp.stanford.edu/projects/arabic.shtml

If you want to run these packages in hadoop you will have to decide if you want to run them in

- MapReduce

- as pig udfs perhaps

- Spark

( Hadoop Streaming and Spark also support python, so you could use nltk but I would suggest Java )

[#3]

@ali hadi

additionally

http://hortonworks.com/hadoop-tutorial/nlp-sentiment-analysis-retailers-using-hdp-itc-infotech-radar...

http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/

and a video http://hortonworks.com/use-cases/sentiment-analysis-hadoop-example/