question Re: sentiment analysis with HDP in Archives of Support Questions (Read Only)

sentiment analysis with HDP

c1579459 — Fri, 16 Sep 2022 10:06:51 GMT

Hi all

I am a master student I want work my thesis in sentiment analysis with hadoop in arabic language, so my question is here support this language ?

Thanks

Re: sentiment analysis with HDP

bleonhardi — Thu, 03 Mar 2016 00:20:23 GMT

Depends what you want to do. By itself Hadoop doesn't support any sentiment analysis. So you need to use a sentiment analytics package. HAdoop is mostly written on Java so pretty much all Java packages will work. Java itself handles strings as UTF so arabic is supported by itself.

The biggest ones are

Stanford NLP

OpenNLP

and Gate

From a quick google search both gate and stanford support some arabic features:

https://gate.ac.uk/gate/plugins/Lang_Arabic/src/arabic/

http://nlp.stanford.edu/projects/arabic.shtml

If you want to run these packages in hadoop you will have to decide if you want to run them in

- MapReduce

- as pig udfs perhaps

- Spark

( Hadoop Streaming and Spark also support python, so you could use nltk but I would suggest Java )

Re: sentiment analysis with HDP

aervits — Thu, 03 Mar 2016 01:04:45 GMT

@ali hadi

additionally

http://hortonworks.com/hadoop-tutorial/nlp-sentiment-analysis-retailers-using-hdp-itc-infotech-radar/

http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/

and a video http://hortonworks.com/use-cases/sentiment-analysis-hadoop-example/