Support Questions

Find answers, ask questions, and share your expertise

Is Horton Works Community Connection site using Hadoop for processing Data???

avatar
Expert Contributor

Community connection doing fantastic job by providing solutions to the User's Problems.But My Question is like,Are Developers using Hadoop or related field in developing this??? If yes,what are those???

1 ACCEPTED SOLUTION

avatar

As @Jonas Straub states we are using AnswerHub for our functionality. The backend database is MySQL, but here is their stack: http://docs.answerhub.com/articles/1073/answerhub-architecture.html

View solution in original post

5 REPLIES 5

avatar

At the moment Hortonworks Community is using AnswerHub as a platform. I believe they are using Django as a backend framework, not sure though. As far as I know we have not connected any HDP tool, @Mark Herring has all the details.

We could definitely use some of the tools from our HDP stack to power different services of our community site. Are you working on a similar use case?

avatar
Expert Contributor

@Jonas Straub

I am not working on any use case similar to community. I am working on Hadoop only. Just thinking how we can connect our HDP tools to power communities like this.

avatar

Here are some use case for a community like this:

  • Solr to power the search engine of the community
  • Hive to analyze access logs and user interaction
  • Kafka/Storm to prevent spam (kind of like FraudDetection for banks) and process posts (filter bad words, escape posts, etc.)

I also like the use case from Facebook, they are using HBase for their messages, chats, etc. (https://www.facebook.com/notes/facebook-engineering/the-underlying-technology-of-messages/4549916089...)

avatar

As @Jonas Straub states we are using AnswerHub for our functionality. The backend database is MySQL, but here is their stack: http://docs.answerhub.com/articles/1073/answerhub-architecture.html

avatar

Wow cool! thanks for sharing the architecture pic 🙂