Member since
12-05-2016
2
Posts
3
Kudos Received
0
Solutions
12-06-2016
04:15 AM
3 Kudos
1) MySQL stores user data such as app id, contact details etc.MySQL also stores ad data, such as the type of ad to be served, what's the location etc? 2) We would like to capture location based information from users' phones.
Q - what's an ideal database to store this information in? Are there any bottlenecks when receiving vast amounts of location data from millions of phones and how to mitigate it? 3) While this location data is streaming in, if an ad is available (ad details are in mysql), then the ad needs to be shown real time as the user enters a geo-fenced area.
Q. what's a real time option to spot the user in a geo-fenced area, know there is an ad associated with that location and show the ad real-time. Can this hadoop technology (probably storm) handle millions of users?
Q. How do I take data from MySQL (for example, who is the user, which ad needs to be shown and the content of the ad) within the Hadoop System when I spot a user in the Geo-fenced area? Can I keep this information synced in Hadoop in real-time as the ad is created? Which technology supports moving MySQL data to Hadoop real-time and which database would be good to store this information? What happens when ad data is changed regularly - how do we sync it in Hadoop?
4) Once an ad is served, how do we store our actions. Which database would you recommend? 5) What technologies can we use for analytics to be performed on the data from MySQL and Hadoops database? Again, how do we reduce bottlenecks using specific technologies so that we don't waste time pulling data from one DB to another local machine and process and redo everything? What's a good way to automate things from the beginning. Thanks for taking the time to advice me. We are a small team of app developers and a java developer. We are just starting to think of ads as a revenue stream and were researching good solutions to go about it. Before we hire the right staff, we wanted to know what are the skill-sets we should look for from such a team we would setup. We prefer Hortonworks platform as it's the only true integrated hadoop solution.
... View more
Labels: