Database design ad server? What is the typical ad server database design to track clicks, impressions and conversions. How can I design a cron job to aggregate all my data by hour?
-
While I can track every single click and impression and conversion, at scale this will amount to millions of rows of data. Can anyone share ideas on database and aggregation design .
-
Answer:
I have recently developed a comparable system, thus will not be able to disclose all of the details. However, I think it all boils down to these key points: - do everything you have to do at the right moment (example: if you need unique users per day, in a weekly report, when do you count them?, do you need geo lookups in realtime?) - pick state of the art proven technologies that are designed to scale almost limitlessly - make sure there's no single point of failure: not even primarily for high availability, but also for high throughput - make sure your team is experienced in writing these kind of applications. Even if you pick the right technology stack you can still fail if your team misuses it. EDIT: it might also be interesting to read this article of a very large RTB platform, http://techblog.appnexus.com/2013/api-rearchitecture-series-the-juicy-details/
Robin Verlangen at Quora Visit the source
Other answers
The design would typically would follow from the requirement of the scale and the latencies to be met.Depending on the above two you may choose several strategies and underlying infrastructure. They could be as under but not limited to the listed Store events in logs rotated at the frequency desired, rolled up via an etl and exposed via db to various consumers Create network logs and stream the events via scribe/storm and produce real time analytics Create logs and ship them via kafka for rolling up and producing metric Ship logs to elastic search and make them available over an interface etc etchttp://kritter.in, an ad tech enterprise solution provider,
Rohan Rai
Related Q & A:
- How can I find a Suitable Job in USA?Best solution by Yahoo! Answers
- How can I find a better job while I am currently working?
- How can I get a clinic job as a nurse right out of college?Best solution by Yahoo! Answers
- How can I design a workout program for myself?Best solution by Yahoo! Answers
- How can I get a good job in HR?Best solution by Quora
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.