PGCon2011 - Add 4 Video (2015.09.18)
PGCon 2011
The PostgreSQL Conference
| Speakers | |
|---|---|
|
Robert Treat |
| Schedule | |
|---|---|
| Day | Talks - 1 - 2011-05-19 |
| Room | DMS 1140 |
| Start time | 10:00 |
| Duration | 01:00 |
| Info | |
| ID | 361 |
| Track | Scaling Out |
Database Scalability Patterns: Sharding for Unlimited Growth
Most people have come to understand simple replication based horizontal scale-out, but while this technique works pretty well for some read loads, there are system where either the amount of data involved is too great for a single system, or the write based load goes beyond the capacity of a single machine. In these cases we must turn to complex systems of federated databases to build database systems that can sustain perpetual growth.
"Sharding" is a buzz word losing some of it's buzz, and that's a good thing. For many people building read-based scaleout systems is all they will ever need, but if it isn't where do you turn? In this talk I'll focus specifically on large scale, application based scale out being used by some of todays largest internet infrastructures. We'll focus on understanding the pattern underlying these systems, how they are implemented (including discussions on MySQL vs. Postgres as a backing store), and how to manage the infrastructure once you've built it. It isn't for the faint of heart, but if you plan to build large scale systems on commodity hardware, you need to know what has worked for others in the past.