#000592
Building Scalable Web Sites
Cal Henderson
A practical field guide to the engineering problems that only show up when a website gets genuinely big, written by the lead developer of Flickr at the height of its growth. Cal Henderson skips theory in favor of hard-won experience: how to partition and distribute databases across huge datasets, plan hardware and hosting, monitor a running system to find the bottleneck that is actually biting, handle internationalization and user-uploaded content, and expose clean service APIs. Published in 2006, it captured a pivotal moment when "Web 2.0" applications were straining architectures built for simpler sites, and it became a touchstone for a generation of backend engineers. Even where the specific technologies have dated, its way of thinking about scale, trade-offs, and operational reality remains instructive.
more…less ▴
The author
Cal Henderson is a British-born software engineer who was the lead developer and later director of engineering for Flickr, the pioneering photo-sharing service, from its earliest days through its Yahoo era. He later co-founded Slack, where he served as chief technology officer — a career that gives this book unusual authority on building systems that must scale.
The book
Building Scalable Web Sites (O'Reilly, 2006) is explicitly grounded in Flickr's real infrastructure: database partitioning, hardware and hosting decisions, performance monitoring, internationalization, and API design, presented as concrete practice rather than abstraction.
How it has aged
The principles — measure before optimizing, design for horizontal growth, respect operational reality — remain sound, but the specifics reflect mid-2000s tooling, well before the cloud, containers, and managed databases reshaped the field. It's best read now as a well-written historical snapshot plus durable engineering judgment.
For more context
The O'Reilly listing and Flickr's own announcement describe the book and its origins.
Sources - Building Scalable Web Sites — O'Reilly - Building Scalable Web Sites — Flickr Blog
- Type
- Book
- Author / Maker
- Cal Henderson
- Publisher
- O'Reilly Media
- Year
- 2006
- ISBN
- None
- Shelf
- Craft & How-to
- Location
- Colorado