Nice buzzwords, but how does the stuff actually work?
As software engineers, we need to build applications that are reliable, scalable and maintainable in the long run. We need to understand the range of available tools and their trade-offs. For that, we have to dig deeper than buzzwords .
This book will help you navigate the diverse and fast-changing landscape of technologies for storing and processing data. We compare a broad variety of tools and approaches , so that you can see the strengths and weaknesses of each, and decide what’s best for your application.
This book compares the fundamental ideas behind a broad variety of systems. It doesn’t go into the details of how to configure and use one particular tool. But it does explain the trade-offs and fundamental limitations that systems face, so that you can make informed decisions .
We discuss many good ideas from academic research, but we always tie them back to reality. Just because it looks good on a whiteboard doesn’t mean it actually works in practice. We care about ideas that have been proven under intensive workloads , at big companies and at startups.
We go under the hood of the systems you already use, teasing apart how they work internally. The aim is to help you think about data systems in new ways — not just how they work, but why they were designed that way . Your own software will be better as a result.
This book should be required reading for software engineers. The explosion of data and its increased importance to the applications we build has created a new set of complex challenges. Designing Data-Intensive Applications is a rare resource that bridges theory and practice to help developers make smart decisions as they design and implement data infrastructure and systems.
Kevin Scott, Chief Technology Officer at Microsoft
Designing Data-Intensive Applications is one of the greatest reference books. When I was working on databases at Google I regularly recommended it to coworkers who needed more background on particular distributed systems topics. It will keep being a go-to book as long as I work in this field.
Jaana Dogan, Principal Engineer at Amazon Web Services
This book is awesome. It bridges the huge gap between distributed systems theory and practical engineering. I wish it had existed a decade ago, so I could have read it then and saved myself all the mistakes along the way.
Jay Kreps, creator of Apache Kafka and CEO at Confluent
The essence of building reliable and scalable distributed data systems and efficiently using them to solve real world problems is in mastering the tradeoffs associated with the design choices. Designing Data Intensive applications explores them like none other and provides a unbiased view of how distributed systems have made these choices over time.
Veena Basavaraj, Director of Engineering at WeWork
A joy to read! This is one of the best technical books I've read. It offers very helpful context, historical and current, to understanding the key issues in the text.
David Beyer, Investor at Amplify Partners
Designing Data-Intensive Applications (DDIA) is available in print and ebook formats from your favorite bookstore.
See the table of contents for more details on the topics covered.
Follow @intensivedata on Twitter, or join our mailing list to receive very occasional news related to the book:
Martin Kleppmann is a researcher in distributed systems at the University of Cambridge. Previously he was a software engineer and entrepreneur at Internet companies including LinkedIn and Rapportive, where he worked on large-scale data infrastructure. In the process he learned a few things the hard way, and he hopes this book will save you from repeating the same mistakes.
Martin is a regular conference speaker, blogger, and open source contributor. He believes that profound technical ideas should be accessible to everyone, and that deeper understanding will help us develop better software.
You can find him as @martinkl on Twitter, and his blog is at martin.kleppmann.com.
© 2014-2019 Martin Kleppmann
