Delivering data-driven value at scale
Many enterprises are investing in a next-generation data lake, hoping to democratize data at scale to provide business insights and ultimately make automated intelligent decisions. In this practical book, author Zhamak Dehghani reveals that, despite the time, money, and effort poured into them, data warehouses and data lakes fail when applied at the scale and speed of today's organizations. A distributed data mesh is a better choice.
Dehghani guides architects, technical leaders, and decision-makers on their journey from monolithic big data architecture to a sociotechnical paradigm that draws from modern distributed architecture. A data mesh considers domains as a first-class concern, applies platform thinking to create self-serve data infrastructure, treats data as a product, and introduces a federated and computational model of data governance. This book shows you why and how.
Behind the ScenesAn Interview with Zhamak Dehghani
What was the writing process like?
It was full of highs and lows. But overall, I thoroughly enjoyed the mental exercise to capture, structure and communicate complex concepts with simplicity and a narrative for the reader to follow. I was fortunate to have a great group of people from diverse backgrounds as early reviewers. They came along with me through the writing process and shared their feedback as conversations live in the draft files. I never felt alone or in an echo chamber having their presence and company.
I began the writing process mid-2020 intending to write a series of blogs, but it was soon apparent that there was too much to share and I had to move the writing into the book format. That format I began later that year.
What did you learn from the process?
Writing a book is the best way to learn about yourself. Through writing and hearing yourself write, you learn about your voice, your hopes and fears, how you approach solving problems, the values that matter to you that underpin your work. Writing a book is the best way to reflect on who you are and change.
Of course, having mentors and reviewers like Martin Fowler was an incredible opportunity to learn to communicate to a technical audience. I could write a book on what I learned about writing from Martin.
What was the most interesting part of writing a book?
It’s hard to pick one aspect. For me, the writing process was divided into two parts - developing and editing. First, developing the ideas, writing them down, and then editing them and in some cases rewriting them again. This cycle repeats itself many times through the book development.
Developing and editing are both enjoyable but completely different activities and use different parts of the brain. I enjoyed content development greatly: it involved learning, researching, creating something new, drawing the complex concepts in simple figures, etc. It had a lot of creative elements. Writing was like coding a new problem for the first time.
I also enjoyed editing as it was an opportunity to learn about reviewers’ perspective and feedback, and then reflect on how I could improve and refactor the content. Editing was refactoring the code after a code review.