menu
Perspectives by ThoughtWorks - Edition 2 banner
Perspectives by ThoughtWorks - Edition 2 banner
EDITION #2 I RELEASED DECEMBER 2018

The end of data gluttony

Is data hype leading some enterprises down the garden path? How can companies separate the hype-y from the helpful? In this issue of Perspectives, we present new principles grounded in reality, to support data initiatives that drive results.


Principles to rejuvenate your data strategy

Interest in data and what can be done with it has hit an all-time highand it’s unsurprising. There has been an explosion in extra interesting data, paired with tools and technologies to make sense of it. The rising tide of interest has triggered a wave of corporate panic. Companies rush to inhale more and more in fear of getting left behind. Welcome to the era of data gluttony.

Search interest in data terms over time

Diagram - Search interest in data terms over time via Google Trends
Diagram - Search interest in data terms over time via Google Trends

Source: Google Trends


Principle 1: Data needs to connect directly to business purpose

The data panic has companies jostling to kick off data initiatives. But the rush has many companies pushing out data projects without a cause for the sake of trialing new tools. The advice of author Simon Sinek is extra relevantstart with why. Why are we doing this? How will this information help my people act differently? Data in its crudest form isn’t much help here. What enterprises need is insight that helps people behave differently and make decisions in line with business goals. But good information doesn’t just magically result in insights, so even the most digestible information needs to be worked extensively before it has value. 

Quote by Dr. Christoph Windheuser, Global Head of Artificial Intelligence, ThoughtWorks


“Never, ever do a pure infrastructure projectwithout immediate business value, it’s almost certain to fail.”


Dr. Christoph Windheuser, Global Head of Artificial Intelligence, ThoughtWorks


Principle 2: More isn’t always better (or, startups could teach you a thing or two)

Established companies may have more data at their disposal. But in the race to effectively use data, simplicity and culture often give startups an advantage.


Case in pointbigger doesn’t translate to better. The volume of data in big businesses means more possibility, but that potential is chained up in siloed systems, often hard to access or tough to understand. And while there’s more that could be done, colossal quantities of data are expensive to hold and maintain. There’s also the roadblock of accountability. As companies grow it’s less clear who "owns" key data considerations: Where it’s stored, how it’s cleaned, who has access and so on. By contrast, data-driven startups build their systems with the free flow of information as a critical component. 

Tech behind legacy enterprises vs. data-driven businesses


Diagram by ThoughtWorks - Tech behind Legacy entreprises v data-driven businesses
Diagram by ThoughtWorks - Tech behind Legacy entreprises v data-driven businesses


Principle 3: Data lakes won’t save you (and neither will AI)

Innovations like AI and data lakes can have an impact, but they aren’t magic bullets. Companies need to see these advances as tools rather than falling in love. The temptation to leap on tools when they’re invented is strong. But pursuing what’s trendy can cause strategic missteps and distraction. The complexity and nuance involved means what worked well for one business may be disastrous for anothereven in the same industry.

Quote by Ken Collier, Author - Agile Analytics

“What I fear is that we're headed toward the next AI winter. After all of this hype wears off . . . all of a sudden AI is going to get the bad rap of not having lived up to some unrealistic expectations.”


Ken Collier, AuthorAgile Analytics



Principle 4: Culture and design are just as important as tech (if not more)

Data gluttony has many companies rushing to hire data scientists and set up bolt-on departments that focus on data and data alone. But do enterprises know what to do with data scientists if and when they’re found?

Data scientist shortages in the US by city

Diagram - Data scientist shortages in the US by city according to Linkedin report 2018
Diagram - Data scientist shortages in the US by city according to Linkedin report 2018
Source: Linkedin Workforce Report, August 2018


Principle 5: Start small, learn, repeat . . . and don’t ever stop

An inconvenient truth for many traditional companiesthe circle of finding data, extracting information, and translating that into action takes months or years. This results in a "better-late-than-never" type of response. But figuring out how to insert data within key agile development practices like continuous integration and delivery can help shrink the time between information and action. 

Cycle of Intelligence

Combining agile and continuous delivery with data science



Diagram - Continuous Intelligence
Diagram - Continuous Intelligence

Perspectives delivered to your inbox

Timely business and industry insights for digital leaders.