ThoughtWorks
  • Contact
  • Español
  • Português
  • Deutsch
  • 中文
Go to overview
  • Engineering Culture, Delivery Mindset

    Embrace a modern approach to software development and deliver value faster

    Intelligence-Driven Decision Making

    Leverage your data assets to unlock new sources of value

  • Frictionless Operating Model

    Improve your organization's ability to respond to change

    Platform Strategy

    Create adaptable technology platforms that move with your business strategy

  • Experience Design and Product Capability

    Rapidly design, deliver and evolve exceptional products and experiences

    Partnerships

    Leveraging our network of trusted partners to amplify the outcomes we deliver for our clients

Go to overview
  • Automotive
  • Cleantech, Energy and Utilities
  • Financial Services and Insurance
  • Healthcare
  • Media and Publishing
  • Not-for-profit
  • Public Sector
  • Retail and E-commerce
  • Travel and Transport
Go to overview

Featured

  • Technology

    An in-depth exploration of enterprise technology and engineering excellence

  • Business

    Keep up to date with the latest business and industry insights for digital leaders

  • Culture

    The place for career-building content and tips, and our view on social justice and inclusivity

Digital Publications and Tools

  • Technology Radar

    An opinionated guide to technology frontiers

  • Perspectives

    A publication for digital leaders

  • Digital Fluency Model

    A model for prioritizing the digital capabilities needed to navigate uncertainty

  • Decoder

    The business execs' A-Z guide to technology

All Insights

  • Articles

    Expert insights to help your business grow

  • Blogs

    Personal perspectives from ThoughtWorkers around the globe

  • Books

    Explore our extensive library

  • Podcasts

    Captivating conversations on the latest in business and tech

Go to overview
  • Application process

    What to expect as you interview with us

  • Grads and career changers

    Start your tech career on the right foot

  • Search jobs

    Find open positions in your region

  • Stay connected

    Sign up for our monthly newsletter

Go to overview
  • Conferences and Events
  • Diversity and Inclusion
  • News
  • Open Source
  • Our Leaders
  • Social Change
  • Español
  • Português
  • Deutsch
  • 中文
ThoughtWorksMenu
  • Close   ✕
  • What we do
  • Who we work with
  • Insights
  • Careers
  • About
  • Contact
  • Back
  • Close   ✕
  • Go to overview
  • Engineering Culture, Delivery Mindset

    Embrace a modern approach to software development and deliver value faster

  • Experience Design and Product Capability

    Rapidly design, deliver and evolve exceptional products and experiences

  • Frictionless Operating Model

    Improve your organization's ability to respond to change

  • Intelligence-Driven Decision Making

    Leverage your data assets to unlock new sources of value

  • Partnerships

    Leveraging our network of trusted partners to amplify the outcomes we deliver for our clients

  • Platform Strategy

    Create adaptable technology platforms that move with your business strategy

  • Back
  • Close   ✕
  • Go to overview
  • Automotive
  • Cleantech, Energy and Utilities
  • Financial Services and Insurance
  • Healthcare
  • Media and Publishing
  • Not-for-profit
  • Public Sector
  • Retail and E-commerce
  • Travel and Transport
  • Back
  • Close   ✕
  • Go to overview
  • Featured

  • Technology

    An in-depth exploration of enterprise technology and engineering excellence

  • Business

    Keep up to date with the latest business and industry insights for digital leaders

  • Culture

    The place for career-building content and tips, and our view on social justice and inclusivity

  • Digital Publications and Tools

  • Technology Radar

    An opinionated guide to technology frontiers

  • Perspectives

    A publication for digital leaders

  • Digital Fluency Model

    A model for prioritizing the digital capabilities needed to navigate uncertainty

  • Decoder

    The business execs' A-Z guide to technology

  • All Insights

  • Articles

    Expert insights to help your business grow

  • Blogs

    Personal perspectives from ThoughtWorkers around the globe

  • Books

    Explore our extensive library

  • Podcasts

    Captivating conversations on the latest in business and tech

  • Back
  • Close   ✕
  • Go to overview
  • Application process

    What to expect as you interview with us

  • Grads and career changers

    Start your tech career on the right foot

  • Search jobs

    Find open positions in your region

  • Stay connected

    Sign up for our monthly newsletter

  • Back
  • Close   ✕
  • Go to overview
  • Conferences and Events
  • Diversity and Inclusion
  • News
  • Open Source
  • Our Leaders
  • Social Change
Blogs
Select a topic
View all topicsClose
Technology 
Agile Project Management Cloud Continuous Delivery  Data Science & Engineering Defending the Free Internet Evolutionary Architecture Experience Design IoT Languages, Tools & Frameworks Legacy Modernization Machine Learning & Artificial Intelligence Microservices Platforms Security Software Testing Technology Strategy 
Business 
Financial Services Global Health Innovation Retail  Transformation 
Careers 
Career Hacks Diversity & Inclusion Social Change 
Blogs

Topics

Choose a topic
  • Technology
    Technology
  • Technology Overview
  • Agile Project Management
  • Cloud
  • Continuous Delivery
  • Data Science & Engineering
  • Defending the Free Internet
  • Evolutionary Architecture
  • Experience Design
  • IoT
  • Languages, Tools & Frameworks
  • Legacy Modernization
  • Machine Learning & Artificial Intelligence
  • Microservices
  • Platforms
  • Security
  • Software Testing
  • Technology Strategy
  • Business
    Business
  • Business Overview
  • Financial Services
  • Global Health
  • Innovation
  • Retail
  • Transformation
  • Careers
    Careers
  • Careers Overview
  • Career Hacks
  • Diversity & Inclusion
  • Social Change
Data Science & EngineeringTechnology

What's Your Big Data Resolution for 2015?

Linda Luu Linda Luu

Published: Dec 30, 2014

2014 was a big year for ThoughtWorks’ big data analytics team. We were fortunate to work with some of the most innovative organizations in healthcare, financial services and marketing industries to solve tough business problems using predictive analytics.

From start-ups to Fortune 500 organizations, we’ve observed the following trends emerging in big data analytics that have shaped our areas of focus for 2015.

Big Data 2015

Make the right investment, sooner

A common question we’ve observed from clients is: “We have lots of business ideas but how do we choose the right idea to invest in?”

One of the traps of working with new ideas and lots of data is the temptation to collect, cleanse and transform data before getting started. This can sometimes takes months to years without a single insight gleaned. Starting with the principle that ideas can be converted into a series of time-boxed experiments, we apply qualitative research techniques to test early hypotheses about the opportunity. Ideas are then validated by the data which provides data scientists with a direction to pursue before even looking at the data.

Get access to your data, faster

Overcoming the daunting task of getting started with predictive analytics requires access to “raw” data to assist with experimentation and proof of concepts. Techniques such as the Data Lake and Lambda Architectures enable teams to test out hypotheses by delaying the high cost and burden of up-front data modeling, MDM, data governance, cleansing and transformation, and in turn focuses teams on building the right thing, faster.

These techniques are gaining traction and you can read more about it in the December edition of ThoughtWorks Technology Radar, a bi-yearly publication that examines technology trends.

Stay relevant in a fast changing industry

R or Python? Tableau or Qlikview? Hadoop or Spark? We are seeing lots of technology leaders struggle with which technologies to embrace, which vendors to believe, and how to develop the in-house skills to deal with these new technologies.

Staying up-to-the-minute on every new technology can be exhausting, and sorting through vendor hype is very difficult. Good solutions aren’t about the technology. Instead they are about aligning business goals with a value-driven approach, and selecting appropriate technologies. Appropriate technologies need to be cost effective, well-suited to the broader IT infrastructure, sustainable, scalable, and designed for the job at hand.

Strike the right balance between data and privacy

Developing a trusted partnership between a consumer and a provider is tricky. Consumers have increasingly high expectations about how their data will be used, whom it will be shared with, and how it will be protected. Retailers and other providers violate that trust at their own peril.

Big Data and Mobile

Four potential dimensions of influence over customer data privacy include:
  1. Governmental policy and compliance,
  2. A practitioner code of ethics,
  3. Corporate data collector responsibility, and
  4. Consumer personal awareness and attention.
The first two of these do not yet exist, which leaves corporate responsibility and consumer awareness to assure privacy. Google’s “Right to be Forgotten” policy represents a minimum standard that should be adopted by all organizations. What is more interesting is how organizations will use consumer data to create tremendous value for the consumer rather than for the organization, thereby strengthening consumer relationships and trust.

It’s an exciting time for big data analytics. The growing plethora of big data technology choices at our fingertips has enabled a new landscape to create disruptive new business models and engage with consumers in ways never experienced before. Looking forward to 2015, the complex balance between trust, privacy and corporate responsibility presents some interesting challenges ahead.
  • What we do
  • Who we work with
  • Insights
  • Careers
  • About
  • Contact

WeChat

×
QR code to ThoughtWorks China WeChat subscription account

Media and analyst relations | Privacy policy | Modern Slavery statement ThoughtWorks| Accessibility | © 2021 ThoughtWorks, Inc.