Master
ThoughtWorks
Menu
Close
  • What we do
    • Go to overview
    • Customer Experience, Product and Design
    • Data Strategy, Engineering and Analytics
    • Digital Transformation and Operations
    • Enterprise Modernization, Platforms and Cloud
  • Who we work with
    • Go to overview
    • Automotive
    • Healthcare
    • Public Sector
    • Cleantech, Energy and Utilities
    • Media and Publishing
    • Retail and E-commerce
    • Financial Services and Insurance
    • Not-for-profit
    • Travel and Transport
  • Insights
    • Go to overview
    • Featured

      • Technology

        An in-depth exploration of enterprise technology and engineering excellence

      • Business

        Keep up to date with the latest business and industry insights for digital leaders

      • Culture

        The place for career-building content and tips, and our view on social justice and inclusivity

    • Digital Publications and Tools

      • Technology Radar

        An opinionated guide to technology frontiers

      • Perspectives

        A publication for digital leaders

      • Digital Fluency Model

        A model for prioritizing the digital capabilities needed to navigate uncertainty

      • Decoder

        The business execs' A-Z guide to technology

    • All Insights

      • Articles

        Expert insights to help your business grow

      • Blogs

        Personal perspectives from ThoughtWorkers around the globe

      • Books

        Explore our extensive library

      • Podcasts

        Captivating conversations on the latest in business and tech

  • Careers
    • Go to overview
    • Application process

      What to expect as you interview with us

    • Grads and career changers

      Start your tech career on the right foot

    • Search jobs

      Find open positions in your region

    • Stay connected

      Sign up for our monthly newsletter

  • About
    • Go to overview
    • Our Purpose
    • Awards and Recognition
    • Diversity and Inclusion
    • Our Leaders
    • Partnerships
    • News
    • Conferences and Events
  • Contact
Global | English
  • United States United States
    English
  • China China
    中文 | English
  • India India
    English
  • Canada Canada
    English
  • Singapore Singapore
    English
  • United Kingdom United Kingdom
    English
  • Australia Australia
    English
  • Germany Germany
    English | Deutsch
  • Brazil Brazil
    English | Português
  • Spain Spain
    English | Español
  • Global Global
    English
Blogs
Select a topic
View all topicsClose
Technology 
Agile Project Management Cloud Continuous Delivery  Data Science & Engineering Defending the Free Internet Evolutionary Architecture Experience Design IoT Languages, Tools & Frameworks Legacy Modernization Machine Learning & Artificial Intelligence Microservices Platforms Security Software Testing Technology Strategy 
Business 
Financial Services Global Health Innovation Retail  Transformation 
Careers 
Career Hacks Diversity & Inclusion Social Change 
Blogs

Topics

Choose a topic
  • Technology
    Technology
  • Technology Overview
  • Agile Project Management
  • Cloud
  • Continuous Delivery
  • Data Science & Engineering
  • Defending the Free Internet
  • Evolutionary Architecture
  • Experience Design
  • IoT
  • Languages, Tools & Frameworks
  • Legacy Modernization
  • Machine Learning & Artificial Intelligence
  • Microservices
  • Platforms
  • Security
  • Software Testing
  • Technology Strategy
  • Business
    Business
  • Business Overview
  • Financial Services
  • Global Health
  • Innovation
  • Retail
  • Transformation
  • Careers
    Careers
  • Careers Overview
  • Career Hacks
  • Diversity & Inclusion
  • Social Change
Career HacksSocial ChangeDiversity & InclusionCareers

[Stories of Social Change] Raising awareness for discriminatory AI programs in Brazil

Roselma Mendes Roselma Mendes

Published: Mar 30, 2020

Over the years, the world has seen remarkable and rapid advancements in technology which are deeply impacting society. Despite this, we continue to struggle with issues such as poverty, violence, and climate change. At ThoughtWorks, we believe that technologists have a unique role to play in how we can positively impact society and push for a more equitable tech future.

In our Stories of Social Change series, we are sharing stories from ThoughtWorkers around the world who have leveraged their skills and experience to build technology that truly impacts people and effects social change. These stories show that technologists are in a unique position to change the world and inspire action in others.

Roselma Mendes Brazil ThoughtWorks

Name: Roselma

ThoughtWorks home: Brazil

Preferred pronouns: she/her/ela

Joined ThoughtWorks: 2014

What brought you to ThoughtWorks?

My journey at ThoughtWorks began at ThoughtWorks University (TWU) in Pune, India. More than five years later, a lot has happened. I’ve worked on a billing API project, a shadow apps platform for ThoughtWorks, and a platform strategy focused on infrastructure. Today, I’m working on a search platform for ThoughtWorks.

Every day, I learn a lot and get to work with amazing people; people who are willing to view the world from a different lens, one that is more inclusive and collaborative.

How has your work made a positive impact on the world?

In Brazil, most black people live in favelas, or other poor neighborhoods, where they’re disproportionately targeted by state-run surveillance systems. Facial-recognition technologies are used to ‘fight the enemy,’ however the enemy generally ends up being black Brazilians. So activists noticed a problem: some of the AI programs in Brazil had an unreliable, biased database due to discriminatory targeting.

Brazil and other countries in the global south have a lot to contribute when it comes to ethics and technology. Unfortunately, most of the debates I see are from a global north perspective. What Maíra and I are trying to understand is how ThoughtWorks’ global south can contribute more when it comes to making tech more equitable for all. 

We have a lot of work to do in Brazil to make sure our government respects and improves our Privacy Data Law (LGPD) and increases the population participation in the debate about the use of such technologies. Recently in Brazil, Maíra Araújo and I (both ThoughtWorkers based in Recife) have started to engage with building an equitable tech future, which encourages ThoughtWorkers to pursue, learn, and build technology that makes a positive impact on the world.

I have a presentation about "How Technology Can be Racist" along with Gabriel Barreto (ThoughtWorker) and Silvana Bahia from Olabi (ThoughtWorks partner). I have also written about the role of Black women on Ethics and Technology and Digital Security.

Roselma Mendes Brazil ThoughtWorks

Currently with the campaign, we’re having introductory conversations with local groups for possible partnerships, listening to their stories, and talking about our campaign. We understand that a lot has been done outside of our walls and there are people working on the frontlines to raise awareness about the issues we are talking about here. In this scenario, how do we use our knowledge, such amazing minds, and place of privilege to join forces to this fight?

How does it feel to create technology that makes such a positive impact on people?

Aside from the work I do that impacts the issues discussed here, there’s also the aspect that it’s the right thing to do for everyone. Contributing to such an important debate makes me feel useful. I’m really motivated by the fact that I can use my skills and strengths to make a difference in peoples’ lives. 

What has sparked your curiosity while doing this work?

Having a joint effort with local communities to discuss the impact that technology has or will have on their lives; specifically in the Brazilian context, where 55,8% of the population is self-declared Black (considered Negros and Pardos according Brazilian Black Movement). Brazil has a deep history of racism in regards to Black people: we are the ones who are on the worst side of income distribution, access to education, health, sanitation services, etc. Meanwhile, Black people are incarcerated at a higher rate and are more likely to be killed by the police. 

It’s important that we discuss the recent use of technologies like facial recognition used for urban surveillance in Brazil. A lot has been discussed in the US about AI and racism, taking some examples we have Joy Buolamwini with AJL or Safyia Noble with her book Algorithms of Oppression or Ruha Benjamin with the book Race after Technology. 

Recently, Tarcizio Silva, a Brazilian scholar and specialist in monitoring and researching social media released the book, "Comunidades, Algoritmos e Ativismos: olhares afrodiaspóricos"  (Communities, Algorithms and Activism: afro diasporic views) where he curated articles from several other scholars on the subject.

Roselma Mendes Brazil ThoughtWorks

How can folks inside and outside of ThoughtWorks get involved or contribute to this work?

As technologists, we are in a privileged position to influence the direction of our future with digital technology. I would suggest to read more about the use and implications of AI and big data. Not only are they issues that can possibly affect you, but they are also ones that affect other minority groups. 

Some organizations that are also focused on these issues in Brazil and/or Latin America include, IP.rec, Data_labe, Olabi, Rede de Observatorio de Seguranca, Coding Rights, and Lavits. Don't be satisfied with the ‘positive’ explanation of a particular technology; investigate what other implications the technology may have on vulnerable groups. When we are keen to listen to other perspectives aside from our own, we get a much more profound understanding of the world and how things can be done right.

Always ask the question: who benefits most from this technology?

Free to be yourself

Learn more about inclusivity at ThoughtWorks.

Find out more
Related blogs
Career Hacks

[Stories of Social Change] Building an app to empower female houseworkers

AJ Iniguez
Eduardo Meneses
Learn more
Career Hacks

[Stories of Social Change] Christin and mTomady - when success is safe babies

AJ Iniguez
Christin Westermann
Learn more
Machine Learning & Artificial Intelligence

How artificial intelligence is transforming the criminal justice system

Stephanie Weber
Learn more
Master
Privacy policy | Modern Slavery statement | Accessibility
Connect with us
×

WeChat

QR code to ThoughtWorks China WeChat subscription account
© 2021 ThoughtWorks, Inc.