ThoughtWorks
  • 联系我们
  • Español
  • Português
  • Deutsch
  • English
概况
  • 工匠精神和科技思维

    采用现代的软件开发方法,更快地交付价值

    智能驱动的决策机制

    利用数据资产解锁新价值来源

  • 低摩擦的运营模式

    提升组织的变革响应力

    企业级平台战略

    创建与经营战略发展同步的灵活的技术平台

  • 客户洞察和数字化产品能力

    快速设计、交付及演进优质产品和卓越体验

    合作伙伴

    利用我们可靠的合作商网络来扩大我们为客户提供的成果

概况
  • 汽车企业
  • 清洁技术,能源与公用事业
  • 金融和保险企业
  • 医疗企业
  • 媒体和出版业
  • 非盈利性组织
  • 公共服务机构
  • 零售业和电商
  • 旅游业和运输业
概况

特色

  • 技术

    深入探索企业技术与卓越工程管理

  • 商业

    及时了解数字领导者的最新业务和行业见解

  • 文化

    分享职业发展心得,以及我们对社会公正和包容性的见解

数字出版物和工具

  • 技术雷达

    对前沿技术提供意见和指引

  • 视野

    服务数字读者的出版物

  • 数字化流畅度模型

    可以将应对不确定性所需的数字能力进行优先级划分的模型

  • 解码器

    业务主管的A-Z技术指南

所有洞见

  • 文章

    助力商业的专业洞见

  • 博客

    ThoughtWorks 全球员工的洞见及观点

  • 书籍

    浏览更多我们的书籍

  • 播客

    分析商业和技术最新趋势的精彩对话

概况
  • 申请流程

    面试准备

  • 毕业生和变换职业者

    正确开启技术生涯

  • 搜索工作

    在您所在的区域寻找正在招聘的岗位

  • 保持联系

    订阅我们的月度新闻简报

概况
  • 会议与活动
  • 多元与包容
  • 新闻
  • 开源
  • 领导层
  • 社会影响力
  • Español
  • Português
  • Deutsch
  • English
ThoughtWorks菜单
  • 关闭   ✕
  • 产品及服务
  • 合作伙伴
  • 洞见
  • 加入我们
  • 关于我们
  • 联系我们
  • 返回
  • 关闭   ✕
  • 概况
  • 工匠精神和科技思维

    采用现代的软件开发方法,更快地交付价值

  • 客户洞察和数字化产品能力

    快速设计、交付及演进优质产品和卓越体验

  • 低摩擦的运营模式

    提升组织的变革响应力

  • 智能驱动的决策机制

    利用数据资产解锁新价值来源

  • 合作伙伴

    利用我们可靠的合作商网络来扩大我们为客户提供的成果

  • 企业级平台战略

    创建与经营战略发展同步的灵活的技术平台

  • 返回
  • 关闭   ✕
  • 概况
  • 汽车企业
  • 清洁技术,能源与公用事业
  • 金融和保险企业
  • 医疗企业
  • 媒体和出版业
  • 非盈利性组织
  • 公共服务机构
  • 零售业和电商
  • 旅游业和运输业
  • 返回
  • 关闭   ✕
  • 概况
  • 特色

  • 技术

    深入探索企业技术与卓越工程管理

  • 商业

    及时了解数字领导者的最新业务和行业见解

  • 文化

    分享职业发展心得,以及我们对社会公正和包容性的见解

  • 数字出版物和工具

  • 技术雷达

    对前沿技术提供意见和指引

  • 视野

    服务数字读者的出版物

  • 数字化流畅度模型

    可以将应对不确定性所需的数字能力进行优先级划分的模型

  • 解码器

    业务主管的A-Z技术指南

  • 所有洞见

  • 文章

    助力商业的专业洞见

  • 博客

    ThoughtWorks 全球员工的洞见及观点

  • 书籍

    浏览更多我们的书籍

  • 播客

    分析商业和技术最新趋势的精彩对话

  • 返回
  • 关闭   ✕
  • 概况
  • 申请流程

    面试准备

  • 毕业生和变换职业者

    正确开启技术生涯

  • 搜索工作

    在您所在的区域寻找正在招聘的岗位

  • 保持联系

    订阅我们的月度新闻简报

  • 返回
  • 关闭   ✕
  • 概况
  • 会议与活动
  • 多元与包容
  • 新闻
  • 开源
  • 领导层
  • 社会影响力
博客
选择主题
查看所有话题关闭
技术 
敏捷项目管理 云 持续交付 数据科学与工程 捍卫网络自由 演进式架构 体验设计 物联网 语言、工具与框架 遗留资产现代化 Machine Learning & Artificial Intelligence 微服务 平台 安全 软件测试 技术策略 
商业 
金融服务 全球医疗 创新 零售行业 转型 
招聘 
职业心得 多元与融合 社会改变 
博客

话题

选择主题
  • 技术
    技术
  • 技术 概观
  • 敏捷项目管理
  • 云
  • 持续交付
  • 数据科学与工程
  • 捍卫网络自由
  • 演进式架构
  • 体验设计
  • 物联网
  • 语言、工具与框架
  • 遗留资产现代化
  • Machine Learning & Artificial Intelligence
  • 微服务
  • 平台
  • 安全
  • 软件测试
  • 技术策略
  • 商业
    商业
  • 商业 概观
  • 金融服务
  • 全球医疗
  • 创新
  • 零售行业
  • 转型
  • 招聘
    招聘
  • 招聘 概观
  • 职业心得
  • 多元与融合
  • 社会改变
软件测试Pune技术

Disruptive Testing: Part 7 - Michael Hunter

Anand Bagmar Anand Bagmar

Published: Sep 1, 2014

My interview today is with Michael Hunter, a senior software developer, who’s been with Microsoft for 14 years now. He helps the teams evaluate the quality of their products. When he’s not at work, he can be seen city hiking around Seattle and spending time with his fiancée and her giant cat (the furry one in the photo!). Read more about his “You Are Not Done Yet” checklist and other good stuff at http://www.thebraidytester.com. You can contact him at michael@thebraidytester.com. 

Michael Hunter

Q - Hi Michael! Thank you for chatting with us. As someone who’s been in the field of testing for over a decade, do you think the ‘wall’ between a Developer and a Quality Analyst is dissolving, or getting stronger?

A - I think it’s dissolving, and good riddance! In most teams I’ve worked with which separated Dev and Test (I’ve never seen a software team with actual QA roles) into separate groups, Dev starts relying on Test to evaluate the code. I’ve never seen this speed up the process of shipping software. While I’m all for people specializing in testing, and even in specific types of testing, I shy away from separating them out in any way. My most effective partnerships with developers have been figuratively (and often literally) sitting in their offices writing tests alongside and even integrated into their code.

I want to partner with the engineers I work with, not be a crutch.

Q - In these times, how important is it for a Quality Analyst to be technical, and maybe also contribute to Test Automation?

A - I see my ability to read and understand code as one tool in my toolbox. I find that reading code can help me understand how a system works, and it can suggest techniques to try and even specific tests to run. Debugging into an issue I found sometimes points out other issues, or helps me generalize the issue to a class or category of issues. Writing code can jump me through parts of a workflow I’m not interested in; it can also help me notice things I might not notice otherwise. My technical expertise also helps me help the engineers I work with reason about their designs and probe into their code.

However, technical expertise isn’t required to do any of these things! I have yet to see a system that can’t be reasoned about and probed into simply by asking questions of its functionality. While I recommend everyone on an engineering team learn at least the basics of reading code, I don’t think doing so is required.

Q - What innovative features would you highly recommend in a Test Automation framework, that would help the team immensely?

A - Most important, I think, is that your framework helps test authors think and write tests in terms of what their customers’ model of the product, rather than the testers’ concept of the product or what the UI happens to look like today. (I’ve detailed one way to do this at http://www.thebraidytester.com/stack.html.)

Architect your framework to provide single points of change for the aspects of the product you expect to change.

Keep your framework as simple as you possibly can while still adding the value you want it to.

Remember that your framework is software! Treat it with the same care in engineering as you do the software it’s testing.

Q - What tips and tricks can you share for building a ‘testable product’?

A - Start with understanding what you actually care about – how you define quality. Next, decide what information you’ll need to measure that. Now you can think about how to get that information out of your product. Once I’m at that point, I use my colleague Dave Catlett’s SOCK mnemonic to remind me of key testability concerns:

  • Simplicity – Are the mechanisms we’re using to enable testability the right level of simple for what we desire
  • Observability – Can I/my automation see the data we need to see to understand what the product is doing?
  • Control – Can I/my automation force the product into the code paths and usage scenarios we want to explore?
  • Knowledge of expected results – Do I have an oracle to reliably (enough) evaluate how well what actually happens matches with what we expect to happen?

Q - What are the top five myths about Software Testing from your experiences? Why?

A - 

  •     Testing ensures quality. While testing can provide information about the product it's evaluating, it can’t ensure anything. Testing might provide evidence that our customers will generally enjoy using our product, or demonstrate that when our product is used in certain ways it tends to crash, or any number of other data points that might correlate with the quality of our product. I don’t, however, know any way that testing can ensure the quality of our product
  •   Testers break the product they test. When I test I often find sequences of actions that cause my product to crash, or corrupt data, or otherwise act in ways my customers (hopefully) will not expect and probably will not enjoy. I don’t cause any of these reactions, however – they’re already baked into the product by the time I’m looking at it
  •     Automated tests save time. While I've seen automated tests save immense amounts of time and add immense value, I've also seen them waste immense amounts of time and remove immense value. While sometimes we don't know ahead of time which will happen, I am consistently happiest when I constantly re-evaluate which techniques and activities seem most likely to be most fruitful right now
  •    Testing is necessary. I don’t even think evaluating the quality of our software is necessary. While I know any number of activities I can do, before and after our customers use our software, which will increase the likelihood they will become raving fans and convert all their friends and give us lots of money, none of these activities are necessarily necessary
  •    Testing can reliably simulate our customers’ experiences. While I’ve had success at reliably simulating certain aspects of certain of the ways my customers have used my products, and of predicting the experiences they will have using my products, I’ve also failed miserably at doing these things. Further, my customers constantly surprise me with the ways they use my products. The only way I know to truly understand my customers’ experiences is to ask them and to observe them. I can do this in person, and more and more I can do this by analyzing the streams of data they let my software send back to me describing what it and they are doing. I think we have only the barest inklings how this ability will change the ways we evaluate our products' quality; I’m looking forward to being surprised and amazed at what we become able to do!

Q - What tips would you like to share with Quality Analysts who are relatively new in the software industry?

A - Look for the way *you* find bugs, and for the way *you* understand how a system works – and how *you* understand where it is likely to fall apart. You do these in a very different way than everyone else on your team. Find *your* way and you find the value *you* uniquely add.

Be willing to ask “the stupid question”. I get the information I want, and as a bonus, I find admitting I don’t understand something builds trust with my team. And I guarantee you other people have the exact same question.

Search for why, not just for what. Understand why the issue you just found manifests, why it surprised you, why it’s likely to surprise your customers, why your marketing people will care about it, why your CEO will care about it. Understand why your manager, their manager, your CEO, and your peers ask you to do what they do – and why they *don’t* ask you to do other things.

Look for what’s being left out, ignored, dismissed.

Time spent away from your job is as important as time spent doing it. Take a walk, read about unrelated topics, build things that seem unconnected; do this intermixed with your assigned work and see if new ideas and approaches don’t start coming to mind.

Thank you Michael, for your time and this conversation! 

Check out other great interviews in this series with James Bach, Lorinda Brandon, Markus Gärtner, Matt Heusser,  Justin Rohrman and Anna Royzman.

  • 产品及服务
  • 合作伙伴
  • 洞见
  • 加入我们
  • 关于我们
  • 联系我们

WeChat

×
QR code to ThoughtWorks China WeChat subscription account

媒体与第三方机构垂询 | 政策声明 | Modern Slavery statement ThoughtWorks| 辅助功能 | © 2021 ThoughtWorks, Inc.