Measurements & Metrics for making good Quality Decisions

MnM4Q - Version:1
“If you can’t measure it, you can’t manage it.”- said Peter Drucker. As test professionals, we are faced with critical decisions we have to make along the life cycle. From choosing the right test strategy and approach, estimating the right amount of effort and budget, deciding if to add more test execution (cycle), to deciding what is the real quality of the system now, and more. In this workshop Alon Linetzki aims to bring the awareness and knowhow for identifying, analyzing and maintaining important measurements and metrics (choosing the right ones…), for making critical and important decisions during the product development and testing life cycle. The GQM method for defining measurements & metrics shall be explained, and demonstrated. Through presentation, discussion, debate, brainstorming and questioning, we shall go through terminology, methodology, and concepts to learn how to plan, design and use measurements & metrics in a meaningful way, that will help us make good testing decisions. Relevant exercises are integrated into the workshop in order to close the gap between methodology and actual implementation.
Intended audience
Experienced test engineers, testing team leaders, test managers, Quality Assurance engineers, QA team leaders and QA managers that would like to know which metrics are critical and are worth setting up and maintaining for making good testing and quality decisions.
Expand All
  • Introduction to Measurements and Metrics
    • Introduction
      • Presenting participants and coach
    • General
      • Measurement; Metric – definition
      • In which way should we use M&M
      • Measurements & metrics misconceptions
      • Discussion exercise – measurements & metrics – why & how
  • Choosing the right metrics
    • Motivation
      • How decisions are really done?
      • The 7 most expensive words in a project
      • Why selecting good metrics is important?
      • Getting the right decisions, using the wrong metrics
    • GQM – Goal Question Metric
      • Introduction
      • Defining Business Goals (BGs) and Testing Goals (TGs)
      • Exercise – Defining Testing Goals [optional]
      • Asking the right questions
      • Exercise – Defining Questions [optional]
      • Defining the right metrics
      • Exercise – Defining Metrics
    • Using M&M for making Good Testing Decisions
      • Decision points during the product development lifecycle
      • Scenario exercise – what are our goals? How will we know we reached them? What will help us know that?
      • Integrating M&Ms, Setting up Dashboards
  • Measurement & metrics implementation
    • M&M Implementation and Operation
      • The Measurements & metrics Catalog
      • M&M Roll Out dimensions
        • Functional
          • Operational
          • Managerial
        • Aggregation
        • Comparison (Projects, Releases, Products, Departments)
        • Category (Quality, Budget, Scope, Time)
      • Exercise – Catalog [optional]
      • M&M Economics
    • Measurements & metrics in Agile
    • Measurements & metrics Benefits & Risks
    • Workshop Retrospective
  • Participants should have knowledge in test planning & estimation, test design, test execution, cooperation with development; engineering and product, have exercised test status reports and have done some defects analysis.