Issue #207 : Software Testing Notes
The Test Pyramid Was a Lie
Hello there! 👋
Welcome to the 207th edition of Software Testing Notes, a weekly newsletter featuring must-read content on Software Testing. I hope this week has been good for you so far.
This week, we will explore:
The Testing Skill Gap Your Competitors Are Exploiting
How to Build a Scalable API Automation Framework Using Java, RestAssured, and JUnit 5
Escaped Defect Rate: Quality is about hard truths
Testing non-predictive systems: letting the tests teach you
Your K6 Tests Are Lying to You (And It’s Not K6’s Fault)
and more…
📚 Testing
The Test Pyramid Was a Lie (Or at Least an Oversimplification) by Phil Hargreaves
Phil Hargreaves takes a thoughtful look at the test pyramid and challenges the idea of optimizing for test layers and coverage, and instead explores a more practical workflows that matter most to users.
Testing non-predictive systems: letting the tests teach you by Peter Wilson
What does testing looks like when there’s no clear answers? Peter Wilson talks about how to implement an iterative “testing cycle” that gradually evolves showing how testers build confidence in system behaviour over time rather than simply verifying expected outputs.
The Testing Skill Gap Your Competitors Are Exploiting by Matt Lewis
Matt Lewis argues that the biggest testing risk today isn’t poor automation but it’s losing the investigative, business-aware thinking that experienced testers bring to the table.
How to Measure E2E Test Coverage Without a Standard Tool by Josphine J.
Josphine tackles the deceptively simple question of E2E test coverage and explains why standard coverage tools don’t work for E2E tests, and what to measure instead.
Escaped Defect Rate: Quality is about hard truths, not ego boosts by Alison
Alison blends QA concepts with personal reflection to explore how decisions that look “correct” by conventional metrics can still fail once they reach real world.
🔍 Software Testing
⚙️ Automation
Migrating From Cypress.env To cy.env and Cypress.expose Methods by Gleb Bahmutov
Gleb Bahmutov shares a notable change coming in Cypress v16 that rethinks how environment variables and secrets are handled during tests.
It’s clearly a bug, but what is the bug exactly? by Joep Schuurkes
Joep Schuurkes unpacks a puzzling Playwright issue and walks through the debugging process and explains how dynamic test names combined with Playwright’s double evaluation of test files can lead to confusing behaviour.
AI-Assisted Development is the New Test Automation by Stuart Thomas
This article by Stuart Thomas draws an interesting parallel between the rise of test automation and today’s surge in AI-assisted development, arguing that the real shift isn’t about tools replacing engineers but about how engineers choose to use them.
Writing tests with Claude Code - part 1 - initial results by Bas Dijkstra
Bas Dijkstra explores what happens when an LLM is asked to generate an entire API test suite from scratch, walking through the Bas ’s experiment generating 23 REST tests in minutes and then evaluating their real value.
Your API Tests Are Passing. That’s the Problem. by Gil Zilberfeld
This article introduces the idea of the “Green Mirage,” and through simple API testing examples, Gil Zilberfeld explores how stronger assertions and clearer thinking about what a test actually proves can reveal hidden gaps.
How to Build a Scalable API Automation Framework Using Java, RestAssured, and JUnit 5 by Ameya Sawant
Ameya Sawant provides a walks through building a scalable API automation framework with Rest Assured, JUnit 5, and Apache Maven.
🔍 Test Automation
💨 Performance
Your K6 Tests Are Lying to You (And It’s Not K6’s Fault)
This piece takes a thoughtful look at how load testing with k6 can quietly mislead teams if they misunderstand its virtual user model, especially the common assumption that VUs equal real users.
🔍 Performance Testing
🛠️ Resources & Tools
QaSkills.sh — is an open source directory of curated QA testing skills designed for AI coding agents. You can install these skills into Claude Code, Cursor, Copilot, and 30+ other AI agents to give them expert QA knowledge.
MCPLab — A tool to test and evaluate MCP servers and evaluating AI/LLM tool integrations.
📝 List of Software Testers
Do you create content around Software Testing ? Submit yours blog details here and I will add it to the list.
🎁 Bonus Content
📌 OTHER INTERESTING STUFF
⭐ LAST WEEK’S MOST READ
Software Quality is Heading Toward a Revolution by Josh Grant
Persona-based testing with AI agents: find the UX gaps your E2E tests can't see
From Dev Branch to Production: A QA Engineer’s Guide to CI/CD Pipelines by Himanshu Pathak
😂 And Finally,
📨 Send Me Your Articles, Tutorials, Tools!
Wrote something? Send links via Direct Message on Twitter @thetestingkit (details here). If you have any suggestions for improvement or corrections, feel free to reply to this email.
Thanks to everyone for subscribing and reading!
Happy Testing!
Pritesh(@priteshusdadiya)