Issue #209 : Software Testing Notes
Put quality at the centre of what you do
Hello there! 👋
Welcome to the 209th edition of Software Testing Notes, a weekly newsletter featuring must-read content on Software Testing. I hope this week has been good for you so far.
This week, we will explore:
Who Tests the Tests? AI, QA, and the Verification Paradox
Trust in Test Planning
Testing LLM Outputs: A Hands-On Guide to DeepEval Metrics
Designing Realistic Load Test Scenarios with k6
Test Your Website with Just a Keyboard: The Easiest Accessibility Check
and more…
📚 Testing
Put quality at the centre of what you do – A Review of ‘Out of the Crisis’ by W. Edwards Deming by Mike Harris
Mike Harris takes a reflective revisit of Out of the Crisis and explores how Deming’s ideas, especially the feedback loop of continuous improvement and shared purpose can shape a team’s approach to quality.
Who Tests the Tests? AI, QA, and the Verification Paradox by Irfan Mujagić
In this piece Irfan Mujagić tackles the awkward loop created when AI generates tests and then we’re told to “verify with more tests”. As Irfan points out We should be focusing on adversarial thinking, domain knowledge, and intentional review rather than piling on automation.
The Knowledge Void Eats Quality for Breakfast by Gil Zilberfeld
Gil Zilberfeld explores the “Knowledge Void” that creeps in when AI-generated code and tests outpace our understanding on what systems actually do and how they’re validated.
Trust in Test Planning by Jesper Ottosen
Jesper Ottosen reframes test planning as less about generating artifacts and more about building trust, alignment, and shared understanding.
🔍 Software Testing
⚙️ Automation
Testing LLM Outputs: A Hands-On Guide to DeepEval Metrics by Serhii Smetanskyi
Serhii Smetanskyi takes a deep dive into making LLM testing feel a bit more like real engineering by plugging “LLM-as-judge” metrics into familiar pytest workflows.
Why Every Testing Tool Generates Different JUnit XML by Dennis Martinez
Dennis Martinez digs into the world of JUnit XML, showing how a “standard” with no real spec still manages to power useful tooling. It’s a nice reminder that messy formats can still be valuable.
From Prompt to Passing Test: A Complete Agentic QA Session by Ivan Davidov
Lean how a well-instructed AI agent can go from vague prompt to fully working test suite. Ivan Davidov has written series of articles exploring the app, generating code, and wiring everything into CI.
🔍 Test Automation
💨 Performance
Designing Realistic Load Test Scenarios with k6 by Indra A.
Indra A shares how to design K6 load test step by step and shows how modeling ramp-up, peak periods, and “think time” should be used.
🔍 Performance Testing
🌞 Accessibility
Test Your Website with Just a Keyboard: The Easiest Accessibility Check
This article makes a strong case for the simplest possible accessibility audit by putting your mouse away and navigating with just a keyboard is a fast way to uncover surprisingly common usability failures that affect far more users than most teams assume.
Accessible web testing with Cypress and Axe Core by Vitaly Skadorva
Vitaly Skadorva has written a practical guide to include accessibility into your test suite with Cypress and axe-core.
🔍 Accessibility Testing
🛠️ Resources & Tools
AI-Test-Case-Generator-Eval — AI-powered tool for evaluating LLM-generated test cases across multiple models with human and LLM-as-judge scoring
📝 List of Software Testers
Do you create content around Software Testing ? Submit yours blog details here and I will add it to the list.
🎁 Bonus Content
📌 OTHER INTERESTING STUFF
⭐ LAST WEEK’S MOST READ
Stop Writing API Tests Manually — Let Your OpenAPI Spec Do the Work by David Mello
End-to-End Testing with Playwright: Complete Guide with Page Object Model by Satish Reddy Budati
😂 And Finally,
📨 Send Me Your Articles, Tutorials, Tools!
Wrote something? Send links via Direct Message on Twitter @thetestingkit (details here). If you have any suggestions for improvement or corrections, feel free to reply to this email.
Thanks to everyone for subscribing and reading!
Happy Testing!
Pritesh(@priteshusdadiya)