Issue #224 : Software Testing Notes
Evals Are Just QA With a New Name
Hello there! 👋
Welcome to the 224th edition of Software Testing Notes, a weekly newsletter featuring must-read content on Software Testing. I hope this week has been good for you so far.
This week, we will explore:
Why did testing miss this…
AI Visual Testing: What It Can Check
How I Used a QA Agent Workflow to Reduce Manual Testing Pressure
Designing an AI-Assisted Mobile QA Framework
How QA Turns a Traffic Spike Into a Real Diagnosis
and more…
✨ Featured
Clean Your Inbox!
Tired of spending hours organizing your inbox manually? Meet Clean Email, an all-in-one email management toolset built not just to clean up your inbox once, but to keep it organized automatically over time.
Clean Email helps you build a self-maintaining inbox with intelligent tools that work in the background:
Auto Clean Rules: Automatically archive, label, move, or delete incoming emails based on rules you choose.
Cleanup Suggestions and Smart Folders: Analyze your mailbox and surface the largest sources of clutter, making cleanup faster and easier.
Screener: Keep unknown senders out of your inbox until you decide they’re worth letting in.
Boost your email productivity.
📚 Testing
Tester at the business intersection— how the testing role naturally expands by Melissa Fisher
Quality assurance inevitably pulls you out of your technical silo and directly into the broader mechanics of the business. Melissa Fisher explores how modern testers naturally evolves.
AI Visual Testing: What It Can Check and Where Humans Decide by Julia Pottinger
Julia Pottinger writes about the five different techniques that people call "AI visual testing" and why you must know the difference.
Evals Are Just QA With a New Name: How to Actually Test Skills and RAG by Amit Rawat
Amit Rawat shares a great guide on how to apply standard quality assurance to AI tools with examples, frameworks, and test methods we can utilize to correctly measure your automated agents before they fail.
Speaking up is only half the story by Jitesh Gosai
A quiet team will frequently make bad decisions. Jitesh Gosai explains how your reactions to questions teach your colleagues to share or hide problems, which helps to build a better engineering culture.
Why did testing miss this… Because You didn’t set a risk appetite by Callum Akehurst-Ryan
Managers usually blame testers for software errors, but Callum Akehurst-Ryan correctly identifies missing executive decisions and shows us exactly how to make leaders set a strict quality standard so your team can test with confidence.
🔍 Software Testing
⚙️ Automation
Fakes vs Mocks in Testing by Dhananjay
How do you choose what to mock and what to fake when you are testing? This brilliant guide tells you exactly when to use mocks for external services and fakes for internal states to write strong tests.
How I Used a QA Agent Workflow to Reduce Manual Testing Pressure by James Cullimore
Over time, manual tests often become repeated and impossible to manage. James Cullimore shares a clever plan by adding adding a testing map and shows how it builds link between code and test cases.
Why I Prefer BDD over SDD for Agentic Development by Vitaliy Pot
I know many dislike creating BDD tests but we are in era where AI agents build software and test suites quickly, having BDD style instructions makes much more sense now.
Alternative Solution to iOS Auto Recording Problem on Appium by Ahyar Ibrahim Aldebaran
Appium test recordings for iOS often fail and create bad video files. In this aricle, Ahyar shows how to solve this problem and record the screen correctly when you use FFmpeg on a Mac.
Designing an AI-Assisted Mobile QA Framework That Teams Can Maintain by Rashiprabha Atapattu
Rashiprabha Atapattu has written an excellent guide on building a mobile testing framework with AI assistance.
How I Built an Oracle to Evaluate a QA Test-Generation Agent by Daniel Dahlin
I have seen AI agents write test scripts that are believable but doesn’t actually test what you want the way you wanted. Daniel Dahlin shares how to build a hidden answer key to prove whether your testing agent is actually writing correct tests.
AI Chat Bot Testing Exercises by Alan Richardson
Alan Richardson shares an excellent exercise for us to practice text attacks and learn exactly how users can break AI Chat bots.
Stop Copying Your API Contract Into Your Cypress Tests by Bart Vanherck
Broken software often hides behind tests that pass for the wrong reasons. Bart Vanherckshares how generating your test requests directly from an OpenAPI document forces your compiler to catch these errors immediately.
🔍 Test Automation
💨 Performance
How QA Turns a Traffic Spike Into a Real Diagnosis by Irfan Mujagić
Irfan Mujagić makes a strong case for careful triage of your load spikes as it always beats fast guesses and walks through how QA should investigate a traffic spike before anyone blames the code.
Load Testing Databricks SQL Warehouses with JMeter
Single query timings can hide real performance issues. This guide shows how to use JMeter to benchmark Databricks SQL warehouses under realistic concurrent load.
🔍 Performance Testing
🌞 Accessibility
Testing Methods: Labels or Instructions by Dennis Deacon
Clear labels and instructions are essential for accessible forms, but automated checks alone cannot judge whether they help real users. Dennis Deacon explains how automated testing, AI, and manual testing work together to evaluate WCAG 3.3.2 Labels or Instructions.
🔍 Accessibility Testing
✨ Featured
Clean Email — helps you build a self-maintaining inbox with intelligent tools that work in the background:
Auto Clean Rules: Automatically archive, label, move, or delete incoming emails based on rules you choose.
Cleanup Suggestions and Smart Folders: Analyze your mailbox and surface the largest sources of clutter, making cleanup faster and easier.
Screener: Keep unknown senders out of your inbox until you decide they’re worth letting in.
🛠️ Resources & Tools
SQLite Schema Diagram Generator — Visualize your DataBase in SQL Schema graph.
Regexper - Create a Diagrams from your regular expressions
SMS Temp — Utilize for testing SMS while protecting your privacy and security with free temporary phone numbers service.
📝 List of Software Testers
Do you create content around Software Testing ? Submit yours blog details here and I will add it to the list.
🎁 Bonus Content
📌 OTHER INTERESTING STUFF
⭐ LAST WEEK’S MOST READ
The Invisible Rituals Every QA Engineer Learns the Hard Way by Deogracious
What is next after an experienced quality role? by Jesper Ottosen
😂 And Finally,
No Issues found **They are just errors 🤣
📨 Send Me Your Articles, Tutorials, Tools!
Wrote something? Send links via Direct Message on Twitter @thetestingkit (details here). If you have any suggestions for improvement or corrections, feel free to reply to this email.
Thanks to everyone for subscribing and reading!
Happy Testing!
Pritesh(@priteshusdadiya)