Issue #181 : Software Testing Notes
Using AI as a practical assistant rather than a fully autonomous tester
Hello there! 👋
Welcome to the 181st edition of Software Testing Notes, a weekly newsletter featuring must-read content on Software Testing. I hope this week has been good for you so far.
This week, we will talk about:
Using AI as a practical assistant rather than a fully autonomous tester.
Common confusion between testing LLMs and testing applications that use them.
Insights from BCS Testing Conference 2025
OpenAPI test case generator
Testing AI bias
and much more…
✨ P.S. You might have noticed the new contrast and color changes on our Substack site. I’ve tweaked them for better readability and accessibility. I would love your feedback: Please do let me know!
📚 Testing
AI-Assisted Testing – The Rules and Roles by Gil Zilberfeld
Rather than using AI to generate test and letting AI loose on app and hoping it will test you app thoroughly, there is much easier and practical way to use AI. Take a look at this article by Gil Zilberfeld to know how.
It’s Not How to Test LLMs. It’s What to Test? by Aarthi GK
Testing pure GenAI models and testing GenAI-powered applications are not the same. Aarthi GK shares how confusing these two can leads to messy expectations and flawed test strategies and why we as a testers must align expectations with what’s actually being validated.
Top 3 Takeaways from British Computing Society, Software Testing Conference 2025 by Jitesh Gosai
Jitesh Gosai shares a thoughtful summary of the conference, topics ranging from how testing is evolving rapidly in response to AI, system complexity, and collaboration are shaping the future of quality and testing.
🔍 More Articles
⚙️ Automation
why we finally allowed arbitrary waits in our tests by Kosta Welke
Waiting strategies play a big part on reducing flakiness of tests. But sometimes, it something else entirely. Kosta Welke and team encountered a really interesting case where delayed hydration and unpredictable timing broke valid tests, read the article know what exactly happened and how they came up with the solution.
Automate Your API Test Case Generation with OpenAPI to Sheet by Irwan Syarifuddin
If you’re still manually writing test cases from your OpenAPI specs, this neat CLI tool created by Irwan Syarifuddin might just save you hours. OpenAPI to Sheet OpenAPI YAML specifications into Excel test case sheets. A great example of scratching your own itch.
Furthermore, he has also written about how to Generate API test in minutes using Swagger JSON + Github Copilot with Playwright
Mastering Chrome DevTools Protocol (CDP) in Selenium 4: A Practical Guide for Test Automation by Nitish Dwivedi
In this article, Nitish Dwivedi provides a walks through on how simulate slow networks, logging console output, capturing screenshots and more with the Chrome DevTools Protocol (CDP) in Selenium 4.
Docker for QAs: Playwright Tests On Docker by Rodrigo Cabral
As brining CI/CD in your test automation is becoming the norm, Rodrigo Cabral shares how to use Docker and Rancher Desktop to build a portable, repeatable test environment with Dockerized Playwright setup.
Playwright vs Selenium: Key Insights to Pick the Right Tool by Renzo Parente
Playwright and Selenium are two of the most important players in web test automation, but they serve slightly different needs. Renzo Parente offers a clear, practical comparison of the two and will help you decide which tool aligns best with your team’s testing strategy.
Testing AI for Bias: What We Have Learned by Hemraj Bedassee
Hemraj Bedassee digs into real-world examples of how AI bias surfaces across voice, text, language, and regional inputs and how human-in-the-loop (HITL) testing approach can help to uncover this issues.
🔍 Automation Articles
💨 Performance
Don't Forget These Non-Functional Requirements by Saurabh Dashora
Knowledge of NFRs are not just for developers but for performance testers too. Saurabh Dashora provides a walks through of eight essential non-functional requirements like availability, latency, and resiliency, offering real-world implementation tips for each one.
🔍 Performance Testing
🔒 Security
Your API is cute, but is it secure? by Dhaval Agravat
Dhaval Agravat uses a playful kitchen metaphor to teach serious backend security fundamentals every developer and security tester should master.
🔍 Security Testing
🛠️ Resources & Tools
Mocking Star — Mocking Star is an open-source mock server built with a focus on UI testing. It automatically intercepts your app’s network requests and returns mocked responses. You can create custom environments for UI and local tests, and use advanced filters to decide which requests should be mocked.
SSR (Server-side Rendering) Checker — compare the CSR (client-side rendered) version of your page with SSR (server-side rendered) version to uncover any SSR vs CSR issues.
UFreeTools — free online tools for developers, designers, covering coding, design, graphics, text editing, image, network, cryptography and more.
📝 List of Software Testers
Do you create content around Software Testing ? Submit yours blog details here and I will add it to the list.
🎁 Bonus Content
📌 OTHER INTERESTING STUFF
⭐ LAST WEEK'S MOST READ
😂 And Finally,
Tester discovering edge cases the developer never imagined possible 🤣
[P.S. If you like this meme please also Like and Follow our Facebook Page]
📨 Send Me Your Articles, Tutorials, Tools!
Wrote something? Send links via Direct Message on Twitter @TheTestingKit (details here). If you have any suggestions for improvement or corrections, feel free to reply to this email.
Thanks to everyone for subscribing and reading!
Happy Testing!
Pritesh(@priteshusdadiya)