Issue #156 : Software Testing Notes
How do I Test AI?
Hello there! 👋
Welcome to the 156th edition of Software Testing Notes, a weekly newsletter featuring must-read content on Software Testing. I hope this week has been good for you so far.
This week, we will explore:
How to Test AI and role of AI systems in reducing software testing costs.
Inconsistent and poorly defined terminology in software testing
Page Transactions design pattern using Guará
Practical steps for implementing Data Flow Testing
Python Typed Parameterized Decorators in Test Automation
and more…
🙏 Featured
350+ best hand-picked tools to supercharge your testing.
TestDevTools is a collection of 350+ hand-picked tools & resources for your every testing needs. Whether you're looking for a new Automation tool, framework alternatives, a new way to manage test data, a way to learn development or testing… We got you covered.
📚 Testing
How do I Test AI? by James Thomas
James Thomas explores the challenges involved in testing AI systems with it’s unique complexities such as data variability and ethical concerns. The article discusses key areas such as input/output coverage, risk assessment, bias detection, automation at scale, and the importance of human oversight to ensure AI reliability and fairness.
A lack of standard (testing) terms hurts us all by Callum Akehurst-Ryan
This article discusses how inconsistent and poorly defined terminology in software testing creates confusion, making communication difficult within the testing community. Callum Akehurst-Ryan argues that lack of standardized language leads to misunderstandings, inefficiencies, and even imposter syndrome, affecting both individuals and the profession as a whole.
Onboarding Tips for Testers by Cassandra H. L.
How do you onboard a tester in a project? Cassandra H. L. has written a guide for effective onboarding in a new company or project, focusing on key areas such as gaining domain knowledge, securing necessary access, and building relationships.
The Role of AI in Reducing Software Testing Costs by Emma Thomsan
Emma Thomsan explains the high expenses associated with traditional testing methods, such as manual effort, long test cycles, and scalability challenges, and demonstrates how AI mitigates these issues through automation, faster bug detection, optimized regression testing, and continuous testing integration.
🔍 Software Testing
⚙️ Automation
Page Transactions as a new way to organize your testing automation by Douglas Cardoso
Guará — is a Python implementation of the Page Transactions design pattern, which simplifies test automation by focusing on user operations rather than UI elements.
Douglas Cardoso (creator of Guará) shares how Guará enhances test readability, maintainability, and flexibility by grouping user interactions into transactions, making test scripts feel like plain English while remaining tool-agnostic. The article provides a practical example using Selenium, explains its integration with various automation tools.
The Magic of Web Component Tests by Gil Zilberfeld
In this blog post, Gil Zilberfeld explores how component testing, using tools like React Testing Library with Jest, provides a way to test components in isolation without relying on full-page rendering.
How to Run a Specific Spec File in Playwright Tests Sequentially by Butch Mayhew
A great article by Butch Mayhew addressing the issue of test failures caused by state changes in Playwright tests running in parallel and presents a solution to ensure test consistency.
Regular expressions can help you to do more with your automated tests by Mike Harris
Mike Harris writes about how regular expressions (regex) can be used in Playwright tests to provide more flexibility when filtering elements, compared to using plain strings. The article demonstrates how passing regex as a function parameter allows for more precise element selection, such as matching text that starts, ends, or contains specific patterns.
Data Flow Testing: A Comprehensive Guide by Ekaterina egorova
Data Flow Testing — is a structural testing method that analyzes how data moves through a program to identify errors related to variable usage, ensuring data reliability and code quality.
Ekaterina egorova outlines practical steps for implementing Data Flow Testing, including program analysis, building data flow graphs, identifying definition-use chains, and creating test cases to optimize code performance and accuracy.
Python Typed Parameterized Decorators in Test Automation by Nikolai Filatov
Nikolai Filatov demonstrates practical implementations of typed decorators for platform-specific tests, timeout enforcement, and retry mechanisms, making test suites more robust, maintainable, and efficient.
🔍 Test Automation
💨 Performance
🔍 Performance Testing
🌞 Accessibility
Accessibility essentials every front-end developer should know by Martijn Hols
Although the article is targeted to the front-end developers, the insights shared by Martijn Hols will be a great help to you in finding the accessibility gaps that might get unnoticed otherwise.
🔍 Accessibility Testing
🔒 Security
What's OAuth2 Anyway? by Roman Glushko
Roman Glushko provides an in-depth exploration and design principles behind OAuth2. The article examines the historical context and challenges that OAuth2 addresses, such as the risks associated with sharing user credentials directly with third-party services.
Prompt Injection for Large Language Model (LLM) Security by Kalyan Singh
The article discusses the security risks associated with large language model (LLM) applications, focusing on vulnerabilities like prompt injections that can lead to unintended behaviors, data leaks, and exploitation. Kalyan Singh shares how to outline mitigation strategies, including input validation, context management, and monitoring, to help organizations secure LLM-powered applications and maintain user trust.
🔍 Security Testing
🛠️ Resources & Tools
mitata — A configurable benchmarking tool with automatic garbage collection and universal run-time compatibility.
API Tester — A free multi-featured app for iOS, Android, iPadOS, and macOS to test any type of API (REST, GraphQL, SOAP, JSON RPC, XML, HTTP, HTTPS, etc).
CrUX Vis — An experiment from the Chrome team, it's a Chrome User Experience Report that provides a dataset that reflects how real-world Chrome users experience popular destinations on the web.
Auto Playwright — A TypeScript package that lets you automate Playwright steps using ChatGPT, with support for all browsers that Playwright supports.
📝 List of Software Testers
Do you create content around Software Testing ? Submit yours blog details here and I will add it to the list.
🎁 Bonus Content
📌 OTHER INTERESTING STUFF
⭐ LAST WEEK'S MOST READ
The Honeycomb Test Model: A Holistic Approach to Software Testing by Shubham S.
Bugs aren't the problem, they're symptoms of a problem by Vitaly Sharovatov
😂 And Finally,
This is how a real tester truly thinks.
📨 Send Me Your Articles, Tutorials, Tools!
Wrote something? Send links via Direct Message on Twitter @thetestingkit (details here). If you have any suggestions for improvement or corrections, feel free to reply to this email.
Thanks to everyone for subscribing and reading!
Happy Testing!
Pritesh(@priteshusdadiya)
The and finally funny post already does not work anymore :(