Issue #158 : Software Testing Notes
13 essential KPIs to track as a QA Manager
Hello there! 👋
Welcome to the 158th edition of Software Testing Notes, a weekly newsletter featuring must-read content on Software Testing. I hope this week has been good for you so far.
This week, we will explore:
Testing AI models using RAGAS, MLflow, and Pytest
How QA professionals and development teams can build trust with each other.
A Testing Framework for RAG Applications
APIs Exploratory Testing
Testing Applications with Network Constraints
and more…
🙏 Supported by
QA leaders, take your strategy to the next level. Our latest E-book, QA Manager’s Power Play, reveals 13 essential KPIs to track, helping you to cut data noise, improve QA efficiency, impress leadership, and drive business impact. Download your free copy now and start making smarter QA decisions.
📚 Testing
The Full Software Testing Chain: A Journey, Not Just a Step by Elena Voevodkina
Elena Voevodkina outlines the testing journey from unit testing to production monitoring, detailing the importance of each testing type in catching issues early and preventing failures
The Art of Debugging Together — How QA and Developers Can Align by Priyanka Verma
Clear communication and collaboration between QA and developers is the secret formula of success. Priyanka Verma explains that by providing detailed bug reports, explaining the impact, listening to developers' perspectives, and escalating when necessary, QA professionals can foster trust and alignment with development teams.
What is APIs Exploratory Testing and How it works? by Japneet Sachdeva
Japneet Sachdeva shares the importance of exploratory API testing API and how to approach it systematically, focusing on functionality, security, and user expectations while balancing automation with maintainability.
🔍 Software Testing
⚙️ Automation
Bruno + GitHub = Ultimate API Test Automation by Giridhar Rajkumar
Learn how to integrate Bruno tests into a GitHub Actions workflow. In this article, Giridhar Rajkumar provides a step-by-step guide on creating API requests with Bruno, adding assertions, running tests from the command line, and generating reports in JSON and HTML formats.
Mastering ADB logcat: Options, Filters & Advanced Debugging Techniques by Lana Begunova
ADB logcat helps you in efficient bug reporting and debugging by capturing, filtering, and analyzing logs. Lana Begunova explores advanced logcat techniques, such as buffer management, filtering commands, and best practices for isolating critical log messages to streamline troubleshooting.
In 2025: The Future of Automation Testing: Adapting to AI Model Validation by Dang Kieu
This is a very interesting sharing a step-by-step guide to testing AI models using RAGAS, MLflow, and Pytest. Dang Kieu shares how to set up the testing environment, conduct functional testing with Pytest, evaluate model performance using MLflow, and assess model accuracy with RAGAS metrics.
Running Postman Collections in Jenkins by Abubakkar Sithik
Do you know how to automate Postman API test execution using Jenkins? Abubakkar Sithik shows us how to utilize Jenkins pipeline and leverage Newman for running multiple Postman collections in parallel, generating detailed HTML reports, and sending email notifications along with multiple environment support.
Everything you need to know to create XUnit C# Tests in Visual Studio by Nick Polyak
This article provides a comprehensive guide to setting up and writing tests using XUnit in .NET, covering everything from creating test projects to running and debugging tests in Visual Studio.
Automating RAG Pipeline Evaluation with RAGAS: A Testing Framework for RAG Applications by Sumit Soman
When it comes to RAG apps, metrics like faithfulness, answer relevancy is how you test accuracy and reliability of Retrieval-Augmented Generation (RAG) systems. Sumit Soman provides a step-by-step guide on setting up RAGAS, generating synthetic test data, and automating performance evaluation using a sample RAG system powered by LangChain and OpenAI.
How to Get Started With Firebase Test Lab In Android Studio by Philipp Lackner
Philipp Lackner shows how you can make use of Firebase Test Lab for your Android app to test your app on various different devices, manufacturers and configurations in the cloud without having to physically possess these devices.
Improving the tests for RestAssured.Net with mutation testing and Stryker.NET by Bas Dijkstra
RestAssured.Net — C# DSL for writing readable tests for HTTP-based APIs (Bas is the creator of the framework)
Testing your test is important. As Bas Dijkstra embarked with mutation testing with Stryket.NET for RestAssured.Net, he found many gaps in the test coverage. This article outlines how Bas Dijkstra enhanced the test suite by adding missing assertions, refactoring code for better testability, and improving overall test logic.
🔍 Test Automation
💨 Performance
Setting up NeoLoad Controller and Load Generators by Sayan Bhattacharya
This is a detailed guide on how to optimize NeoLoad setup for complex testing scenarios Sayan Bhattacharya share few best practices for configuring controllers and load generators to ensure efficient testing, addressing network considerations and observability through integration with monitoring tools.
Prometheus or InfluxDB ? which one is better for storing Performance testing results by Pratik Ugale
What should you choose for storing JMeter performance test results? InfluxDB or Prometheus? Pratik Ugale argues that while Prometheus is primarily designed for real-time monitoring and alerting, its rigid schema and limitations in handling high-cardinality data make it less suitable for storing and analyzing complex JMeter results.
Testing Applications with Network Constraints by Vittorio Palmisano
How to test applications under real-world network constraints in a Linux environment?
Vittorio Palmisano has created a utility called the Throttler, which wraps around NetEm and IPTables to simulate bandwidth limits, latency, packet loss, and other network issues.
The article provides installation instructions and configuration details for setting up Throttler, with practical use cases with examples, such as throttling Firefox, iperf, and Zoom, to assess their performance under different network conditions.
Tackling Memory Leaks in Node.js by Siarhei Liashchou
The article highlights how memory leaks in Node.js can silently degrade performance, increase costs, and ultimately crash applications. Siarhei Liashchou explores common causes such as global variable misuse, closures retaining references, unclosed resources, and event listener accumulation, while also providing actionable fixes like using WeakMap, proper scoping, and automated cleanup strategies.
🔍 Performance Testing
🛠️ Resources & Tools
Appium Inspector — A GUI assistant for Appium (the UI automation platform), providing visual inspection of the app under test, showing app page screenshots and page source, and features for interacting with the app.
Light my Request — A fake HTTP request/response into a Node.js HTTP server for simulating server logic, writing tests, or debugging.'
📢 Call for Speakers
Are you passionate about software testing, quality assurance, or emerging tech trends? Whether you're a seasoned speaker or a first-time presenter, SIGiST Conference is looking for engaging speakers. Click here to find out more!
📝 List of Software Testers
Do you create content around Software Testing ? Submit yours blog details here and I will add it to the list.
🎁 Bonus Content
📌 OTHER INTERESTING STUFF
⭐ LAST WEEK'S MOST READ
Common Misconceptions About Quality Engineering by Jitesh Gosai
Beyond the Code: Crafting the Perfect Test Automation Strategy by Nishi G.
Shift-Left Performance Testing: Integrating k6 in CI/CD Pipelines by Sumit Soman
😂 And Finally,
📨 Send Me Your Articles, Tutorials, Tools!
Wrote something? Send links via Direct Message on Twitter @thetestingkit (details here). If you have any suggestions for improvement or corrections, feel free to reply to this email.
Thanks to everyone for subscribing and reading!
Happy Testing!
Pritesh(@priteshusdadiya)