GenAI Learning Journey, Contract Testing, AI Safety Testing and more TGNS131
8 Dec 2025 · 10 min
JoeBot covers this week's testing news: Lisa Crispin's GenAI learning journey, contract testing for microservices, and NIST's new open-source AI safety platform Dioptra. Also featured: GameDriver's latest release, Checkly's Series B funding, and a human+AI testing platform called Test Chimp.
Chapters
What famous tester just published the Gen AI LLM Learning Experience Journey? How can Contract testing bridge the gap in integration testing? And have you seen the new open source platform that was just released for AI safety testing? Find out in this episode of the Test Guild News show for the week of August 4th. So grab your favorite cup of coffee or tea and let's do this before we get into it. If you haven't already, make sure to subscribe to Our Test Guild LinkedIn New Show Newsletter that I have a link for down below to never miss another episode for. First up is a Gen AI LLM Learning Journey. So in this blog post by the renowned agile tester Lisa Crispin discusses the growing impact of generative AI and large language models on software testing. In this post, Lisa really emphasized how these technologies are helping testers by automating mundane tasks and generating valuable insights. She also highlights the importance of continuous learning and adaptability for testers to leveraging these advancements effectively. And she also provides examples of how Genai can assist in areas like test case generation, defect prediction, and even in simulating real world usage to uncover hidden issues. And Lisa also encourages testers to embrace these technologies to give them the try and try to integrate them into their own workflows. However, this post also cautions over the overreliance on these tools and stresses the need for human oversight to ensure quality and reliability. But I think the key takeaway, as Lisa points out, is to embrace these technologies while maintaining a critical eye to ensure the quality and reliability of their outcomes. So thank you Lisa for this post and to learn more, you can check out more about it down below. So how can contract testing help you with integration tests? Well, let's check out this latest post by Boz all about contract testing and how it has emerged as a critical approach with integration testing. And so this post goes over how contract testing provides an efficient and robust method to validate the interactions between different services. And it also goes over how, as microservice architecture becomes more and more the norm, how how traditional integration testing is really falling short to provide coverage for these types of tests. So he goes over how contract testing addresses these issues by defining and enforcing clear contracts between services, ensuring they communicate correctly without requiring complete end to end test. And this article outlines the mechanics of contract testing and also emphasizes its critical role in the software development life cycle. And by validating interactions at the micro level, developers can catch errors earlier, reducing costly fixes later in the pipeline. And he also points out how contract testing also supports parallel development streams by decoupling service dependencies and enhancing productivity. Definitely another mustering by Boz. You could check that out down below. I also came across a new tool that you should definitely check out, and it's how Sanjay Kumar just announced the release of a new browser extension called Check My Links, and this free tool quickly scans web pages to identify broken, active and valid redirect links, providing valuable insights in just a few seconds. It's available for Chrome, Edge, Opera and Brave browsers, and it helps maintain website integrity by detecting link issues. Some of the features Sanjay points out is that it highlights valid links in green, invalid links in red. It allows users to customize link highlight colors. You can export link data for further analysis, and an occlude settings to exclude certain pages from scans. So Sanjay is always developing new tools. Definitely keep your eye on him and definitely check this out as well. Let me know your thoughts about it in the comments down below. So what is the Dependency Inversion principle? To me it sounds like an 80s synth band, but it's not. It's actually something that can help software testers. What is it? Let's check it out. And this is by Kristen Giacovone, who goes over one of the last pieces of her Solid Principle series on the Dependency Inversion principle. So Kristen breaks down the dependency inversion principle, which advocates that high level modules should not depend on lower level modules. Instead both should depend on abstractions, which means that the core code base should rely on interfaces or abstracts classes rather than concrete implementations. And this approach encourages a more flexible intercoupled architecture, and she breaks down them. When applied to software testing, these principles can drastically improve the maintainability and scalability of tests. And so this looks like this is the last post in a series on Solid Principles, so make sure to check out all Kristen's other posts on this topic. Next up is all about Game Driver how it's just announced the release of its latest version, version 2024 07, and it's designed for Unreal Engines and Unity. And this update brings a variety of new features aimed at enhancing automated testing for game developers and testers and QA professionals. And this release focuses on improving workflow efficiency, expanding platform support, and integrating more seamlessly with CI CD pipelines. It also goes over some key additions, including enhanced interactions with game objects, updated support for various versions of Unreal Engine and Unity, and advanced debugging tools. These improvements are set to streamline testing processes, allowing developers to identify and resolve issues more quickly. And if you've never heard of Game Drive before, you don't know how it can help you with testing? Definitely check out our free training course course on getting started with video game testing using game driver to get you up to speed on this awesome utility as well. Next up is our Follow the Money segment. So Checkly has been on a roll. They just announced it raised 20 million in series B funding and Tim goes over how this financial boost is expected to aim Checkly enhancing its platform, which enables developers to detect and resolve issues at an unprecedented speeds, up to 10 times faster than traditional methods according to them. So definitely a cool solution. If you haven't checked it out, check it out as well and you can find more about this announcement in the links down below. So up next is how to build automate a full stack test quicker from manual test runs this is by Nuan, who posted on LinkedIn about a tool I've never heard of before that mentioned that he worked in organizations ranging from millions to trillion dollar scales, consistently finding testing to be a critical yet suboptimal area. As developers work increasingly relies on fast, inexpensive but often inaccurate large language models, testing is becoming the main bottleneck in the development process. Because of this he sees the role of humans in testing is changing, and while some advocate for fully AI driven testing, a more practical approach involves human guiding the process through the exploration and insights while AI handles the repetitive tasks like automating and scaling. And then that's where he mentions the tool I never heard of before. He points to test chimp, and this tool that he points to is an example of what he thinks is a balanced approach which combines human intuition and creativity with AI efficiencies. And this platform's goal is to create seamless integration of human and AI testing efforts in the testing process. Never heard of it before, but definitely if you have, let me know your thoughts on it in the comments. So this next article is all about observability and it's all about synthetic monitoring with open telemetry. So I've noticed over the years that observability has become more and more critical as a component to ensure robust and efficient systems. So a recent pivotal development in this field is the integration of synthetic monitoring techniques with OpenTelemetry, which is an open source project providing a unified set of APIs, libraries and agents and instrumentation to collect distributed traces and metrics. And this post goes over why maintaining optimal performance and reliability of software is critical. One innovative approach gaining traction is the use of synthetic monitoring combined with the powerful capabilities of opentelemetry. So synthetic monitoring, which involves simulating user interactions and transactions to test application performance is being seen as a cool way to use OpenTelemetry's flexible open source tools. And what's great about this approach is it enables organizations to preemptively detect performance issues and outages and in their software, ensuring a superior user experience. And this approach provides a proactive layer of observability, allowing teams to understand system behaviors under predefined conditions without waiting for real users to encounter problems. So I think this is an invaluable asset for diagnosing and resolving potential bottlenecks that every tester should learn about. And you can find out more about it in the links down below. And with all this talk around AI found an open source platform which is designed to enhance the safety testing of of artificial intelligence systems and this is by the National Institute of Standards and Technology has announced the release of an open source platform designed to enhance the safety testing of AI systems. This new initiative aims to provide a standardized method for evaluating AI technologies, ensuring that they function reliably and are free from biases. And by creating this platform, Nest seeks to offer developers, researchers and policymakers tools to assess the safety and effectiveness of AI applications comprehensively. And this tool, which I think is called Dioptra, is an open source web based tool which was first released in 2022 that they've added onto, which seeks to help companies train AI models and people using these models to assess, analyze and attract AI risk. And this framework also includes a suite of testing tools and frameworks to help you test AI systems. And these tools are geared towards identifying potential vulnerabilities and ensuring that AI technologies comply with established safety standards. So if you're a tester, you definitely should leverage these new tools to identify and mitigate risk, ensuring that AI applications you're developing are both secure and unbiased. All right, for links of everything of value we covered in this news episode, head on over to all those links in that first comment down below. So that's it for this episode of the Test Guild News Show. I'm Joe. My mission is help you succeed in creating end to end full stack pipeline automation Awesomeness as always, test everything and keep the good. Cheers.
More from JoeBot
Automation Testing Podcast 2026: New Schedule, Events, Discounts with Joe Colantonio
Automation Guild Kickoff, AWS Nova, Karate v2, and AI Testing Reality and more TGNS177