MCPs everywhere, NASA Hates LLMs and More! TGNS153

Who cares about AI Augmented Software testing? Have you seen all the new MCP servers like the one for Selenium? And why does NASA hate LLMs? Find out in this episode of the Test Skill News show for the week of April 6th. So grab your favorite cup of coffee and tea and let's do this. Hey, before we get into the news, I want to thank this week's sponsor, Zap Test AI, an AI driven platform that can help you supercharge your automation efforts. It's really cool because their Intelligent Copilot generates optimized code snippets while their Plan Studio can help you effortlessly streamline your test case management. And what's even better is you can experience the power of AI in action with their risk free 6 month proof of concept featuring a dedicated ZAP expert at no upfront costs. Unlock unparalleled efficiency and ROI in your testing process. Don't wait. Schedule a demo now and see how it can help you improve your test automation efforts using the link down below. First article comes our way via Angie Jones. She posted how she created or just released Selenium MCP Server, which is a new implementation that enables browser automation through the Model Context Protocol with Selenium webdriver. So we've seen all the hype around Playwright. So now to be outdone, Angie Jones posts this on GitHub and this tool allows developers and testers to unmate browser interactions through standard MCP clients supporting both Chrome and Firefox browsers. The server includes capabilities for starting browser sessions, navigating URLs, finding elements using various locator strategies, and performing essential interactions such as clicking and typing and capturing screenshots. The implementation is also designed to work with multiple MCP clients, including Goose and Claude Desktop, and can be installed through an easy one click process or manually via npm. All right, this tool is really cool because it bridges the gap between slim webdriver functionality and the emerging MCP standard for automation that we've been seeing everywhere lately. So thank you Angie Jones once again for this awesome contribution. You can find more about it in the link down below. Down below. Next up is the Webinar of the Week. What is it? Let's check it out. So the Test Guild is hosting a webinar titled who Cares about AI Augmented software testing on April 15, and the session will be led by the one and only automation cyborg Jonathan Wright, who's the Chief AI Officer at keysight Technologies. Jonathan really knows his stuff. This is not to be missed. This webinar aims to provide software testers with a clear understanding of AI's role in testing, distinguishing practical applications from marketing hype, which is all over the place. So key topics he'll cover include the evolution of AI and testing, insights into machine learning, generative AI, and the potential risk associated with cloud based AI testing tools. You don't want to miss it and you can register using the link down below. So next article I found scrolling on LinkedIn is by Missy and she links to a NASA report which questions the use of large language models and safety certifications and this new NASA technical report, which was released in March of 2025, raises significant concerns about proposals to use large language models like GPT4 in the development and assessment of safety arguments for critical systems and it goes over how after reviewing 14 relevant papers, the researchers found that while preliminary studies show potential, the technology is far from ready for deployment in critical certification workflows. And some quotes that really pop out is LLMs are machines that BS, not machines that think. And thinking is precisely the task that must be automated if the technology is to improve safety. A lower cost, which I think is really relevant to software testers. And the researchers go on to characterize LLM outputs as Frankenstein BS text produced without regard for its truth value. And it also goes over 14 key questions that must be answered before LLM based argument technology should be considered fit for deployment, including concerns about how automation might impact system design, effectiveness, augment readability, and the identification of potential flaws. The researchers also note that current studies on LLM capabilities in this domain suffer from significant limitations, including small sample size, use of simplified examples rather than full scale safety arguments, and the possibilities that LLMs are simply mimicking examples from their training data rather than really demonstrating true understanding. All right, it's been a while since I spoke to the folks at Karate Labs, but I just noticed they have a new release. They just announced the Release Explorer 1.20, which is a significant update that introduces deep open API and MCP support. This development enhances the tool's capabilities, especially for API testing, by offering more comprehensive support for open API specifications. The update aims to improve the precision and speed of API testing processing, giving software testers an advanced toolkit to ensure API reliability.

Also, the Explorer 1.2 release promises improvements in test coverage and stands out for its ability to seamlessly integrate with existing testing environments. Additionally, enhanced support for MCP allows testers to efficiently manage microservices, vital and modern cloud based application architectures. And with this release, Karate Labs positions X Explorer as the robust solution for teams focused on API and microservices testing. So another company I follow all the time came out with an announcement and that is how Excel Q has announced the significant enhancement to its Autopilot platform. We don't know. Excel Q has been a big supporter of the Test Guild over the years, so really excited to see that they just introduced an AI driven agent designed to automate the entire software testing lifecycle. And this enterprise grade AI agent learns the application under tests. It generates fully executable test cases autonomously, aiming to help reduce manual intervention through the testing process. And and according to the company, early adopters have reported a 65% reduction in the test creation time and the 80% decrease in maintenance efforts. So big promises. Is it true? Well, try it for yourself. Use the link down below and let me know. So with all this talk with mcp, a lot of people are asking is this going to be a replacement for APIs? Not really. And here's why this article goes over that despite claims that MCP threatens To replace traditional APIs, the protocol serves more as a consumer of APIs rather than a replacement. And the author Kevin, breaks down how MCP functions similar to the language server protocol use in software development environments, creating a standardized interface between between AI assistants of various tools, services and data sources. And many companies are already generating MCP service directly from existing open API definitions, effectively transforming API descriptions into MCP compliant interfaces. But security remains a significant concern with the protocol. And for API developers, MCP introduces a new design consideration, including creating more AI friendly interfaces and documentation that services both human and machine Readers and I'm not sure how many of you are part of our free channel in our community, but we just got a post by Gagan who talked about how he recently discussed the significance of mutation testing and software quality and he told me he actually learned about this on one of our new shows about mutation testing and he actually put it to the test. You don't know Mutation testing evolves deliberately introducing introducing small changes or mutants into applications code to evaluate the effectiveness of existing test suites and the objective is to determine whether the test can detect the introduced errors, thereby assessing their robustness. And in this article he highlights PI Test, which is a tool designed to automate this process. PI Test systematically alters code to create mutants and then runs unit tests to see if those changes are detected. The outcomes are categorized as either killer mutants which are detected by the test, or survive mutants which go unnoticed, indicating potential gaps in test coverage. And he talks about how his company has integrated mutation testing and has reported enhanced test suite quality and effectiveness. He also notes that earlier implementations of PI tests could have prevented certain incidences, underscoring the value in maintaining high quality code so Next up in Docker News Docker has just Unveiled Docker Desktop 4.40 and this brings a significant enhancement aimed at refining the software development workflow. Key updates include the integration of a new Compose Watch feature, allowing developers and testers to monitor changes in real time and automatically update their Docker environments without manual intervention. This version also introduced an improved volume management feature offering user enhanced capabilities by handling data volumes, which is crucial for maintaining a consistent environment across development, testing and production pipelines. And last up, Elastic has made a announcement that the general availability of Elastic distribution of open telemetry offering site liability engineers and developers and testers a production ready open telemetry ecosystem with enterprise grade support and this announcement goes over the initiative addresses the challenges identified by EMA research where over 73% of it decision makers plan to implement open Telemetry but face adoption barriers due to insufficient support. This also aims to eliminate vendor lock in and proprietary add ons, providing a stable open source solution for infrastructure and application monitoring. All right, for links of Everything value we covered in this news episode, head on over to the links in the first comment down below. So that's it for this episode of the Test Skill News Show. I'm Joe. A mission to help you succeed in creating end to end full stack pipeline automation awesomeness. As always, Test everything and keep the good. Cheers.