Browser Conference, OpenSource LLM Testing, Up-skill Test AI, and more TGNS125

What Free Must Attend Agnostic Browser Automation Conference is happening this week. Have you seen the Open Source LLM Evaluation framework to help you test? And do you want to know how to upskill your testing team with AI and navigate the future of quality assurance? Find out in this episode of the Test Skill News show for the week of June 16th. So grab your favorite cup of coffee or tea and let's do this. First up is all about the Browser Conference. So the Browser Conference is set to take place this week June 20th and it will provide a neutral platform for discussing browser automation and this free online event will feature speakers from companies such as Google Sauce Labs and Selenium focusing on topics related to testing, scraping and AI. Some awesome topics are covering is AI driven testing Large scale scraping challenges in next generation WebDriver bidi protocol the the Browser Conference is a free online conference and they have sessions around working with libraries such as Puppeteer, Playwright and Selenium, and they also have a fantastic speaker lineup as well. Make sure to register now even if you can't make it, because Replays will be available for all registered attendees. So just go to TestGuild me BrowserCon and sign up now or use the special code down below and hope to see you there. Are you running your tests in a Java Maven project? If so, I just found a new blog post by Andy Knight, the Automation Panda, and this post outlines all the steps needed to effectively run tests in a Java Maven project. The blog emphasizes following the standard directory layout for placing test code and main code separately, so it covers adding the Maven Surefire plugin for unit test and the Maven Failsafe plugin for integration tests, ensuring tests run smoothly and comprehensively. The best the post also advises on maintaining a clean build environment and adhering to Maven conventions to avoid complexities and maintainability issues. So to learn more about leveraging Maven's built in lifecycle phases and keeping the POM file well organized and how it can significantly improve your test automation. Definitely check out that post in the links down below. Are you looking for an HTML report generator designed for Playwright Test? Well, I just found this new Solution on my LinkedIn feed by Kaushik, who has announced the release of Bertani Report Version one, which is a new HTML report generator designed for Playwright Test and this tool aims to enhance reporting capabilities by providing a structured and visually appealing way to organize test results. Key features include how to group your test results, flexible configuration options, automatic directory creation for screenshot storage, and color coded test statuses and and users can install this via NPM and configure it within their Playwright setup. So for more details, definitely check out this NPM page that I'll have for in the links down below. And speaking of Playwright, if you also want to know how to turbocharge your Playwright executions, you want to register for our upcoming webinar all about how to do so using the solution I just learned more about called testcube, which is the first test orchestration platform for cloud native applications. And once again there'll be a link for you to register for this webinar and down below. Next up is a Follow the Money segment Blink IO, an autonomous generation AI software testing platform, announced that AS secured 5 million in funding and this funding will support the company's expansion in the US and address the global shortage of test programmers. So Blink IO's AI driven platform automates test script creation and maintenance without human intervention. Founded by Tal and Guy, you probably know them, they've been in the testing space for a while. They blinkio really aims to help innovate in the software testing space with its technology which supports over 50 languages and operates 24 7. And to actually see Blink IO in action, make sure to check out another upcoming webinar we have with Blink IO that goes over all about how to upskill your testing team with AI navigating the future of quality assurance. And you can register for that once again in the links down below. So speaking of gen AI, is it going to replace you and your engineering teams? Probably not. But why? Let's find out more. This Stack Overflow blog, written by Charity Majors, CTO of Honeycomb IO, outlines why or what is the limitations of generative AI in building engineering teams. While generative AI can assist with writing code, it cannot replace the complex human roles required for effective team building and collaboration. And the article also emphasizes that while AI generated code can be a useful tool and it lacks the contextual understanding and problem solving skills inherent to human engineers, and as such, relying solely on generative AI for team development is insufficient. So software testers should recognize that while generative AI can aid in automated some tasks, it's not a substitute for human expertise and understanding, project requirements, team dynamics and strategic decision making. And while it won't replace, it actually can help assist with certain things. And you should definitely check things out. For example, here's another tool I just launched which is an AI codeless test automation solution I believe it's called Ponya has availed its latest AI driven codeless test automation solution which is designed for erp, CRM and enterprise cloud applications and this solution leverages change intelligence to enable comprehensive cross application testing. This platform integrates requirement management, test management, low code and no code, test automation and change impact analysis, providing a streamlined and intuitive experience for users of all skill levels. And the announcement goes over that by automating test scripts, generation and validation using its generative AI solution and aims to streamline testing processes particularly for SAP and Salesforce environments, which I know a lot of people struggle to automate using open source type of solutions. All right, we talk a lot about generative AI, but how do you handle or how do you test LLMs? I came across Marie's LinkedIn post that highlights some of the challenge of testing large language models goes over how can you ensure reliability in customer facing applications and why it's essential and they point to a confidence AI deep eval solution and what's cool about the solution. It is a simple to use open source LLM evaluation framework. It's similar to pytest but specifically designed for unit testing LLM outputs and it includes the latest research to evaluate LLM outputs based on metrics such as geovalve, hallucinations, answer relevancy. So whether your application is implemented via RAG or fine tuning LangChain or anything else, DeepAvalve has you covered. So definitely check out DeepAvalve for yourself to help streamline LLM testing by integrating automated comprehensive evaluations into bake them into CICD pipelines. So hopefully this approach ensures that your code and prompt changes do not compromise the reliability of generated answers. And in security news, Microsoft has delayed the release of Recall, a new feature in Windows 11 that allows users to research their computer for previous viewed content. Initially set for broad availability in June, Recall now will be available only for Window Insider. Programmer participants and Microsoft made this decision to ensure the features meet high standards for quality and security, following feedback from the Windows Insider community. So this Recall feature, which captures screenshots of users screens every few seconds, raise concerns among security professionals and privacy advocates. Critics highlight potential security risk, prompting Microsoft to make Recall an opt in feature, encrypts its database and also requires enrollment for activation. So this delay follows a ProPublica report on Microsoft's handling of critical vulnerabilities, including pressure on the company to improve its security practices. So as a software tester, you should definitely always be concerned about security, be raising this within your teams before it goes public with things like these type of features. And last up we have Rapid7, who actually makes one of my favorite security tools, Metasploit they've announced that they've introduced generative AI capabilities to its AI engine, enhancing its managed detection and response services. And this update aims to improve threat detection, alert, triage, and incident response. This AI engine now uses large language models to analyze vast amounts of threat data, helping security analysts quickly identify and respond to malicious activities. All right, for links of everything of value we covered in this news episode, headed over to all the links in that comment down below. So that's it for this episode of the Test Skill New show. I'm Joe. My mission is to help you succeed in creating end to end full stack pipeline automation awesomeness. As always, test everything and keep the good. Cheers.