Automation Code Coverage, Audio Video Testing and More TGNS71

How does Code coverage for Automation work for Game Test Automation? What are some of the top continuous automation testing platforms? And have you seen this cool method to help troubleshoot Java applications? Find out in this episode of the Test Guild DevSecOps news show for the week of January 15th. So grab your favorite cup of coffee or tea and let's do this. The awesome folks at applitools sponsor this Test Guild News show episode still not doing Visual validation testing? Why not? This year more than ever, you need to learn the difference between functional and visual testing gaps that functional testing misses and how visual tests help you to deliver a better user experience, which is more important now than ever. And it's easier now than ever to get started. All you need to do is create a free applitools account using the link in the first comment down below to take your automation efforts to the next level this year. First up, Automation News so our first post is so Alan Page link to someone else's post on code coverage for Game Test Automation. Anytime I see something by Alan Page link into something else and at the same time I'm seeing Wayne commenting on it as well. I know it's going to be a good resource that you need to look at as well. So the actual article was written by Henry Golding and what's cool is he shares some thoughts on how to effectively use code coverage in a C game test automation context. And he starts off the article with some good use cases for coverage data. One of them is finding untested code. The second one is optimizing test selection by automatically filtering out irrelevant tests to run on a change list. I love that one. I love number two. And the third one is when used with extreme caution, obviously is getting a general sense for how testing is happening. Is there lots of some none and some trends, whether it's going up, if it's flat or if it's down. And he goes over some reasons why code coverage can't tell you how good your tests are, what's a terrible target, different kinds of coverage and some recommendations. So definitely a must read article and you could find it in the first comment down below. So another thing I know a lot of testers struggle with is how do I test audio or visual quality for say an iOS application? Well, sales labs just released some new functionality to actually help you do this and it goes over some use cases. Why this is important, especially with game development studios, media companies, educational institutions and entertainment platforms. So this feature is now just for native iOS apps, while support for native Android applications and Cross browser web testing will be launching later this year, so it's a good time to get your hands dirty and try this out for yourself. And it goes over some of these things that Sauce Labs audio output testing can help you with. Like you can hear your app sound in real time, you can verify whether your in app capabilities perform under various device conditions, you can validate the audio stream of a video embedded in your application, and you can verify that in app audio interactions work with certain elements are triggered in real time. And also goes over some things that it can help you with. Streaming testing and a bunch of other use cases that you may find helpful as well. So definitely some cool new features released by Sauce Labs and you can check that out in the first comment down below as well. So another company that released some new features this week that you also might find helpful is LambdaTest. So LambdaTest announced that they just launched Test analytics. So this functionality allows you to add custom widgets as well as custom dashboards to access more comprehensive views of your test execution. This release offers DevOps teams the ability to track the progress and quality of testing, spanning several Lambda Test product lines through personalized dashboards that aim to enable improved decision making. So if you're using Lambda Test, definitely some functionality that's going to aim to save you a bunch of time and definitely check it out. So want to know what the top 15 Continuous Automation Testing platforms are? Well, Diego from Forrester just released their 2012 Q4 wave evaluation and this report evaluated over 60 vendors and only 15 made it to the top based on the revenue, the infusion of AI and the top customer test case technology vendors think are mostly required by their customers and their customers as well. So if you saw my top 13 trends for 2023, I mentioned the rise of test management platforms and this is just some validation here. Diego also mentions that the biggest transition they've seen is a platform approach that offers the ideal environment for all types of testing and testers while integrating with a bunch of different other tools with great test experience through all the different phases of the software development lifecycle and DevOps, AI, Cloud, CICD and automation are all some of the top key features that they've identified in this report. One thing that really popped out out of this is that 72% of their customers claim that their enterprises prefer an integrated testing platform approach over best of breed tools that address different types of testing. So some of the top 15 that they identified and these, a lot of these are also sponsored Test Guild, our Excel queue, aplitools they have key sites here. Micro Focus, PowerSoft, Perfecto Software Sauce Lab, SmartBear, Tricentis. If you want to actually read the report. I don't have the report and the reason why is it costs $3,000. So what I would do is follow some of these companies because a lot of these companies that are featured in this report will give you more insight because because they have some of the information that's embedded in these reports because there are some of the vendors that were actually selected. So definitely to read what I have, you could find it in the first comments down below. So congratulations to all the Test Guild sponsors that actually made it in this year's Forrester Continuous Automation Testing Platforms report. So anyone that knows me knows I love hearing about new tools. So this next resource is by Ashish So Ashish Ashley reached out to me on LinkedIn and and told me that he's been associated with test automation for close to a decade now. He's worked with a wide variety of tools like Selenium to Playwright, TestComplete, Ranorex, but he always found that the tools really missed out on scriptless testing. So he linked to me a solution I believe he created called Cognizant Intelligent Test Scripter. And so this is an open source scriptless test automation solution that provides a unified interface for all day to day test automation activities such as test design, development, execution, reporting and maintenance. And he also created a video going over this tool and how you can use it to automate a bunch of different things. So thank you for this resource, Ashish. I haven't tried it myself, but if you have, you can try it out and let us know your thoughts in the comments down below. All right, not sure if you're sick of hearing about it yet, but this is a money segment on Chat GPT. How Microsoft is betting big on the creators of Chat GPT in a race to dominate AI. So in 2019 Microsoft invested 1 billion in open AI, which is the company that actually designed ChatGPT. And this year they're going to invest 2 billion more. And I've always said money is a key indicator when companies are pushing money, especially $3 billion worth. You need to pay attention to ChatGPT. I've seen a lot of posts where people just dismissing ChatGPT. I think ChatGPT is definitely going to be something to be seen more of, especially in the testing space. And Microsoft themselves said they plan on actually incorporating it. Microsoft plans to rapidly build and deploy new products based on this technology, so definitely a must read you should definitely check out. Also Next up, Performance Insight Reliability News so obviously more and more folks are using Kubernetes, so I found this other free resource to help you. As I said, I love tools and I think this might help you as well. So especially with Kubernetes. I'm not sure if I'm saying this correctly, but it says Commodore goes freemium. I never heard of Commodore before, so when I clicked on it to find out more what this tool does, it simplifies Kubernetes for developers, it helps you manage, observe and troubleshoot issues, and has Kubernetes expertise built in like Best practices for configuration Automated Troubleshooting Kubernetes Concepts explains out of the box alerting and it says it's supposed to be free forever, so you have nothing to lose by checking it out and see if it can help you with your kubernetes testing efforts as well. So this next article comes your way via Aron Kinsbruner. If you don't know, I have two big announcements. The first one is I was kind of shocked as Aron Kinsbruner, who's been one of the automation testing experts a lot of people have been following for years, has made the jump over to a different company called lightrunner, which is not an automation testing tool. If you don't know, lightrun is a developer observability platform. I've seen a lot of testers make this move from automation testing to these observability platforms that tend to fit in more with probably SRE type of situations. And this article is a guide to how to troubleshoot Java applications using dynamic instrumentation. And it goes into detail what traditional troubleshooting and debugging looks like, why the old way of doing it is costly for different reasons and an alternative approach using dynamic instrumentation and logging. And he actually has an example of how to do this using lightrun, which has a free trial that you can try out and goes step by step implementing it. So congratulations Iran for your new position and thank you for letting me know about this new resource and this new article. I'm sure we're going to learn a lot more about observability from you, so thank you for that and for links of everything of value we covered in this news episode. Head on over to Links in the first comment down below. And while you're there, make sure to check out our sponsor applitools free account offer and discover how to take your automation testing to the next level. Leveraging Visual AI so that's it for this episode of the Test Guild new show. I'm Joe. My mission is to help you succeed in creating end to end full stack pipeline automation awesomeness. As always, test everything and keep the good. Cheers.