Testing Super Mario, Tesla TGNS23
JoeBot covers test automation funding, Netflix A/B testing guidance, and a fuzzer that found bugs in the original Super Mario game. Also: Tesla's app outage locked people out of their cars, and Google Cloud had widespread issues this week.
Want to know what Cypress Test Studio is all about? What car companies crash servers actually cause car owners to be unable to open their vehicle doors? And how can you use Fuzz testing with the Mario Brothers? Find out the answers to these and all other end to end full pipeline DevOps automation testing, performance Testing and security testing in this episode of the Test Guild News show for the week of November 21st. So grab your favorite cup of coffee or tea and let's do this. This episode of the Test Guild new show is sponsored by the awesome folks at applitools and applitools is the next generation test automation platform powered by visual AI which helps you increase quality, accelerate delivery and reduce costs with the world's most intelligent test automation platform. But I understand seeing is believing. So create your free account now by clicking on the link in the comments down below. And while you're there, why not like leave a comment and subscribe to get alerted every time I release a new episode. First up, Automation News all right, let's kick it off with a money segment. Show me the money here. Mable actually nabs 40 million in their latest Round of Funding so this news item actually came my way via LinkedIn from Brittle where I first saw the mention of Mable getting this next round of funding. This article just dives into some of the reasons why more and more companies are investing in AI low code type of solutions. Just an interesting read and finding out a little bit more why it seems to be such a hot space right now in testing for companies getting more and more funding. So definitely check that out in the links down below. So the next article that caught my attention was Interpreting AB Results, False Negatives and the Power at Netflix. Alright, so I missed this a few weeks ago and it's a four part series and it talks about how Netflix uses AB test to inform decisions and continuously innovate on their products. And they define the two types of mistakes that can occur when interpreting test results, false positives and false negatives. So if you wanted to learn how to do the same, definitely check out that article as well. So over the past month or so you've probably been hearing a lot about the Metaverse, but how about the Octaverse? And that's where GitHub's State of the Octaverse 2021 report highlights trends and predicts good practices. I think it's a really good read. So they researched and highlighted some major trends and the three main ones that they brought up were really writing and shipping code faster, creating documentation and supporting developer communities and One of the key areas they actually call out is automation when they say automation is especially important for larger organizations with a direct effect on the number of merge PRs per day. So interesting to see a report that you wouldn't normally think of being automation testing or automation focus actually highlight the importance of automation. So speaking of developers and tools, another tool that a lot of developers tell me they enjoy using is Cypress. So have you tried or even seen Cypress's new experimental feature called Cypress Studio? So one of my favorite Cypress ambassadors, Marie Drake, actually highlights some of the experimental features of Cypress Studio in her latest blog post. So if you don't know Cypress Studio lets you write test automation with a minimum amount of coding by recording interactions to the application under tests. So if you've been doing automation for any amount of time, think of tools like back in the day Windrunner or QTP or even Selenium ide. And so this is a similar function. So Marie takes it through its paces to see how well it actually picks up the different recordings. How to write a test So a nice quick overview of the power of Cypress and how they keep iterating on it to make it even better and better. And this is a solution I'm sure, or a feature a lot of people have been asking for for a while. So give it a try and let me know what you think. So thank you Marie for that. So this actually brought me down the rabbit hole of another Cypress blog post that came my way through Philip on auto completion selection in Cypress using TypeScript and this blog post goes into detail on how to create custom commands that will auto complete your selectors, how to perform a check on your tests that are written in TypeScript, how to grep selections with your app and how and also how to create warnings if there are selectors in your app that you are not using. So really help logical around Cyprus as well. So thank you Philip for that also. And I'm not sure if you heard but applitools test automation university just reached over 100,000 members and to celebrate they're actually putting on a free event the week of December first week of December 1st to the 2nd if you haven't already definitely check it out. Check out the speakers and register for free to get a lot of free content to help celebrate this awesome educational tool provided by applitools and Angie Jones. So thank you Applitools and Angie Jones for this awesome innovation. Next up, performance and site reliability news. Now this first article is kind of chilling and it's how some Tesla Owners were unable to unlock their car darts due to server errors. In the article just details how some owners worldwide were unable to unlock or communicate with their cars using the app due to an outage of the company's servers and the outage prevented owners from using the app to get into the car and it reports an incorrect location of the car. Obviously Tesla says they're looking into matter but just something to keep an eye on and to think about as we're developing software and something you may not have thought about as an edge case as you were testing software, but definitely something you need to be aware of with these type of technologies. How do they fail over if there's a server error, which I think is a perfect opportunity for server liability engineers to get involved in this type of testing. And as I was looking into the Tesla server issue I also came across an article post on LinkedIn about Google not found error with their outage with their cloud servers and this was pointed out by the co founder of Catchpoint who actually pointed to a great review of this outage that talks a little bit more about this incident review of Google's cloud outage having widespread downstream impact on companies. And it's just a really great breakdown of the era, what happened and some key lessons you can find to help you hopefully avoid these type of issues in the future. And the next article I came across on LinkedIn is Get Planet Scale Monitoring with Managed service from Prometheus. So this is from E. Polin who's been posting a lot of great information around this content around cloud based performance scenarios reliability. So definitely give her a follow. It's I've been following a lot of great articles on posts that she does pretty much daily and a really great article that she posted here about introducing Google Cloud managed services for Prometheus. If you don't know, Prometheus is the de facto standard for kubernetes monitoring and works well with many basic deployments. And this goes into detail about Google's cloud managed services for Prometheus that's currently in preview. It's really touted as an easy to use service with open source interfaces and it also goes into detail how customers are already seeing success using this preview. So definitely check it out and let me know what you think. Next up security news. So last week or the week before we talked about fuzzing. So here's a great article on how to use Burp Suite to fuzz web apps to find bugs and it's a really detailed article on using Burp Suite for a number of purposes to test, evaluate and hack web applications. The this particular one goes over fuzzing and the process for sending random or pseudo random data into an application with the intent of crashing the application and thereby identifying vulnerabilities. And like I said, it goes into step by step how to set burp suite for this exact scenario. So if you ever want to get involved with fuzz testing or learning it step by step, this is a great article to get started with. So if that didn't get you excited about fuzz testing, I think this next article will and this is a Twitter thread by Sarah Jamie Lewis, who actually created a NES game Fuzzer and she did a really lot of cool stuff that used the Fuzzer to actually find issues with different games like Mario Brothers. So Jamie's doing a lot of cool stuff with this, messing around, getting it to work with different games and finding a lot of different issues. So thank you Sarah for that and something I definitely want to try out now. Hopefully Sarah will have a blog post on this or a video tutorial how she did this because it seems really, really cool. But you can definitely check it out in the Twitter thread, which I'll have in the links down below. And I also came across a new tool I never heard of before which is now Secure, which Now has a GitHub Actions that helps devs easily test mobile app security, which is a big growing field as we get into the new year. This goes over a solution by now Secure that enables mobile app security testing directly inside GitHub workflows for developer first security. So one thing I've learned over the years is that to get developers involved in testing it's critical you have tools that actually integrate into the testers or the developer's ecosystem so that they don't have context. Switching going back and forth between all these tools is actually baked into their workflow and using tools like this actually makes it better for them or easier for them to get the work done that needs to be done before we ship things to our developers. So definitely a solution. You should check out in the links down below and for links of everything of value we covered in this news episode. Head on over to links in the first comment down below. And while you're there, make sure to check out our awesome sponsor applitools free account offer and discover how to take your automation testing to the next level using an awesome visual AI solution. So that's it for this episode of the Test Guild News Show. I'm Joe and my mission is to help you succeed with creating full stack end to end pipeline automation awesomeness. As always, test everything and keep the good Cheers.
More from JoeBot
Automation Testing Podcast 2026: New Schedule, Events, Discounts with Joe Colantonio
Automation Guild Kickoff, AWS Nova, Karate v2, and AI Testing Reality and more TGNS177