4 Free TestGuild Tools Every Tester Should Be Using with Joe Colantonio

In a land of testers far and widely journey seeking answers, seeking skills, seeking a better way O the Test Illinovation Testing Podcast Guiding testers with our nation awesomeness. From ancient realms to modern days, they lead the way. Oh, the Testicle Ocean Testing Podcast.

Hey, it's Joe. And welcome to another episode of the Test Guild Automation Podcast. And today you're in for a special treat. If you don't know, over the years I've interviewed hundreds of experts and one thing kept coming up that is testers need practical bias free tools to make better automation decisions fast. And AI is making this even harder to do. And that's why I started building a suite of free test skill tools created for testers by testers.

So today I'm going to show you.

Four free tools you can use right now to level up your testing game. From choosing the right automation framework to scanning your site for accessibility issues. And all free. So let's check it out. Hey, before we get into it, all my automation testing heroes, we're officially gearing up for the 10th annual Automation Guild Online Conference. I can't believe how fast time goes. This is our biggest, most epic, epic event yet. Early bird registration is now open for our waitlist members and tickets are moving fast. If you were on that wait list, make sure to check your inbox and grab your spot at the lowest price of the year. Not on the list yet. Don't worry, we got you covered. You can still get priority access for the next release using that link down below. Register now. Hope to see you there. Oh, and by the way, this year's theme is Back to the Tester, celebrating a decade of helping testers level up their automation skills and career. Don't miss out. The early bird window closes soon. All right, so you may be asking, hey Joe, why did you build these tools? Well, the goal behind these tools is really simple. I really want to make everything we've learned as a community and turn it into something you can actually use. Whether you're building an automation strategy, auditing your current process, or just trying to get your boss on board, these tools give you the data and direction without the fluff. And what's great about it is if you have any issues, you want some new features, or if there's a tool you like me to develop, you can just let me know by sending me an email@joetestgill.com I love to make these even better. You know, these have been around for a month or so, and I'm just curious why more people aren't using them. So your feedback would be really helpful. All right. Our first tool is what I'm calling the test Skill tool Matcher. It lets you find the right testing tool in minutes, not days. I get asked all the time, Joe. There's so many tools, I don't know which tool matches my need. Because as you know, not every tool is made specifically for every team. What's good for one team may not be good for another. So that's why I created this. If you've ever spent hours maybe comparing Selenium against Playwright, Cypress, TestComplete or any of the other new AI based tools.

That are out there, you know how overwhelming it gets.

So the tool Matcher helps you cut through that noise. You just answer a few simple questions like, you know, type of testing, is it performance or functional testing? Security testing, your language preference, which is optional. So say you just wanted tools that support, say Playwright, Budget and Main Goal and then click. It will recommend tools that actually fit your user case. So let's take a quick look in this quick demo.

All right, there are multiple things you could do with this tool. The first one is to find a tool that matches your needs. So let's just keep it simple. Let's select test Automation. Now we just want to test web browsers. So select web applications. Also select multiple of these. So you could do web applications and API. It'll try to match tools that match both those criteria. Let's just stick with web application. Let's do free and for advanced, let's do, I don't know, let's do Python. Right? It has seven matches. Now there's multiple things you could do. You could select three of these. So let's just do the top three.

Let's do compare. It'll compare the two. You can visit the website or you can actually have this information sent to via email. Or if you want to learn more about a tool, you can just click on it itself. It'll bring up its dedicated page, it has reviews. Reviews will show if you want to write a review. You can write a review. That'd be awesome. Highly recommend you write a review. If it's one of your favorite tools.

It'Ll show limitations. Pros, cons, resources may be associated with it. So I actually interviewed the founder of this tool. So if you click on that, that'll bring you directly to that resource to do to see even more information. And there's multiple things you could do. You can also upload a tool, click on learn more to see it. In this particular view, you see the Platforms that are supported, the languages, the pricing. Also, if it has an MCP server, you'll see an MCP Server button. Click on that MCP server will take you directly to its MCP server as well. Another thing you can do is say you already have a tool in mind. You could just go to the Test Tool Matcher and just type in, I don't know, let's say browser stack. I don't say accessibility testing. Those will bring up their tool directly so you can look up any specific tool that you might have in mind to see to go to their dedicated page as well.

And the cool part? It is vendor neutral. No marketing bias, no paid placement, just real matches based on functionality and purpose. And because I have over 600 episodes on many of these tools and many people that recommend some of these tools, I actually have them added as resources as well. So if you find a tool and you're like, all right, how do I get started? A lot of times I have either a course or a podcast I have associated with that tool within the tool Matcher that you can go to right away to get up to speed quickly. So instead of say, scrolling through a bunch of Reddit threads or asking intense slack channels, all you need to do is click on the link down below for the Test Tool Matcher and find the right fit instantly. Or if you're on the website, just go to our test skill.com page, click on Tools and select it from the dropdown. All right, tool number two is our test risk calculator. Well, what is it? Well, it helps you spot testing risk before they become failures. This one's especially useful for leaders and managers when you're planning. So the risk calculator helps you identify where your biggest testing blind spots are. This will help you prioritize what matters most in your testing strategy. And it also comes with AI powered recommendations based on real world risk factors. So no spreadsheet, no guesswork. It creates a matrix of things that are important or helps you actually rank what you should focus your testing on based on what you mentioned are your biggest risk areas. And it's also a great way to prioritize what to fix next or to communicate risk to leadership. And I know that testers that have used this love this one because it gives them the way to quantify what they already know that risk isn't evenly spread across your pipeline. You can have AI generate thousands of tests, but they don't matter if they don't actually address the risky part of your application. And this actually uses your brain to actually walk through different scenarios with you and your team as you map these different risk and different features to see which ones are the ones you definitely should focus in on on this latest Sprint or the latest release that you're working on. So let's check this out. It was actually inspired by an Automation Guild online conference session by the one and only Bob Cruz.

Right, so here's the risk calculator if you want to learn more about the strategy. I actually uploaded the video of Bob Cruz explaining it in his full Automation Guild session that talks about what it is, how it works, how to create really good risk analysis. But this is basically based on what he talked about in that full session. You give it the name of a module that you working on. So let's just say, right, so here I'm gonna do like webinar because I have a webinar piece of my application and I want to do registration.

Obviously for me, if someone can't register, catastrophic, right? What's the point of having webinars? People can't register. And then you can measure the complexity. It's actually kind of low to register for a webinar. Frequency of use, very high. A new functionality. We haven't had any new functionality, so I'll put low. They'll give it a probability score based on this formula. Click Add component and then you do this for all your other components in your particular release that you're working on. So say I want to do another one. Once again, it's the same area, but this one, let's say I want to do a ridge report.

If I can't generate a registration report, you know, it's not ideal.

But people could still register. So I'll say high impact.

Complexity once again, low. Frequency of use low. New functionality low. Once again, it gives it a probability score out the component. And you keep doing this for all the particular features that you're working on. And rather than do this yourself, I highly recommend you get your whole team together to create those metrics.

And then once you have all your.

Components listed, you can click on AI Report and just enter in information.

This is my alter ego, Joey Gabago. At Testing Mafia. You can download the PDF and it allows you to generate an AI testing plan as well. This report is only as good as the information you put in for your risk analysis. So this will give you a high level executive summary where your test plan should be, how many hours it could possibly take. And as I mentioned, this is just in kind of beta, so let me know how well it generated this report for you, but I think that's a great start for you to start thinking about risk in your application and actually getting your team involved to help you identify that risk as well.

All right, tool number three is our Accessibility Scanner, and this is one of my personal favorites. As you know, accessibility is everyone's responsibility, but most teams don't have time or budget for big audits or as an automation engineer, you don't necessarily know where to focus in your efforts or what code to use actually validate some of these issues. And that's what's unique about this scan. It's created specifically for automation. Test engineers let you get screenshots, plain English explanations, ownership tags, and ready to use test code. Read the Selenium, Cypress or Playwright, and obviously the test Guild Accessibility Scanner is free, no login required. You just paste your URL and it runs a quick check based on accessibility best practices. So things like alt, text, area roles, contrast ratios, and more. So think of it as almost like a smoke test for accessibility. If you haven't done any accessibility, this is step one that you should be doing for sure. So once you do that, you'll get a report that helps you catch common issues early before they possibly could end up costing you compliance fines or user trusts. Plus, I think it's a great tool to use as a conversation starter to bring accessibility awareness into your sprints. Sounds cool, right?

Right.

Let's check this out.

All right. For the Accessibility Scanner, all you need to do is enter in your website. Let's do, I don't know, let's do ESPN.

You check the type of validation I want to WCAG 2.2. Start your scan. This could take a little bit. I added some quotes to help pass the time.

All right, scan is done. First thing is you can either do developer mode or non developer mode. It just makes it simple to read. I keep it on developer mode. You can also do different views. You have a classic view, it'll tell you what that means.

Or you could do a navigation cards, which I like better, gives you more information or smart grouping, where it takes all the elements and puts them in a different kind of view here. So let's just do navigation cards. Keep it on developer mode. So first thing is it gives you a guild score, just a score you can use over time to see if it's getting better or worse. Shows a screenshot you can actually click into zoom. Then I'll show you the site that was scanned.

Show you how many critical errors, how many serious issues, how many total issues. What I think is cool is so it has a critical thing and explains what it means.

Why it matters. Right? So it kind of breaks things down into plain English. Also, who fixes it? A lot of times people don't know, all right, I found the issue, but who fixes it? It tells you web developer, designer and testers also how to fix, gives you some suggestions on how to fix.

And if you're using a particular tool like Cypress or say, Selenium, it'll give you the code to use to actually put into your particular framework to actually fix that or check that particular issue. It also links out to what the WCAG issue is. And what I really like is you.

Can actually highlight on the screen where.

The issue is located. As you can see, it highlights these particular icons, these frames, so it'll show you where the issue is as well visually, which I think is really helpful because a lot of times you may not know. Like I said, this is a great way to just do a simple scan right off the bat, see how you're doing it, and actually track it over time, using this score just to gauge if it's getting better or worse for your team. If you have any issues with this, like I said, this is in beta. Just give me some feedback. I would love to know how you rate it, if it was helpful, and what I could do better at, and what would make it better.

All right.

Our fourth tool is the Automation Accessibility quiz. So this applies to automation or AI in general. It helps you discover your team's automation maturity. If your team's not ready for automation, it's not going to be ready for AI either. And this quiz is for anyone wondering where does our automation really stand? So you'll answer questions about your automation coverage, test design, collaboration, CI CD integration, and AI adoption. At the end, you'll get an automated maturity score and suggestions to move up to the next level. Once again, this is based on over 600 interviews I've had with testers over the years. So based on what they tell me are the biggest indicators they've seen for success with automation, I bake that into this tool and many testers tell me it's an eye opener. They realize they're further along than they thought or they finally see what's holding them back. All right, let's check it out.

All right. For the automation assessment, all you need to do is go to start the quick assessment.

It'll ask you some major questions. First one is maintainability, how you rate yourself. You could select a rating, and if you're not sure how you rate yourself what a three means. It tells you exactly what it means. To see if it's exactly how you should rate yourself or not, let's give us a 3. For maintainability relevant to the business, do scan 3 partial alignment. Once again, if you don't know what it means, just click on what it means. It'll tell you.

And these main areas are the main areas.

I've heard over 600 episodes, so that's why they're included in the quiz. Let's do a five. Clear traceability, reusability. Probably a two.

Manageable and scalable. Let's do a three once again. You can use this over time to see if your team's getting better or worse with their efforts.

All right, It'll generate a score 19.

Out of 30, and it'll show you your overall score and what areas you need to improve more on. It'll send you an email. And in that email I have a Automation Scorecard playbook. And this playbook will contain different areas from the quiz as well as what you could do to improve your score.

All right, so those are the top four tools I've created so far that I think you should definitely check out. You may be asking, what ties all these tools together? Well, it's one idea helping you make smarter decisions faster, all based on community input without the need to buy a fancy enterprise solution. Each tool is designed to give you a snapshot of your testing health, whether it's a technical fit, risk, exposure, accessibility or overall maturity. And as I keep mentioning, I plan to keep adding more tools built by testers for testers. So I would love to have your input on these existing tools or suggestions for new tools that I can create for you. And if you want to try any of these tools, all you need to do is head on over to test skill.com and click on the Tools menu item or use that special link down below. Try one today. It's 100% free and I love to hear what insights you get. And if you're watching on YouTube, hit like and subscribe for more content on testing, automation and AI. And if you're listening on the podcast, make sure to share this episode with your team. And let's help more testers work smarter, not harder. And as always, test everything and keep the good cheers.