How ChatGPT Impacts Automation, Performance, and Security Testing TGNS69
ChatGPT can write automation scripts for Playwright, Cypress, and Selenium, but testing practitioners warn it has real limitations. The episode covers how the tool helps with performance and security testing while exploring where it falls short.
Are you curious about the potential impact of OpenAI ChatGPT on automation performance and security testing? Tune into this episode of the Automation and DevSecOps news show for the week of December 11th. We'll explore the latest developments and discuss what this means for the future of testing.
So grab your favorite cup of coffee.
Or tea and join us for an informative and enlightened discussion.
That was actually written by ChatGPT. I probably would never use enlightened in a sentence, but there you go. Are you looking to take your automation project to the next level? Look no further than applitools and their visual AI validation testing. Trust me, it's a game changer. Plus you could try it for yourself by creating a free account. Just click the link in the comment below and see the difference for yourself. And while you're there, don't forget to like subscribe and get notified every time I release a new episode that also.
Was written by ChatGPT.
First up, automation News. So as you can tell, this could be a special edition pretty much focused on ChatGPT. It's been the rage all week. So let's go over some news items I found that cover this. I guess before we get into these news items it probably makes sense for me to describe what Chat GPT is. So I went to Chat GPT and it told me to explain itself to a beginner in a very pithy sentence. And this is what it told me. ChatGPT is a type of artificial intelligence language model that is trained to generate human like responses to text input. It can be used to automate conversational tasks such as responding to customer inquiries or generating personalized content. ChatGPT is unique in its ability to generate coherent and natural sounding responses, making it a powerful tool for many applications. And we're going to see how we can actually apply this to automation testing, performance testing and security testing in this episode. So this next article comes your way by Abeth Marshall on OpenAI three ways it can help Software testers. Let's check it out. All right, so I really like about this article. It's by a practicing tester so I think it's a good breakdown. Very fair on ways OpenAI can possibly assist you as a software tester. So Beth goes over how she came.
Across OpenAI the two camps she sees.
Folks in that she's seen online, which I agree with, shows how to get started what you can do as it applies to automation. This is really cool. She used it for Postman. Pretty neat section how you can use ChatGPT to research and even write content, use Codex to cross reference or draft test automation scripts. So really well thought out blog post. Thank you Beth for this and you could definitely check that out in the first comment down below. So I found a real detailed breakdown specific to chatgpt of a tester's experience using it with their thoughts. This is by Wayne, who's one of the must follows I have for really great insight around testing automation and he wrote GPT is pretty impressive and nobody said it was supposed to test code well, but he still had to check it out. And this document that he posted below actually has the results of his investigation and I love how he goes about first framing the problem. What he did.
The testing problem he put forth to ChatGPT.
Making the test code the raw transcript and asking it to test the code it wrote, which is pretty cool. Look at this, look at this document.
Really great detail.
So definitely check this out. Thank you Wayne for this resource because I think it's really going to help folks get some more insight into what ChatGPT can and cannot do. As I said, this has been all over the place and so this next article is also on ChatGPT, but it's the experience from James Bachelor. So he also documents his interaction with ChatGPT, the type of test that he ran, or type responses. He got back with the conclusion that he believes CHAT GPT is a dangerous technology that will hurt a lot of people.
So once again James take so I want to give you different perspectives to.
Try to get you to think and.
Check it out for yourself and I'd love to know what your thoughts are in the comments down below. And once again I highly recommend you follow folks like Jason Auburn. He's not only a tester but he knows AI. He had a company based on AI.
So he's one of the few people.
I think that actually really know testing and really know AI to know what it can and cannot do. He's posted so much on this that I just, just give him a shout out and let's check out his profile really quick to show you all the things he's been posting on ChatGPT.
So if you go to his activity you could see most of the things are all around ChatGPT, his experience with it, his thoughts on it, what he's done with it. And so I definitely recommend you check out Jason to really get a perspective from someone that really knows AI. So if you really want to take a deeper dive with the community of software testers, automation engineers on automation, AI, these type of topics you definitely want to check out. Automation Guild. We just opened up registration for the 7th annual ON online event. Dedicated 100% to helping you succeed with automation testing.
So I'll have a link to this. You should definitely check it out and register now for the 2023 event that's taking place February 6th to the 10th. And so how can I tie in ChatGPT with this? Well, what I did is all right.
So I went to ChatGPT, I told it to write a song about Automation.
Guild and a rap style copied these lyrics.
I went into Uber Duck, I pasted it in to text to synthesizer, I chose some rappers, I synthesized it.
It'S Eminem.
And then took these all together and.
Smashed them together to create this song.
Helping software testers succeed. That's what we boast. Great animation awesomeness. Our mission with tips and tricks.
Every single day.
I just thought that was a cool kind of application of ChatGPT that I was. I've been having a lot of fun with this myself, so definitely check that out as well. So this week you also should definitely check out a webinar going on by Applitools on Cypress, Playwright, Selenium and WebDriver let the engineers Speak series. So this webinar actually goes over how the experts use the different frameworks we mentioned in their day to day operations. So in this session they're going to ask the panel of experts to share why their teams chose Cypress, Playwright, Selenium and WebDriver, what factors went into the decisions and how their projects are going today. And if you really want to see coding from a head to head battle, all you need to do really is go into ChatGPT and type.
So I typed in write an automation testing script in Playwright that goes to test guild.com and enters the text automation.
And then it generates the Playwright script for me.
I also thought, hey, let's try this.
By adding the applitools Eyes SDK to.
The same exact script to verify some images. And once again it took that script that it already wrote and it just.
Inserted the code you would need for.
Applitools eyes as well.
And while I was at it, I just decided to do the same thing using Cypress. So it generated the Cypress script for me. I tried Selenium with Python, it generated that for me. And I also tried webdriver IO and it created that for me as well.
Next up, performance testing news. So this next article is performance testing Kafka using Gatling. I don't see a lot of resources in this area So I thought I'd share this with you. Dalical starts off by saying Gatling does not support load testing for Kafka applications out of the box and this can be an issue as Kafka is highly used which only increases the need to ensure the performance is succeeding. And despite Gatling not supporting Kafka, this article goes over how they still load tested it with the use of a plugin. Article goes step by step on the environment the plugin script example with some final notes. Speaking of Gatling, let's see how ChatGPT handles Gatling, how it would write an automated script using it.
So once again with the Chat GPT.
And I wrote write a Gatling performance test script for test guild.com.
Next up security testing news. And this goes over how ChatGPT is changing the way cybersecurity practitioners look at the potential of AI. So this article goes really into detail on some real potential and real limitations of this technology that you definitely should check out for yourself.
And then the ChatGPT actually wrote a.
Bunch of different issues that was wrong.
With the line of code I typed in here.
So as you can see, ChatGPT could be used for multiple different ways, especially with automation performance and security testing.
And for links of everything value we covered in this news episode. Head on over to links in the first comment down below. And while you're there make sure to check out our sponsor applitools free account offer and and discover how to take your automation testing to the next level. Leveraging Visual AI So that's it for this episode of the Test Guild News Show. I'm Joe. My mission is to help you succeed in creating end to end full stack automation awesomeness. As always, test everything and keep the good. Cheers.
More from JoeBot
Automation Testing Podcast 2026: New Schedule, Events, Discounts with Joe Colantonio
Automation Guild Kickoff, AWS Nova, Karate v2, and AI Testing Reality and more TGNS177