Playwright Vs JMeter, 3 Automation Questions You need To Know and More TGNS119

Do you know what the three pivotal questions are to ask when assessing your automation strategy? What is the Open Close principle and how is it applied to software testing? And why would you ever compare Playwright vs Jmeter? Find out in this episode of the Test Skill News show for the week of May 5th. So grab your favorite cup of coffee or tea and let's do this. First up is what is the Open Close principle in software testing? Let's check it out. This is part of a series that Kristin Giacovone has been working on, and this one is all about the Open Close principle, which is a key concept in the solid principles of software development tailored specifically for testers. And she goes into detail why this concept is vital for maintaining the stability of systems while allowing for the evolution and scalability of your testing frameworks in this blog uses a practical example, evolving a logging class commonly used for testers for automating login functionality. Initially, the class accepts a username and password enabling automated login. However, when a new feature involving a challenge question is introduced, modifying the original class directly would disrupt existing tests that rely on it. And to address this, an extended class login with challenges created which incorporates the new feature without altering the original class, demonstrating adherence to the Open Close principle. So why should you care? While adopting the Open Close principle can significantly reduce the risk of disrupting existing or automated tests when new features are integrated, it also encourages a more sustainable and manageable approach to developing and maintaining your test automation frameworks. So definitely should definitely check out and you can find it in the links down below. All right, I found this next news article by scrolling through my LinkedIn feed where I saw that Brad Johnson posted an article talking about a new generative AI powered assistant for businesses and developers. And it's all about Amazon Web Services has officially launched Amazon Q with which is a generative AI assistant aimed to improving productivity and software development and business operations. And the reason why I bring this up is because Amazon Q enables highly accurate code generation, testing, debugging and implementation based on developers inputs. It also facilitates access to business data such as company policies, product information, business results by connecting to enterprise data repositories for summarization, trend analysis and dialogue. So definitely something you should be aware of. You could check it out, you can, and let me know your thoughts. And Paul Grzaffi is back in the news with another rocking blog post. Let's check it out. So in this recent blog post on responsible automation, Paul Grisaffi, an expert in automation and testing, shares insights derived from his multiple years of experience in consulting and practice and test automation across a bunch of different organization. Paul suggests three pivotal questions to guide companies in assessing the automation strategies. What are they? The first one is do I have the right automation? Second one is do I need more automation? And third is Do I have too much automation? These questions help determine whether your existing automation aligns with your business goals, and whether additional automation could enhance efficiency, and whether current automation levels exceed the value that they provide. So definitely a must read and you can find it in the links down below. And thank you Paul for the shout out. Okay, so this next news article isn't really news, but it's news to me. What do I mean? Let's check it out. I actually went to Star east last week and I got to meet Stacy Kirk face to face for the first time and she showed me a bunch of free tools her company offers that you could check out for free. And as you can tell there are three different tools here. The first one is Rapid test case generation. The other one is Creating UI test automation code which helps you streamline the process of your test automation code generation. They also have a Create API test automation code and they also have ask your test automation expert. So I saw a quick demo and I played around with these really quickly, but I think it's something that will give you some benefit. So let me know. Check it out yourself in the comments and let me know which free AI tool you like the best. So once again going through my LinkedIn feed I came across another LLM that I think you need to be aware of and this article was posted by Umesh who pointed to how Snowflake has unveiled a new language model called Snowflake Arctic and this was designed for enterprise use with remarkable cost efficiency and openness. Developed by Snowflake's AI research team, Arctic is set to help you transform how business deploy large language models by significantly reducing the financial and computational burden typically associated with such technologies. And this particular LLM excels in executing complex tasks such as SQL generation, coding and following detailed instructions. And according to them, it outperforms other models that have been trained with much higher budgets. And what's even better, this model is fully open Source under the Apache 2 license providing unrestricted access. So what's in it for you? Well, it's a good opportunity for you to learn from an open source community, expand your skillset in areas like the MOE architecture it goes over and enterprise focused AI applications and it also can help you enhance your job prospect for growth as demand increases for skills in testing sophisticated, cost effective AI solutions within enterprise environments. Definitely a must check out and you can find it down below. Also, a few days ago Hassie just announced that Artillery I.O. has announced the official launch of Artillery Cloud, now out of beta and available for general use. So what is Artillery Cloud? Let's check it out. Artillery Cloud is designed for teams conducting continuous load testing, which provides advanced tools for visualization and analyzing results. And this platform helps users make sense of extensive raw data from load tests, identifying and resolving performance bottlenecks, and keeping external stakeholders updated on testing progress. And also, Artillery Cloud includes features such as summarizing reports of key performance metrics, custom charts and dashboards for application specific metrics, and options for annotating and sharing test results. It also supports Playwright for browser performance metrics and user experience visualizations, enhancing the utility of load testing and real world scenarios. Also, Grafana Labs has made a big announcement and this was announced on Leandro Melendez's LinkedIn senior performo all about how Grafana Cloud synthetic monitoring services introduces new capabilities that enable more complex and realistic simulations of user interactions with applications. And so the post goes into detail how this update features the introduction of multi HTTP and scripted checks powered the K6 performance testing tool, and this allows developers, platform engineers and site reliability engineers to create detailed multi step simulations that mimic actual user journeys, ensuring that applications perform reliably under different varied conditions. Previously, Grafana Cloud synthetic Monitoring utilized the Prometheus black box exporter for basic protocol tests. This new integration with K6 expands the the scope to include advanced scripting and multi step testing, providing deeper insights and more robust monitoring of user experiences. It also has the ability to define detailed assertions for each step of the user journey, where testers can pinpoint issues more precisely, leading to quicker problem resolutions. And it's definitely you should check out and let me know your thoughts in the comments down below. Also, octoperf just posted a link to a blog post they wrote I believe last month on how playwright compares to JMeter. What does it all mean? Let's check it out. And as you know, Playwright is known for its end to end testing capabilities that automate real browser actions and presents an alternative to JMeter, which generates virtual users based on a protocol. And while JMETER captures every request generated by the browser and reproduces those to simulate load, Playwright operates by actually launching a browser and executing user actions. And the comparison reveals that though Playwright offers a more realistic user interaction by incorporating actual browser responses, it requires significantly more system resources. But conversely, JMeter, though less intensive on resources as you know, involves complex script management, including handling dynamic parameters like token correlation manually. But this article summarized that despite the higher resource demands, the benefits of using Playwright could outweigh the costs, particularly for specific testing scenarios where user experience and interface interactions are critical. However, combining the strength of both Playwright and JMETER could be a strategic approach, allowing testers to leverage the realism, maybe browser based testing while managing the bulk of the load with protocol based views. Actually, I'll be honest, this is nothing new. I was doing this in 2000 with Windrunner as a GUI v user, running it from within Loadrunner, using both the LoadRunner protocol and WinRunner to get the real user experience. So it's good to see that these tools are finally catching up almost 25 years later. And if using Playwright or JMeter just definitely you should definitely check out and lastly in Security News, all about how Oasis Security, a leader in non human identity management and him secured 35 million extension to its Series A funding and this platform also offers real time analysis on how non human identities are used, assisting operations in identifying security risk and facilitating quick remediation through automated responses and prioritization. All right, and for links of everything of value we covered in this news episode, head on over to the links in the comments down below. So that's it for this episode of the Test Skill News Show. I'm Joe. My mission is help you succeed in creating end to end full stack, full pipeline automation awesomeness. As always, test everything and keep the good. Cheers.