logo

NJP

Getting started with Automated Test Framework: ATF Walkthrough #1

Import · Apr 04, 2024 · video

hi everyone my name isini and the Senor outbound product manager for Alm and ATF and um we have Amanda here you introduce yourself yes no problem hello everyone my name is Amanda SS and I'm a technical consultant under impact specifically on the technical accelerators at scale team um so what my team does we actually provide a service where we help enable customers in specific products of Interest awesome so um guys the the whole point of this is to actually give you like um a work through um so what we doing we'll doing a series where we do work through based on the family release on things that have changed within our product like ATF and some other products but for this now we're starting with ATF and we're doing getting started with ATF like what you need to know about ATF and we're going to do a couple of demos so um we're going to go right onto it right so um before we get started we also want to let you know about the safe AB notice um every s we talk about we hope might change like it might change but we don't want you to make purchase or any buying decision based on what we're going to discuss today so we're going to cover the following we're going to cover understanding ATF we're also cover the ATF Basics and also demonstration then a couple of umly asked questions that we add from customers like you so um first get started so the basic thing know about ACF is the fact that it helps you create and run automated test to confirm that your instance box have to making a change and this is basic Al saying okay you can actually do regression testing and also functional testing are things at can help you do so um be usually advise your customers that PRI on upgrade we expect that you run your ATF test and after the upgrade you also run the ATF test so those two test results you actually confirm or check um how far your instance has regressed if that the case or if your modifications are still um intact and okay then um we also want you to know some of the things ATF does not support at the moment right now we would say ATF is not an ENT solution for limited testing also we Al also want to say um there's limited UI testing support within ATF and also ATF is not suitable for mobile testing so you can use it for um to test your mobile applications then so there are three basic roles within ATF the first one being the test designer and we see this test designer Persona as someone who is low code or no code where team M actually can create and run test so this person is actually familiar with the service now um platform itself and this is one of the most common um roles on any service n project we also expect that particular test designer should be able to do some level of debugging um which might require Advan level of ATF so we expect that this person even though they are no code or low code should be um very knowledgeable in service now then the next one is the fact that um most application Developers assign this Ro due to test important to doe due to need to test important customization so you would see folks like um web service test we're going to talk about later having the rules of a test designer because it'sit the test designer so the next one is the test administrator so this is a pro code where all anyone assigned with this rule can actually manage system the ATF system properties and actually set appropriate um um features or appropriate proposes on it they are required to actually maintain client rers so let's say for example you're trying to set up an ESS server um the test administrator would be the one to actually help you do that or let's say you want to switch from an endless server to using um new sorry not new OP Cloud feature the test administrator will be the one that actually help you do all this then um they also tax defining the test result retention policy so how long you want to keep the test is it 30 days is it 60 days or is it a year so this um the test administrator are responsible for doing that the next one is they also tax to creating new Step configurations so um in later video we're going talk about how to create test and we're going also touch point on test step configurations so the test administrators are the ones that have the um roles to actually create those new test config that the case may be the third person within ATM or the RO would be the web service tester now this is also another Pro code Ro that actually provide access to web service modu test um so the whole point of this guys is that if you are trying to create new script or if you're trying to do Ser side testing this is where you have your web service tested these guys are pro and they can actually perform the role of a test admin and test designer but they are mainly taxed with building web service test for your ATF test so we're going move on to the next slide now so what's the purpose of ATF um the first one being trying to improve automation coverage we're trying to help you automate your test across all customer customer like if you are if you have made modifications to your um service applications as long as you have ATF you should be able to test some of these mod modifications the next one is we're trying to increase delivery um you want you to test as much as possible and actually get the results you you want or the result that reflect what you have in your test or what you have in your instance um we are also trying to reduce effects found in Pro so which is why we always advise that customers should do their ATF test in subro a sub prod instance with this can reduce the number of customer effects or customizations you might have so um these are some of the things you can do with ATF this is not an exhaustive list um the first one being you can create test you can Shadle test you can also use what we call Quick Start test or quick start suit so this quick start test uh more like a predefined set of templates that we have our beer business un needs um generate once um we have new applications so we have various quick start test for itm or um HRS and like so you can actually help this this can actually help you kickart your ATF Journey the next one is parameter parameterized test as it name implies it means you can actually use um variables or specify inputs for your test the next one is ATF Administration so special place where you can actually go to set properties of your ATF test or ATF um framework the next one is also text execution we have various ways you can execute your test you can run them on your client your client device which is your your your browser you can also um configure an headless browser then the next one being you being that you can actually use uh Cloud R which ensures that you can actually run your test on our own service now infrastructure what is the typical recommended site when using ATF the first one is create an ATF test the next is for you to R run the test um upgrade your instance run the test again just compare the result and that's a cycle that goes on till you have a new family release um so I I think now um after now that I've gone through um the basics of ATF we are going to do a demo and am that will take us through some of the things we just discussed nice so I'm going to share my screen one second okay so I have a demo instance here and um the first thing that I will do is kind of walk you through the ATF testing framework um application through some of the some basic definitions on the modules and the different components of that and then we will click into some of these modules and kind of demo the things that were just previously presented um so we have this first section here in order to find the ATF module you would just need to type um automated test framework in your filter Navigator this should be already installed in your instance but of course if you don't see it for any reason you would be able to find that in the plugins or the service now store um but to start with that this first groups of um selections are just more related to the tests that you have in your instance so we have the test module itself this would contain all the outof boox quick start tests as well as any custom test that you decide to build we have the Suites this is like a collection of tests that are all packaged together so later on I will kind of Click into this and show you the different types of options that we have um quick start Suites this is specifically um service now quickart Suites so the difference between sweets and quick start sweets um this one will be a mixture of service now and things that you've made well this one will just strictly be service Nows um we have the test results as well as parameterized testing results a couple of Mo modules down here for you to kind of review the results that you have once those tests are executed um and the schedule so that you're able to not only schedule your test but also monitor the the types of schedules that you currently have manual paid inspector as well I believe we'll cover this a little bit more deeper in one of the other slides but this is just a way for you to kind of check the components um and ensure that those are testable within ATF um the next collection is more based on that actual execution itself so the run and we've already talked about it a little bit but there are a couple of different ways that you can actually run your test one of those being the client test Runner and this allows you to see specifically the UI based actions actually execute um so you're kind of able to manage those with some of the modules that you see here and then last we have the administration side of that so you'll be able to set up the properties kind of configure how you want ATF to run and execute um we have step configurations and step environments so this is more related to the actual act actions that are being executed within the test um test templates and things of that sort you can kind of set that up if you do have those administrative roles um to to execute in your instance so the first thing that I will click on is the properties um so this is the first thing I recommend to set up before you even start creating or executing any test um so I will click here to kind of get in that scope one second um but the first thing that you will need to do especially um on any ver sub production instances is enable that test execution to run um so like it was mentioned earlier we don't want you to run any test on production um so although ATF test the data does get automatically rolled out or rolled back my apologies um if there's any instance where let's say for example your computer crashes and it's not able to get to that roll back step you might make real changes in your production is instance and maybe you might not be able to trace the type of changes that were made so that's why we recommend to kind of just eliminate that risk Al together and um just disable that in production instance and enable it in any of your sub production instances to run so there's a lot of properties in this section I definitely recommend for the um administrative test testers to kind of go through these and configure that but I'll highlight some of the key ones that I like to configure when I'm um configuring this property section so we'll do these screenshots um as far as the options that we have we have enabled for all steps failed steps or completely disable them um so I recommend to kind of have that enabled for failed steps just because um it can kind of take it can increase the time that it takes for your test to run um but for but some of the use cases or some of these other options are if you want to enable for all steps this is good for the kind of initial um stage when you're first building out your ATF test and you want to kind of make sure that everything's okay but once you have that built out um I would say it's pretty safe to kind of enabl that for failed steps and get those screenshot notifications um just to when something is wrong another thing that I do like to enable is this one right here this Glide screenshot feature um so this is really important for um ATF test on workspaces Portals or just other you um interfaces that are outside of the classic view um so the first time that I started to build ATF test I started doing portal side testing specifically on employee Center um and I was always confused like why am my screenshots blank but definitely it's because of this property here so once you do that then you'll sort to see everything and again there's a couple of other properties but those three are the main um important ones for me so if you're doing some of these other types of testing email um UI and things of that sort I definitely recommend to take a look at these and there are explanations for every single property so that you kind of know what happens and and what these are exactly for yeah I suppose that yes so then the next one that I will go into are the tests um like I mentioned earlier this consists of all of the out of box test as well as the ones that you have um so the way that you can typically tell if there are an out of box test is that they usually are named by applications so a lot of the ones that you see here um or the out of box test um and I will click into one of these just so you can kind of see an example um but the purpose of these is to kind of use this as either a template maybe you can make a copy of it build upon and kind of customize it to fit your specific business need or if you're not really um that much customized in your instance you can kind of run this see um how well that it runs but one thing to keep in mind all of these have a readon protection policy um so in order to actually use these you need to um copy that test and then from there on you're able to kind of reuse it and kind of reconfigure those steps to best fit your needs um another thing to mention all of these um out of box quit start tests it comes with something called demo data um and this is just actually an example is what I like to see it as is it's an example of how to kind of configure and use these steps um so one thing to keep in mind if there's ever a step that you're interested in using and maybe you're not configuring it correctly and you're wondering like why is my test failing I recommend to try to find out of box test and see how it's properly configured because maybe you're not setting it up properly and there's a good um and correct configuration on all of these out of box quick start test um so next I will go into the Suites very similar to the test except for this kind of packages everything together um so again how I recognize that these are service Nows is that they're all named by their um application so in my personal opinion what I recommend to do is um look through the Suites find an application that you're trying to test and then see what all of the available options are um this is the easiest way to kind of find a test that you're interested in using in addition to that you're also able to make your own Suites as well by clicking this new button and kind of package any of your own personal tests um we kind of recommend either pack packaging those by application similar to the ones that you see here or similar functionality then the next one that I will go into is the scheduled tab so I don't have anything scheduled here but like I mentioned you're able to schedule those tests and if you do create that schedule you'll see a different types of options like daily weekly or whatever you kind of prefer um so this is super helpful especially when it comes to upgrades because you can have those scheduled before and after your upgrade um and also schedule it outside of business hours for example if you have a lot of tests that you're trying to um run so like for example you can upgrade and also schedule that at the same time so that when you wake up you'll see your instance on a new um release and those results already populated so you can get right to work yeah and then that is mainly also want to talk about test templates test templates yes yeah that one so these temp templates these are pretty much a way for you to put an unconfigured list of steps inside of your instance and it's very helpful if you recognize that you're kind of following a similar pattern um so rather than rewriting all of these steps over and over again you can actually create templates um like for example let's say you always know that you navigate to a specific path before you start um executing some type of test you can create that as a template and then that would kind of prevent you from needing to um manually add each one of those every single time yeah and they come in very handy when you want to um create start creating your own test like instead of using sometimes I think I hear customers say oh they use Quick Start test but with this also it is a way for you to also start your HF test templates and put them in your test suit yes I've gotten some questions like that as well some people are like are we able to create our own quick start test um and this would be the best way to essentially do that is to kind of put that as a template yeah yeah and you can always add them into any kind of test you already have definitely but that was some of the main core components were there anything else you wanted to look at in this module no I think that's all for now um we're going to go more in depth for the later um work through vide those ones we going to do some live discreation Shing the place and lik but this this is what good we're good with this yes there is one more thing actually I almost forgot to show um but something else that I like to show is more related to these quick start test so this is actually also dependent on the types of applications that you currently have installed um but there are also a lot of Quick Start tests so if you go to the service now store you'll see the many different options um so this is what I always recommend to do before you kind of decide that you want to create a test from scratch I recommend going to the service now store and looking at all of the available quick start test some of these for example cmdb everyone has a cmdb so this would be really helpful to um in upload and install before you start creating those another one service catalog a lot of people have that as well so that's another thing that you can just grab um and then use as well so definitely make sure to look at the the plug-in store as well for any types of options yeah this is Vol with T very important MH yes okay all right so um guys thank you very much for watching this and you going to come out with more series to actually help you make sure your ATF adoption or your ATF usage is as easy and free flow as possible so thank you guys thank you

View original source

https://www.youtube.com/watch?v=xTyYKW9C2Fg