Perhaps the most critical aspect of an effective test automation implementation, the Build phase is where it all begins. The decisions you make during the this phase of the implementation will impact you throughout your automation life-cycle. This means the initial building out phase of a proper test automation implementation requires decision making based on your specific situation (covered in our post discussing Automation Best Practices.
Before the build out phase of good test automation can begin, you’ll need a starting plan for testing the application. This means defining initial coverage goals for the automation and setting some preliminary milestones for effort comparisons. These should be small at first; we might set our first milestone as simply as scripting a variable driven login method to gain access to the application for our tests in the future. It’s important to let milestones build on themselves and to add as much value down the road as possible and to build simple test cases that can be moved into a central utility file and refactored as one line function calls in upcoming test cases.
Next, there must be an exploratory phase of testing the application and inspecting the elements to evaluate the effort needed to build out automated test case. Lastly, environmental details need to be agreed upon so that test cases are built to the same standards and specifications as the application. The good news here is that Awetest is flexible enough to allow for sudden changes in your automation (and underlying Development) process but “design” and “architecture” decisions made during the Build phase will impact the time, effort & performance of your automation infrastructure in the future.
Bottom Line: Automation is a development exercise and should be treated as such.
Based on our experience here are some of the key learning and findings for Building your automation from the ground up:
Plan Your Automation
Before diving head first into automation, be sure you understand the monetary, time, and resource investments needed to properly implement test automation in the development / QA cycle of your company. To help you get started, the Awetest team provides a range of professional services that include Quickstart, Migration, and By-the-Hour Guidance packages to help companies build their test automation implementation from the ground, or port previously built test cases into the Awetest system to the eventual routine maintenance always needed for keeping everything running smoothly.
Choose a hybrid testing framework that supports Data and Keyword-driven Testing as well as Modularity and Model-based Testing. With Awetest’s ‘Assets’ tab, spreadsheets and custom method libraries can be saved and called from within automation test cases.
Define Target Initial Coverage
Having a planning session of what needs to be automated before you start trying to automate every manual test you can think of with these five key principles of automation in mind:
- Time Savings: Time to perform the manual test vs. scheduling and viewing results of an automated test
- Repeatability: Ease of performing the manual test with the exact parameters every time.
- Reusability: Does this happen over and over within a given work flow? Tests that require different data sets to pass are definitely worth automating.
- High Risk: Check if there is any area of the application you need to be absolutely sure functions properly
- Configuration Dependencies: If you need to test on multiple operating system, browser, or device combinations.
A good place to start would be taking a look at your existing test cases in Quality Center or other Application Lifecycle Management systems being used, and then identifying the ones that fit your automation criteria. This will allow you to get a good sense of the percentage of total test cases you will want to automate, and a preliminary sense of the relative effort it will take to automate them. We recommend starting the build of your automated regression tests with a test case that is very well understood from both a development and business need standpoint, like a login or create account test case.
Don’t Automate Everything
Sometimes the best automation is no automation – spending a week to script a difficult/rare activity is not a good use of time; do that activity manually during test runs for now, and come back to the problem later. Many times just taking a break from a particular problem point can clear your brain enough to take up the challenge again. Remember that almost all web interactions can be automated with endless time to build the test scripts. If that is holding back your overall automation efforts it is completely okay to shelve the problem temporarily, test the problem manually, and get actual results. In practice, we find that is you are spending more than 6 times the amount of time to automated a test vs testing it manually you might as well put it in the manual testing bin and move on.
Organize Your Tests
Organize your test cases into thoughtful categories, such as:
- Core Functionality
- Problem Areas
- Unit Tests
- Areas Currently Under Development
This makes testing areas of the application that the time of release more target-able and can prove a real time saver with agile development teams. Awetest come with a test case management system for organizing your automation test scripts into meaningful categories that will help your testers build easy test cases at the drop of a hat.
This system also comes with drag/drop/reorder capability to set the order of the test cases/scripts. This gives you flexibility to reorder categories or test cases as required and is useful when you want to add additional test cases to your regression suite in the future. This can also be used to order the test cases to be executed in a regression job run. You can use this capability from the test cases page or schedule jobs page, and your changes will be saved throughout the application.
Don’t Reinvent the Wheel
Always use an extensible test automation framework with the best testing technologies available. Awetest is built from the ground up using variety of different open-source test automation frameworks, each with their own strengths and weaknesses. We aren’t trying to reinvent the wheel here; we are trying to create the best quality tire on the market, and that means spending time improving where the rubber hits the road. This approach means that. with Awetest, there is no real need for software test professionals (who already use these popular technologies) to relearn anything new and more importantly, this means test cases already built in these frameworks will easily port over for implementation in Awetest.
When creating test cases in Awetest, you have the option to select the script type for that particular test case. Some of our current options for regression test cases include:
- Awetest Native DSL
These scripts allow you to leverage any existing test cases you might have built in those testing languages, directly inside of Awetest, with the same maintenance capabilities and level of reporting as Awetest’s Native DSL. Not only that, but you can mix and match your testing languages from within one script file. Awetest has the ability to call Sikuli scripts from within an Awetest script. This means you can utilize Sikuli for individual browser interactions without having to script the whole test case in the Sikuli language.