Test Automation Process Assessment
Bian, Zihan (2020)
2020
All rights reserved. This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:amk-2020112323799
https://urn.fi/URN:NBN:fi:amk-2020112323799
Tiivistelmä
Test automation (TA) is an important software testing method and is pivotal in software development cycles, especially in agile development. The TA process can directly affect the efficiency and coverage of the testing and the accuracy of the testing results; thus, it can affect the software product quality. By assessing the TA process and identifying the improvement steps, companies can promote high-quality software products.
This thesis concerns TA process assessment at the case company, a Finnish bank that recently established TA to support its digital service transformation. This thesis project aimed to help the case company understand their TA process status and outline the focus areas for improving it. The project outcomes included analysis of the assessment results, improvement suggestions based on assessment results, and planned follow-up check-points.
This project initially investigated the overall implementation of TA at the case company and studied the software testing and TA background. Based on the studies, the test automation improvement model (TAIM) was selected as the assessment model for this project. An assessment matrix was defined similarly to the TPI model. A survey and targeted interviews were conducted as the main assessment methods. The survey data was collated to provide insights into providing improvement suggestions and a follow-up plan. Suggestions and follow-up checkpoints were then presented in achievable small steps. Finally, a long-term vision was formed to clarify the direction of continuous improvement.
The assessment found that, at the case company, the maturity levels of key areas (KAs) such as the TA strategy, test tool use, test design, test execution, the overall process, and the verdict are at the initial level, indicating the activities are mostly ad hoc. Thus, a significant team effort is required to improve them. However, KAs such as the test organization, test tool selection, and the software under test have reached a controlled level, indicating the test process activities are performed correctly. The KA of the test environment has reached an efficient level, indicating the test process activities are conducted efficiently.
This thesis project clarified that a clear and solid strategic plan efficiently combining personnel, technologies, and process is key to successful TA.
This thesis concerns TA process assessment at the case company, a Finnish bank that recently established TA to support its digital service transformation. This thesis project aimed to help the case company understand their TA process status and outline the focus areas for improving it. The project outcomes included analysis of the assessment results, improvement suggestions based on assessment results, and planned follow-up check-points.
This project initially investigated the overall implementation of TA at the case company and studied the software testing and TA background. Based on the studies, the test automation improvement model (TAIM) was selected as the assessment model for this project. An assessment matrix was defined similarly to the TPI model. A survey and targeted interviews were conducted as the main assessment methods. The survey data was collated to provide insights into providing improvement suggestions and a follow-up plan. Suggestions and follow-up checkpoints were then presented in achievable small steps. Finally, a long-term vision was formed to clarify the direction of continuous improvement.
The assessment found that, at the case company, the maturity levels of key areas (KAs) such as the TA strategy, test tool use, test design, test execution, the overall process, and the verdict are at the initial level, indicating the activities are mostly ad hoc. Thus, a significant team effort is required to improve them. However, KAs such as the test organization, test tool selection, and the software under test have reached a controlled level, indicating the test process activities are performed correctly. The KA of the test environment has reached an efficient level, indicating the test process activities are conducted efficiently.
This thesis project clarified that a clear and solid strategic plan efficiently combining personnel, technologies, and process is key to successful TA.