Autotests represent a tool that one needs to apply properly. To do so, we have to outline the goals that we pursue when implementing such practice. I would highlight the following ones:
- Reducing the cost and time spent on manual testing;
- Speeding up software releases;
- Increasing quality and reducing the number of defects and risks.
Let's look at how we can achieve each of these goals using autotests.
Reduced manual testing costs
A constant expansion of the project, introduction of new features, framework’s version updates, etc. increases the load on the manual test team. If the workload is increasing and the manual testing team requires more and more members, then you should implement test automation in your processes. Over time, autotests will cover old stable features and free up time for manual testing. This way, you won’t need to expand your team - instead, you’ll save money. Besides, manual QA specialists will actually do the testing and not “conduct test cases.”
Reducing the time of manual testing results in faster delivery time
A business needs to deliver changes to users as quickly as possible. As autotests are launched frequently, bugs will be found and fixed at an early stage. That practice reduces the time spent on testing and fixing prior to the eventual release. Second, the speed of autotests is faster than manual checks. Implementing automated testing into processes can significantly reduce the time it takes to release updates. This way, you can stay ahead of the competition with the release of a new killer feature.
Erik Fogg, COO at ProdPerfect expands the idea: “The value of automated testing comes from re-testing your application or services end-to-end for little more than the cost of computation. Compared to completely manual testing, you will save not only money but also time. It becomes possible to deploy small changes independently without having to wait for a scheduled release day. This increased development speed allows you to move your business much faster and flexibly. Developer velocity gains are hard to measure but easy to feel, and the benefit is huge”.
Increasing quality and reducing the number of defects and risks.
Of course, manual QA specialists are very skilled and won’t let a single bug pass undetected. However, let's suppose you have a mobile bank application (or a billing system) that contains a huge number of fields with 15-digit numbers, dates, and transactions on each screen. Never forget about the human factor: a mistake in such an application can be really costly. When checking a vast amount of data, you can always miss an error due to the so-called effect of losing the freshness of vision. In such cases, autotests are indispensable. And guess what: manual QA specialists will only be happy to shift this routine to autotests.
Here’s Erik Fogg, COO of a data-driven testing service ProdPerfect on the matter: “The biggest benefit of automated testing is the early detection of issues and trust in the build. Both enable us to increase the speed of delivery, as well as developer productivity, significantly. Fundamentally, one could achieve equal test coverage with manual tests, but it’s expensive and slow to do so as your team and codebase grow”.
How do you know when to switch from manual to automated testing?
Long-term projects. For short-term projects with a small number of releases, it will be more profitable to perform manual testing several times.
The functionality and environment are quite stable. The more stable the functionality is, the lower the cost of maintaining the tests turns out to be.
The functionality should be tested regularly and frequently. The more often functionality is tested, the faster its automation pays off.
Technical ability to test using autotests. There are many test cases that are technically impossible to automate. Besides, automating a certain functionality is sometimes labor-intensive and such autotests are hard to maintain. In this case, it is more profitable to use the manual testing.
Сross-platform or cross-browser testing. Automation tools allow you to use the same code for different browsers and platforms. Therefore, having spent the resources to develop a single autotest, you can run it on different platforms (browsers and device versions).
Brian Stewart, Project Manager at ProsperoWeb, shares his experience: “We create web applications, and they need to be tested on the basis of cross-platform and cross-browser compatibility. We do use autotests for the same and it does save a lot of time.”
In regard to these points, a question needs to be asked. Can auto testing replace manual testing?
Dave Lane from Twin Sun explains: “I believe automated testing and manual testing serve different purposes. Automated testing should ensure that your code technically fulfills the requirements so far as the developer understood them. Manual testing should ensure that your software functions in an intuitive and predictable way for your average user. A team with a good appreciation of automated testing will not replace manual testing: instead, they'll shift the responsibility of manual testing up higher in the value chain. Manual testers will not need to spend as much time verifying that the application works. Instead, they'll begin focusing on the overall user experience and think about how to improve the software”.
There are so-called ROI (Return on Investment) calculators. Based on a number of parameters, they help to determine at what point automated testing becomes more profitable than manual testing.
However, it is essential to understand that the calculations will be very approximate since it is extremely difficult to predict and take into account everything with high accuracy. In addition, automation only replaces some of the manual checks. At the same time, automation itself is a product that asks for a technical debt to be repaid, and this should also be taken into account.
Bobby from Blue Label Labs sums it up perfectly: “While automated testing can catch some issues, it often requires a considerable amount of intervention to configure specifics for use scenarios as well as to make sure it’s performing up to speed. A lot of times, automated testing ends being about as methodical and effective as a Roomba in a messy house”.
To calculate the effectiveness of test automation for the selected functionality, you need:
- Manual testing costs (in person-hours);
- The cost of developing autotests (in person-hours);
- The number of testing iterations.
All in all, test automation reduces costs for the business, and the economic benefits increase steadily over time. The main thing is to know how exactly a business may apply this powerful tool with maximum efficiency.
Artur Shaikhutdinov, QA Automation Engineer at Deutsche Bank, sums it up: “The initial investment in test automation can be very high. The acquisition of software, the cost of training to work with it, the design and creation of automated tests - all this requires a lot of time and money. However, once you start developing more and more new features in your product, manual testing ends up being more expensive and automated testing cheaper.”
Building Reconciliation Tool for e-commerce company
Our client was in need of streamlining and simplifying its monthly accounting reconciliation process – preferably automatically. But with a lack of time and low budget for a custom build, development of a comprehensive software wasn’t in the picture. After going through the case and customer’s needs, we decided to implement Retool. And that was the right choice.
The scope of work
Our team developed a custom reconciliation tool designed specifically for the needs of high-volume transaction environments. It automated the processes and provided a comprehensive dashboard for monitoring discrepancies and anomalies in real-time.
The implementation of Retool significantly reduced manual effort, as well as fostered a more efficient and time-saving reconciliation process.
Creating Retool Mobile App for a Wine Seller
A leading spirits and wine seller in Europe required the development of an internal mobile app for private client managers and administrators. The project was supposed to be done in 1,5 months. Considering urgency and the scope of work, our developers decided to use Retool for swift and effective development.
The scope of work
Our developers built a mobile application tailored to the needs of the company's sales force: with a comprehensive overview of client interactions, facilitated order processing, and enabled access to sales history and performance metrics. It was user-friendly, with real-time updates, seamlessly integrated with existing customer databases.
The result? Increase in productivity of the sales team and improved decision-making process. But most importantly, positive feedback from the customers themselves.
Developing PoC with Low Code for a Tour Operator
To efficiently gather, centralize, and manage data is a challenge for any tour operator. Our client was not an exception. The company was seeking to get an internal software that will source information from third-party APIs and automate the travel itinerary creation process. Preferably, cost- and user-friendly tool.
The scope of work
Our experts ensured the client that all the requirements could be covered by Retool. And just in 40 hours a new software was launched. The tool had a flexible and easy-to-use interface with user authentication and an access management system panel – all the company needed. At the end, Retool was considered the main tool to replace the existing system.
Testing New Generation of Lead Management Tool with Retool
Our client, a venture fund, had challenges with managing lead generation and client acquisition. As the company grew, it aimed to attract more clients and scale faster, as well as automate the processes to save time, improve efficiency and minimize human error. The idea was to craft an internal lead generation tool that will cover all the needs. We’ve agreed that Retool will be a perfect tool for this.
The scope of work
The project initially began as a proof of concept, but soon enough, with each new feature delivered, the company experienced increased engagement and value.
We developed a web tool that integrates seamlessly with Phantombuster for data extraction and LinkedIn for social outreach. Now, the company has a platform that elevates the efficiency of their lead generation activities and provides deep insights into potential client bases.
Building an Advanced Admin Portal for Streamlined Operations
Confronted with the need for more sophisticated internal tools, an owner of IP Licensing marketplace turned to Retool to utilize its administrative functions. The primary goal was to construct an advanced admin portal that could support complex, multi-layered processes efficiently.
The scope of work
Our client needed help with updating filters and tables for its internal platform. In just 30 hours we've been able to update and create about 6 pages. Following features were introduced: add complex filtering and search, delete records, styling application with custom CSS.
Together, we have increased performance on most heavy pages and fixed circular dependency issues.
Creating MVP Dashboard for Google Cloud Users
Facing the challenge of unoptimized cloud resource management, a technology firm working with Google Cloud users was looking for a solution to make its operations more efficient. The main idea of the project was to create an MVP for e-commerce shops to test some client hypotheses. Traditional cloud management tools fell short.
The scope of work
Determined to break through limitations, our team of developers turned Retool. We decided to craft an MVP Dashboard specifically for Google Cloud users. This wasn't just about bringing data into view; but about reshaping how teams interact with their cloud environment.
We designed a dashboard that turned complex cloud data into a clear, strategic asset thanks to comprehensive analytics, tailored metrics, and an intuitive interface, that Retool provides. As the results, an increase in operational efficiency, significant improvement in cost management and resource optimization.
Elevating CRM with Custom HubSpot Sales Dashboard
Our other client, a SaaS startup, that offers collaborative tools for design and engineering teams, was on a quest to supercharge their sales efforts. Traditional CRM systems were limited and not customizable enough. The company sought a solution that could tailor HubSpot to their workflow and analytics needs.
The scope of work
Charged with the task of going beyond standard CRM functions, our team turned to Retool. We wanted to redefine how sales teams interact with their CRM.
By integrating advanced analytics, custom metrics, and a user-friendly interface, our developers provided a solution that transformed data into a strategic asset.
In 40 hours, three informative dashboards were developed, containing the most sensitive data related to sales activities. These dashboards enable our customer to analyze sales and lead generation performance from a different perspective and establish the appropriate KPIs.
Building a PDF Editor with Low-Code
Our client, a leading digital credential IT startup, needed a lot of internal processes to be optimized. But the experience with low-code tools wasn’t sufficient. That’s why the company decided to hire professionals. And our team of developers joined the project.
The scope of work
The client has a program that designs and prints custom badges for customers. The badges need to be “mail-merged” with a person’s info and turned into a PDF to print. But what is the best way to do it?
Our developers decided to use Retool as a core tool. Using custom components and JavaScript, we developed a program that reduced employees' time for designing, putting the data, verifying, and printing PDF badges in one application.
As a result, the new approach significantly reduces the time required by the internal team to organize all the necessary staff for the conference, including badge creation.