- By checking the state of the UI after the action.
- By checking the returned data in the UI or by querying the database.
- By comparing data from the test environment with data from a known environment.
To facilitate validation, LogicMantra builds automation frameworks (or test harnesses) that allow scripts to be plugged in, reused or re-designed with minimal effort. LogicMantra also focuses on integrating the test harness with the bug database and the test case database, so that test cases are updated and bugs are reported automatically.Automation Areas Unit Testing: Automating unit tests is a challenge, but in situations where it can be achieved, the effort pays off many times over. A typical method to automate unit testing is to use test applications/samples which automate APIs of a component with different combination of inputs and outputs. Test Lab Setup: Setting up and configuring software and hardware for every build is a time-consuming activity. Automating this allows testing to start earlier, reducing cycle times.
Build Process: Daily builds are desirable, but often unviable because of the time it takes to get the latest code from source control, label it, rebuild the binaries, and deploy the software for testing. This process sometimes takes half a day for complex software. Automating the build process makes daily builds a viable part of the process; it not only saves time and effort, but also ensures that developers can very quickly get information about the quality of their code.Build Verification Test (BVT): Iterations between Dev and Test teams can be reduced by automating BVT tests that allow the test team to quickly evaluate whether builds are of acceptable quality.
Functional and Regression Testing: Automating regression test suites ceases to be straightforward in the case of product modification where each build is designed to change the behavior of the software and the test output. LogicMantra adopts inventive approaches to effectively automate testing in such scenarios.
Performance/Stress/Reliability Testing: These tests invariably need simulated conditions of load or stress on the system. The simulations are automated and repeated multiple times, each time varying different parameters, to detect bottlenecks.