Guide Studio Tester4.0 Part 3

Part 3: Execute Script with Tester 4.0

A. Execute script for Mobile

Set up Executable files for the project

Before executing a test script, we can set-up the executable files (apk or ipa) for the application

Step 1: Select the option upload file IPA or APK from the Project Detail screen

Step 2: Upload the file

Step 3: Input the package name

Step 4: Click on the [Save] button

II. Execute a Script and check the test result

1. Run Now

Step 1: Click on the button [Run Test Script Now] -> The popup Run Test Script will be displayed

Step 2: Select Device (In the Run Test Script popup, select one or more Android devices)-> Click on the [Next] button

Step 3: Select Test Script (After selecting Android devices, the popup list of Android test scripts will be displayed –> select one, or more scripts that the users want to run –> Then click on the [Next] button)

Next, we can select iOS devices and iOS test scripts, similarly to step 2, 3 with Android

Step 4: Select test language(s)

Input a Job name and select test language(s)
Click on the button [Run Test Now]

Step 5: View running test script(s) (Show the correct number of devices and the name of each device selected for running from step 2 -> Click on the [View] button next to each device name to show the streaming screen of that device)

Step 6: After the test script execution is finished: The Test Report will be shown in the Project Detail screen. To view the detail of a Test report: click on each test report item in the list

2. Run a script On Schedule

Step 1: Click on the [Add Schedule Job] button

➩ The popup select devices & test scripts (similar to the “Run Now” feature) will be displayed

Step 2: Setting the time and date to run test scripts automatically:

Input the Job name
Select test language(s)
Select a time to run test scripts: including the time and the day of the week
Click on the [Add Schedule Test] button

➩ After finish adding a Schedule, at the scheduled time, the selected test scripts will be executed and the test result will be saved.

3. Check the test result

After the test script execution is finished, the Test Report will be shown in the Project Detail screen.

To view the detail of a Test report: click on each test report item in the list.

There are 2 types of results: Pass and Fail.

Pass: Script works, no script errors, test script return result exactly as expected.

Fail: There was a script error or an input error, not getting results from Tester 4.0. Or there is no script error but Tester 4.0 returns result different from expectation. If the result is fail, the system will display detail of error and error step.

If user use AI to check the expectation in test script, it will have more result: Warning. The script works, there are no script errors, the AI returns the results (but not the Input Error), but the AI’s result is that something is wrong. Specifically: An element’s image comparison function returns FALSE. When the result is warning, the user needs to confirm the result.

AI when comparing 2 screen shots will give the same ratio of 2 images, the value runs from 0 to 100%.

In Tester 4.0 define a Threshold level so that if it is below this level, it is considered a problem. For example, if Threshold setting is 95% then:

A.I returns 2 images that are more 95% similar -> no problem.
A.I returns 2 images with the same 95% or less -> considered “problematic” à Warning.

At the moment, the Threshold setting is 95%.

4. Download evidence

On the test report detail screen, click on button Download evidence à click on button Download Evidence. Then tester 4.0 will send to you an email when the process is completed.

5. Send mail

To receive test report, after user select test script and device, you tick on Send test report to your email and input recipient’s email. Then Tester4.0 will send test report to you when test script run completely.

III. Export – Import Test Script

1. Export Test Script

After successfully creating the test script, if you want to export the generated test script, you can follow these steps:

Step 1: From the “Manage Test script” screen, click on the “Export Test script” button to switch to the “Export Test Script” screen.

Step 2: Select the test script you want to export, then click the on the [Export X Test script] button (X is the number of test scripts you want to export)

2. Import Test Script

If you already have a test script file, you can import the file by following these steps:

Step 1: From the “Manage Test script” screen, click on the “Import Test script” button to open the “Import Test script” popup.

Step 2: Click on the [Browser] button, then select the test script file you want to import, then click the [OK] button

B. Execute script for PC Web