Adding a checkpoint and test steps

After creating your first goal, you can augment the test with new steps and checkpoints. Let's walk through this:

1. Open a journey in the Goal view;

Users visiting the same journey

If other users are accessing the same journey as you, their avatars are shown near the journey name. In the above image, the user can see that someone with initials "IU" is also on the same journey authoring page.

2. Click on Add a checkpoint below the existing checkpoints. This will open up the form to either create a new checkpoint, or reuse an existing one (see shared checkpoints below):

   2.1. If you wish to create a new checkpoint, type its new name and click create or press enter.

   2.2. To reuse an existing checkpoint, type a hint of its name or number, and once it shows up in the list, click on its name to select it. The label on the confirm button will change from "Create" to "Attach" (note that a checkpoint cannot be inserted more than once in a journey, including the first one).

3. Add the test steps (see Natural language syntax for the available commands).

Adding test steps

You can create new test steps by mousing over an existing one and clicking on the Add step button. The button shows the position where test step will be created.

Test step details

Once a test step is created, you can click on the test step to open the step details on the right side of the screen.

This panel is composed by the following tabs:

• Step editor here you can edit the details of the command that Virtuoso will use for this step such as data/variable used by the command (more on this in the Test step data section below), element selectors, or other options such as what to do When this step fails (more on this in the Test step data section below).
• Screenshot here you will see a screenshot from the page after the test step was executed at least once, and if the instruction targets an element (e.g., click on "Images") you can switch to the Before element interaction to see the state of the page before clicking on the element;
• Side effects shows execution contextual observations that may be relevant to you (e.g., a value used by a variable);
• Step timeline shows the changes, jobs and comments associated to the test step (see Timeline for details).

Test steps added but not executed yet

Virtuoso will fill in some information for your step just after creating it depending on the natural language command used to create the step. After executing the step for the first time, Virtuoso will guess more information about the step such as the element structure, the element selectors, or any other information that the test might generate after executing it. Usually, you will not need to edit the test step details manually.

Side effects are not available for big execution reports

If an execution has over 1000 test steps in total, the side effects are not shown in the execution report to reduce the load on the browser (e.g., the side effect tab will not show the variable used and other side effects).

As a workaround, you can access the information that is not available in the execution report on the goal view while accessing a journey, if that is the latest execution of the goal version, or execute a subset of the journeys failing to reduce the number of test steps below this threshold.

Test step data

Many page interactions use some form of data. For example, the value you write into an input field, or the URL of the page to navigate to. This data can come from fixed values (raw text), or dynamically such as variables, JS expressions, or test data values (from test data tables).

You can manage the data used by your step using the Data section of the step editor:

On top of the section, notice the source of data which will be used in your step. You can change what kind of data you want Virtuoso to use, by clicking on the corresponding section and providing the corresponding values.

In the screenshot above, you will notice a checkmark next to Use value, meaning that Virtuoso will pick up that setting when executing the step. Depending on the type of step and the settings configured in this section, the checkmark indicates which value will be used. For instance, if you have both an expression and hardcoded value set up in your step, the value of the expression will be used instead of the value. In this case, if you want your step to use the explicit value, you need to remove the expression.

Using fixed values

When choosing this option, Virtuoso will use the raw string provided as the value for executing the step.

Using variables as test step data

When using this option, Virtuoso will try to infer the value of the variable from the execution context. The following precedence applies from top to bottom:

1. a variable that was set up previously during the execution by using a Store command;
2. supplied dynamically from the API call triggering the execution (initialData in the execution request);
3. test data value if the journey has a test data table assigned, and a column name is matching the variable name;
4. and lastly, to an environment variable with the same name, if available.

A default value can also be provided in case none of the mentioned dynamic values could be found.

Note: when an expression is set on a step, Virtuoso will use the value of the expression over the variable or fixed value.

Using data-driven values as test step data

If you choose to use values from test data tables, you will need to assign a data table to the journey, and pick a column from the ones availables in that table.

If your journey has a test data table assigned, and you choose a column to use with the test step, Virtuoso will assign a variable name that matches the JavaScript-compatible interpretation of the column name (replacing spaces and special characters by underscores).

The precedence presented on Using data-driven values as test step data still apply, so double check if the previous test steps are not overridding the generated variable value (or if that specific variable is not being provided as initialData for the execution, applicable only for API calls or Flow executions).

Using JavaScript expressions as test step data

JavaScript (JS) expressions will work similarly to variables, but instead of directly inferring the value from the execution context the expression will be evaluated as a standard JS expression.

For example:

• If you previously stored the value 123 in variable $foo a JS expression $foo * 2 will evaluate to 246.
• If you have an environment variable $userName with the value John, $userName + 'Doe' will evaluate to John Doe.

Note: As stated above, JS expressions will take precedence over variables and fixed values, even if the expression itself contains the same variable that is defined on the variable section.

Conditionally skip test steps if the content is empty

When you use the variable, data-table, or expression blocks, you can mark it to skip when variable or expression is empty. For expressions, the step is ignored if the expression evaluates to empty string, 0, or false.

When you activate this option the default value, if any, is cleared and the field becomes disabled.

Reordering tests

You can change the order of your checkpoints and steps by hovering over them and using the drag handle that appears on their left side to drag and drop.

Note that when reordering checkpoints, you won’t be able to move the first checkpoint, nor drop any checkpoint before it.

When reordering steps, you will be able to drag and drop steps within the same checkpoint, or between different checkpoints.

Reordering tests will allow you to keep all the information that Virtuoso stores about checkpoints and steps (including the history and healing information), without having to recreate them.

Tagging checkpoints

You can tag checkpoints to organize your tests further and to quickly find them when adding a shared checkpoint. For example, when some checkpoints may target a specific feature, you can add a tag with that feature name and then mark the checkpoints that interact with it. Later, when trying to reuse those checkpoints, you can write the tag name to locate those checkpoints.

To tag a checkpoint, hover the mouse over it and click on Manage checkpoint tags to open the tag manager. From there you may create new tags or search and select pre-existing ones. This works just like tag journeys but in this case you tag checkpoints.

Shared checkpoints

Journeys from the same goal can share one or more checkpoints (set of test steps). You can see this in action in the first checkpoint of every journey:

On a shared checkpoint, any change to its test steps will be replicated in all other journeys where it's shared. In practice, they are all the same checkpoint. E.g., if you add a test step such as Click on "Images" in the first checkpoint (which is a shared checkpoint), that test step will be added in the same position on the first checkpoint of every journey of the goal.

Sharing a checkpoint

Checkpoints can be shared following one of these two methods:

Reuse an existing checkpoint

You can choose to reuse a checkpoint while adding a new one to the journey by typing a hint (name, checkpoint number, or tag) of an existing checkpoint, and selecting it from the list.

Create a new journey reusing another’s checkpoints

This method allows you to create a new journey that will share all the checkpoints up to a point with the original journey.

1. Move your mouse pointer after the checkpoint you want to share and click on New journey from here;

2. Enter the title for the new journey and click on Save;

The new journey will share all the checkpoints between the first checkpoint and the checkpoint where you clicked on New journey from here in the original journey:

Unsharing a checkpoint

You can unshare any checkpoint (except the first one) by clicking on the icon next to the Shared in N other journeys text next to the checkpoint name.

Splitting and merging checkpoints

You can split an existing checkpoint into two pieces, and merge two sequential checkpoints into a single one. This allows you to organize your tests quickly, breaking longer journeys into smaller and more manageable checkpoints, or joining small checkpoints into a single one during journey authoring.

For example, the checkpoint below includes steps to navigate to the login page, before clicking on a "Forgot password" link:

If we wanted to capture snapshots of the login page or reuse the checkpoint, we could manually create a new checkpoint and move the second step to produce two checkpoints:

The "Add checkpoint" button provides a shortcut to automatically perform these steps. To use it, first place your cursor between the steps that should start and end the new checkpoint and click "Add checkpoint":

Confirm the operation by clicking "Add & move" on the dialog that appears.

Shared checkpoints

When using "Add checkpoint" inside a shared checkpoint, the new checkpoint will only be inserted into the current journey, and not any other journey that contains the checkpoint to be split. You can use the "Add checkpoint" feature in other journeys to add it where required.

For this reason, the "Add checkpoint" cannot be used to split the first checkpoint, as it would remove steps from every other journey.

Checkpoints can also be merged using the "Merge checkpoints" button which will migrate the steps back into the first of the two checkpoints.

Shared checkpoints

Merging checkpoints cannot be performed on a shared checkpoint.

Following these steps allows you to write custom tests, augmenting the ones generated by Virtuoso. This is the end of the introduction to Virtuoso, next we look at how to Using Virtuoso, starting with Managing projects.