# Changelog

This page actively tracks the latest changes and improvements in Virtuoso 🚀. Releases marked as beta denote releases that are currently undergoing testing in our staging and demo environments.

# Chrome 92 and browser updates 2021-07-27

With the Olympics in full swing we all know how important it is to be first across the line. We have therefore updated our Google Chrome version to 92, as well as the cross-browser grid with the latest browsers including Firefox 90.

# Requirement coverage 2021-07-27

Requirement coverage tab

After linking your requirements to journeys, you may be wondering how well your requirements are covered overall.

With requirement coverage you can track the coverage of each individual requirement as well as the overall coverage across your project.

Read more about requirement coverage →

# Intelligent highlighting of iframe elements 2021-07-01

element highlighted inside iframe

Elements inside an iframe are, by design, unaware of their position relative to the page encapsulating them. However, browsers can only take screenshots of the browser-window. This means that highlighting elements based on their reported position on the browser window would lead to a misplacement.

Virtuoso will now intelligently auto-correct the position of the highlighted element on the page, to avoid confusion during test authoring and maintenance.

Read more about this and the limitations in our best practices for iFrames →

# Browser grid updates 2021-06-30

We have updated our cross-browser grid with the latest browsers including Chrome and Edge up to version 91, and Firefox up to version 89. We have also added a series of new devices, highlights include the latest Apple iPads and the Samsung Galaxy S21 series (including Ultra).

Read more about the full list of available devices →

# Conditional test step executions 2021-06-30

Step editor - Data block with skip option

When testing data-driven applications, sometimes, depending on your data, you may need to skip some interactions.

We are introducing a new option to skip executing a test step, if the variable or expression evaluates to empty content.

Read more about condition step execution →

# Data block in test step editor 2021-06-29

Step editor - Data block

The data section of the test step editor has been dramatically simplified. Managing your step data and understanding its source could not be easier, even when multiple data attributes are set.

Read more about using data in test steps →

# V-Capture 2021-06-28

V-Capture

We have re-built our extension for Chrome (V-Capture) from the grounds up to provide an easier and fully integrated experience for capturing user interactions.

You only need to install/update the extension, create a new journey on the goal you want to capture and press Start capturing, from inside Virtuoso.

# Requirement management 2021-06-25

When testing, we are generally testing some form of "requirements", irrespective of whether they are explicitly written somewhere or not. When these requirements are loosely defined and only embedded into tests, it can be difficult to a) get an idea of what is covered and what is not, b) get a clear overall picture of the requirements as a whole.

We have introduced a dedicated requirement management capability into Virtuoso, where you can add or import your requirements, map them to your journeys, and review their coverage. You can even generate journeys automatically (or skeletons for your journeys) directly from your raw requirements!

Requirements page

Read more about managing requirements in Virtuoso →

# Goal and journey summary 2021-06-24

Goal summary

Who's been working on tests? How many are failing? When did they start failing? How is my web application performing? ... These are some of the questions we kept asking ourselves when working on our tests.

We are introducing a new view and experience to the goal view, where you can at a glance review your goal, and dig deeper to see more. For example, click on a journey to see the summary of the journey, expand performance metrics to review the full breakdown of pages, and more.

Read more about the new goal summary report →

# Draft journeys 2021-06-23

Draft journeys

Does the mere thought of directly touching production code or data send a chill down your spine? Creating new journeys in production goals when you feel they are not ready can sometimes feel the same.

With draft journeys, we aim to put these fears aside. New journeys are now created as draft, so that you can experiment and develop them at your own pace. Once you feel they are ready, you can "publish" them to be included in the goal's default set of journeys. Of course, you can set them back to draft at any time in the future.

Read more about draft journeys →

# Multiple organization support 2021-06-22

Switch between organizations

Users can belong to multiple organizations, using the same account. You can switch to the desired organization by selecting it in the Organization dashboard once you are a member of another organization.

# Snapshot comparison baselines 2021-06-21

Snapshot comparison baseline

Your app looks perfect, there are no visual defects, all is as it should be. Wouldn't it be great if you could capture your entire app at this moment in time and use it as a baseline for future tests? That is exactly what the Snapshot Comparison Baseline does.

Whenever Virtuoso captures a snapshot of your app and the results are as expected, you can set that as your baseline. Then ensure that you catch any visual changes that deviate from that baseline. And if the deviation was expected you get to select a new baseline ensuring that your app is always visually flawless.

Read more about the snapshot comparison baselines →

# Execution report improvements 2021-05-27

Execution

Knowing the exact configuration and status of an execution is of utmost importance.

We have enhanced the report to provide a detailed view of the journey execution status, users who launched or cancelled the job, as well as all known execution attributes(e.g., environment, bridge, custom data, etc.). You can also now see, manage, and add execution tags right from the report itself.

Read more about the execution report →

# Ability to control if members can create projects 2021-05-24

Switch to prevent members from creating projects

As an organization owner, you can control whether members of your organization with standard permissions can create new projects or clone existing ones.

# Step re-ordering between checkpoints 2021-05-17

Step drag and drop

It is now possible to drag and drop steps to change their order not only within the same checkpoint, but also between them.

This will allow you to move a step to a different checkpoint without having to recreate it and therefore, keeping its timeline information.

Read more about reordering →

# Root cause analysis 2021-04-20

Root cause analysis

Knowing that a test step has failed can be an indication of a bug or regression but may also be a number of other things (e.g., test needs maintaining). Establishing what caused the test to fail is vital to both validate that the application under test is working as expected and, if not, how to fix it.

Virtuoso's root cause analysis helps you do just that. At a glance, get execution and change history, visual comparisons, and much more, to understand the underlying reason for failures.

Read more about root cause analysis →

# Key-value storage in directives 2021-03-08

Directives can now access and update a shared state during exploration. This allows directives to implement stateful behaviour to change how Virtuoso interacts with pages according to results from previous interactions.

Read more about KV storage in directives →

# Re-use checkpoints anywhere in your journeys 2021-03-08

Add or re-use checkpoint

You can now re-use checkpoints at any point in a journey where previously it was only supported at the beginning.

This enables you to re-use groups of steps when authoring journeys, improving the reusability of steps across all your journeys (reducing the effort when creating or extending them), and the ability to maintain tests (once you fix the checkpoint for one journey, the fixes are applied to all the others using that checkpoint).

Read more about checkpoint sharing and re-use →

# Ability to direct bridge traffic through a proxy 2021-02-11

Bridge proxy

Depending on your network architecture or connectivity requirements, it might be needed to redirect the traffic targeting your application through a proxy server.

You can now specify it as command line parameter on the bridge client application .

This will also allow Virtuoso Bridge to use third party apps for application analysis, e.g., OWASP® Zed Attack Proxy (ZAP).

Read more about the Virtuoso bridge proxy support →

# Leave comments in your journeys 2021-02-11

Comment steps

When authoring journeys, sometimes you may wish to explain why things are done in a certain way, or to leave action notes for your colleagues (or even your future self).

You can now leave comments as steps in your tests. Comment steps begin with double slashes // followed by free text up to 500 characters. These steps are not evaluated during execution (do not affect journey outcome), and are automatically highlighted if they begin with TODO or FIXME, so that you can more clearly raise action points in your journeys.

# Ability to ignore the outcome of test steps 2021-01-26

When step fails

Sometimes in a journey, you do not really care about the outcome of certain steps. That is, you wish for the journey to be considered passing, even if these optional steps are failing.

You can now control the failure behavior of a step by choosing among three possible options:

  • Stop and raise error. When the step fails, no further steps are executed; it is marked as failed and its checkpoint and journey are marked as failed too;
  • Continue and raise error. When the step fails, it is marked as failed, its checkpoint and journey are marked as failed too, but the execution of the journey will not stop;
  • Continue and raise warning. When the step fails, it is treated as passed, except that the step itself shows a warning sign and the warning is shown on the execution report (under the journey side effects tab and on the step's screenshot tab), without impacting the outcome of the journey.

# Live execution update 2021-01-18

Execution progress

As your journeys run in the Virtuoso cloud, from now on, you will see the execution progress updated in real-time.

This means you no longer need to wait until the journey finishes executing to check the results, and will make authoring long journeys easier.

You can see what step has just executed as well as its status and screenshot.

# Journeys Dashboard 2021-01-18

Journeys dashboard

You can now see all your project's journeys in a single dashboard, alongside their last modification and execution status. The journeys can be filtered by their current status, tags, goals, or name, as well as order the list by their last update or execution date, status, or name.

The dashboard also enables you to re-execute journeys individually or in bulk, with support for executing journeys from multiple goals at the same time.

Read more about the journeys dashboard →

# Fix elements with a single click when reviewing a failed execution 2021-01-18

Fixing the element

It is now possible to fix an element when a test step execution failed from the Goal view without needing to leave Virtuoso to collect additional information while authoring and executing.

You can do this by accessing the Screenshot tab of the step details on the Goal View, then click on Fix element, and then choosing one of the highlighted elements discovered when the failure has occurred.

Hovering over each highlighted element will provide you more information about it. Once you click on the element to fix the step, the selectors of the step will be updated immediately, and you can immediately re-execute the journey afterwards.

Note that this quick-fix capability is only available for steps which have elements, and were not marked to continue on failure / assertion failure.

# Detailed execution progress status 2020-12-14

Execution progress

You can now see the details of individual journeys' progress as they get executed.

For example, you can see when journeys are queued, actively running, awaiting bots, rate-limited (throttled due to max parallelism or fair usage), etc.

This should help you get a picture of the progress of your executions, especially when you launch many jobs and/or when executing hundreds of journeys, and simply in-progress can be confusing to know how your jobs are progressing.

Note that when journey execution is queued, it will certainly run as soon as resources are available for it, and simply canceling and re-running the journey will place your execution further down the queue.

# User-centric performance monitoring 2020-12-14

User-centric performance metrics

Virtuoso now captures key user-centric performance metrics every time you capture snapshots of your checkpoints.

These key metrics can help detect areas and pages in your application for which the user experience can be impacted by the page performance.

The report is color-coded to help detect metrics that are good, need-improving, or those which lead to a poor experience.

Read more about performance monitoring →

# Expandable side-bar 2020-11-23

Sidebar

Virtuoso's sidebar has been revamped to provide an improved experience.

The sidebar can now be expanded to more easily navigate to various sections of Virtuoso.

When on the goal view or an execution report where the sidebar options are hidden, you can now expand the sidebar by clicking on the Virtuoso icon, and directly navigate to the screen of your choice (e.g., navigate from the goal view to the extensions manager directly).

# 2.0 - 2020-10-30

# Added

  • Project dashboard: highlight
    • This new dashboard enables you to see how your goals and plans in your project are doing.
    • You can see the status of the latest execution of each goal and plan, and details per goal regarding the journeys executed.
    • You can easily drill down to see more details about the specific executions or a specific goal by simply clicking on the relevant section (e.g., clicking on "14 failed" will jump to the activity dashboard will lead to activity dashboard filtering for the failed jobs of that specific goal).
    • You can filter by specific dates to get a report of the state of your testing within a specific period.
  • Project activity dashboard: highlight
    • This dashboard allows you to see and filter the recent job activity on a specific project.
    • You can use the available filters to limit the information presented in a single place:
      • Job types, goals, date range as available on the previous dashboard.
      • Project tags: select multiple tags showing the jobs containing at least one of them.
      • Job outcome: filter jobs based on their results, for example, show only failed jobs.
      • Environments: see only jobs that were run with specific environments.
    • This feature supports shareable URLs containing the filter states. You can just copy the URL from your browser then share it with other users with access to the project, and they will see the same filters applied on the dashboard.
  • Timeline:
    • Leaving comments now supports markdown syntax (e.g: you can use **something** and it will be rendered as bold, or prefix each line with a - to create an itemised list). highlight
    • Comment field now autocompletes usernames from your colleagues typing @ (e.g: @john). highlight
    • Comment references to users will now be highlighted, and you can see the name, email and username (if available) of the user referenced in the comment by hovering over the comment reference.
    • Timeline entries have been enhanced with detailed information such as "which step was changed, added or removed", "title updates of journeys" or "which checkpoint was added or changed". highlight
  • Snapshot comparison highlight: Virtuoso now captures all key visible page elements involving text values, thus providing a more comprehensive snapshot comparison as a result.
  • Cross-browser/device testing: The latest chrome, firefox, and edge browser versions have been added. On the device front, we now support Samsung Galaxy Note 20, Ultra, A51 and A11; iPhone 11; iPad Pro 12.9 2020, along with Mini and Air 2019 models. Virtuoso's own Chrome browser has been updated to version 86.
  • Sidebar: highlight
    • Collapse/expand the sidebar to more easily access the sidebar items.
    • From goals/journeys you can now access all project-related sections (e.g., jump to extensions manager from your journey rather than having to go to your goal first).

# Fixed

  • Timeline: your timeline is now automatically updated when an event occurs in the same browser tab.
  • Execution report:
    • The "Reject all elements healing" action in "Healed" tab from the overall execution report section works again.
    • Data-driven sequence will no longer go out of sync with the overall execution report.
    • "Execute selected journeys" action properly launches selected journeys.
  • Goal view:
    • Sorting icon to sort journeys is working again.
    • Pasting journeys will no longer lose checkpoint data.
    • Adding step just after unsharing a checkpoint no longer shows an error modal.
    • Pasting a set of steps in the very first step now does not show the JSON.
  • Goal settings: after you set an environment on the goal advanced settings, it will show the environment that is set if you come back to this page.
  • Test data builder page: it no longer shows the same modal multiple times when editing, importing, or deleting and you switch to a different page of the application and then you come back to the test data page.
  • Manage data table:
    • Providing a description while creating an attribute should no longer be a problem.
    • Changing the order of attributes after having an attribute deleted should always work now.
  • Virtuoso bridge: Launching two bridge clients using the same name will no longer lead to a conflict on their instance.
  • Variable references: You can now use variables which start with _ in their name or their sub-parts, e.g, $_foo or $foo._bar.
  • Usage on organization dashboard: Selecting the project goal will now show the usage of that specific goal.

# Changed

  • Intelligent element selection highlight: performance of our guessing engine has been significantly improved, so you may notice a general speed-up on Virtuoso relating to identifying elements using your hints.
  • User profile settings: highlight
    • As a security measure, current password is now required for changing your email address.
    • You can now create or edit your username, which makes it easier for your colleagues to mention you in comments.
    • The user interface of the profile settings page has been improved.
  • Goal view: highlight
    • We have made numerous improvements relating to the performance of the goal screen, which should lead to fewer cases of hanging of stuttering in the page rendering.
    • Every shared checkpoint is now indicated on the product (including the first checkpoint which is always shared).
    • When you have a checkpoint open, you can simply click the checkpoint to filter the journeys by the specific checkpoint you have selected (e.g., in order to find which journeys lead to the open checkpoint).
    • Root cause analysis tab is no longer shown on steps on which there is no failure.
    • Network requests, and console logs:
      • The number of network requests in each failure category is now clearly indicated, as well as the number of network requests for the specific type of event.
      • Exception console logs are now collected and shown on the console logs.
  • Extensions on steps: When using an extension in the step that exists both as an organization and project extension, in the step side panel we indicate whether it's the organization one or the project one (to avoid ambiguity).
  • Mouse up/down commands are now supported with supplying an element. For example, you can now perform a custom drag and drop by mouse over "Element", mouse move by 50, 50, mouse up
  • Drag and drop (mouse drag to command) has been improved to make an initial small movement before moving to the target element.
  • Our date picker relative dates have been rewritten to be more clear, using "days". As an example, Past week is now Last 7 days.
  • Snapshot comparison: While using the swipe mode, the middle swipe button will now be made invisible when you're dragging the swipe slider.
  • Several confirmation modal dialogs have been reworded to make their action and intent more clear.
  • Apps:
    • "Copy to clipboard" action of app's client key, client secret, and signing secret now no longer include quotes around them.
    • Different organizations can now have apps with the same name.

# Removed

  • Old project dashboard: the main project dashboard of virtuoso has been replaced with a new view/user experience. This means that certain functionality such as the "Changes / Success ratio over time" graph will no longer be available.

# 1.18 - 2020-09-30

# Added

  • Timeline highlight:
    • Goal timeline is now available showing the latest jobs, changes and comments.
    • Changes are now detailed on the timeline, for example, when you change elements or steps, you can see in the timeline what the change exactly was.
    • You can now leave comments mentioning your colleagues by email or username, and they would receive an email, so that you can collaborate with one another.
    • You can now easily mention your colleagues by pressing @ and auto-completing their email/username.
  • Copy/paste highlight: you can now paste multiple steps in JSON format as a new step by copying the checkpoints to clipboard and pasting them into a new step input.
  • Bridge highlight:
    • Multi-cloud support: The virtuoso bridge now supports testing across our AWS and GCP cloud infrastructures.
    • Support SOCKS proxies to reach Virtuoso (new client parameter --socks-proxy).
    • Upgraded communications protocol. Requires bridge client updated.
  • Performance timeline: In your goal view, you can now view the performance timeline of your goal based on the captured snapshots at the time.

# Fixed

  • Execution planner: the date and time picker now shows the time selector.
  • Extensions: Saving inline script as extension now copies the content from the inline script to create the extension as expected.
  • Test data selection on plans: the data tables associated to a journey now are scrollable if the number of rows is large.
  • NLP parser: we have fixed the ability to author inline scripts in NLP.
  • Execution report: the side effects tab now previews lists of items in the original order they were created (before this, it was sorting the lists).
  • Navigation from a step that executes an inline script to another step of the same type now shows the correct script code.
  • The healing and continue-on-failure options on steps are now persisted also for copy/pasted steps and journeys.
  • The logout flow of Virtuoso has been significantly improved, and you will no longer face issues after logging-back again.

# Changed

  • Change to synchronization highlight: Synchronization now immediately syncs your graph and starts an execution to capture snapshots of your checkpoints. After this, your graph will automatically remain in sync and synchronization will no longer be necessary (simply start an execution with checkpoint-capture enabled).
  • Snapshot comparison highlight: the comparison tab on goal view now clearly shows the checkpoint involved in the comparison, and a comparison of your checkpoint titles and URLs between different snapshots.
  • Organization dashboard highlight:
    • You can now see the number of active projects, members, teams in your organization (as an organization owner).
    • The default sorting order has been changed to Recent (meaning either last accessed or created date depending on whether you have accessed the project or not).
  • Screenshot viewer highlight: the scroll region on the screenshot viewer is now restricted to the image itself (you will no longer go outside the bound of the viewer if you scroll too much).
  • Date selectors highlight: you can now use quick relative time ranges such as "Past week" which is a more human-friendly format.
  • Data tables: status icon of test data tables now indicate if it's in use by your journeys.
  • Timeline now always jumps to the latest/bottom.
  • Goal import: when importing goals which had shared checkpoints, checkpoints are now imported as shared as well.
  • Page loading timeout: Virtuoso now reports any problems faced while it waits for a page to load before moving to the next step in the step side effects.

# 1.17 - 2020-08-28

# Added

  • Organization dashboard: highlight
    • This is the new main dashboard that enables you to see how your projects are doing.
    • You can see the latest status of your journeys executed within the last month, this should help with understanding the state of your testing.
    • You can filter data historically, to see for instance one week ago, how your tests were doing.
    • You can now clearly see the project assets you have (e.g., how many extensions, data-tables, plans you have).
    • You can see the number of execution jobs for your current active goals over any selected date range period.
    • As an organization owner, you can now more clearly and quickly view your usage, and manage your members and teams.
  • Commenting: highlight You can now leave comments on the journey and step timelines. This should make collaboration with your team easier.
  • Timelines: highlight
    • You can now filter timeline actions by their type (execution, change, or comment).
    • On step executions, you can see the screenshot of the step (along with its before/after element interaction) for all historical executions.
    • On journey timeline, steps and checkpoints for which an action happened are now clickable and on title-text we indicate the change.
  • Customer success integration: highlight
    • You can reach out to customer success team directly from the product (see steps to enable this below). Simply leave a comment on a step or journey you are facing issues with, and mention @cs or @support along with your query. Note that by doing so, you are granting Virtuoso's customer success team access to see your journey.
    • To enable this for your organization, you need to follow the steps below:
      • As an organization owner, open the organization dashboard;
      • Navigate to Apps screen;
      • Find the @CS app, click on it, and then click Install;
      • Create a new integration user, calling it Customer Success, and provide an email for this bot user, and then click Install;
      • Once installed, click on the integration user, and on top right, change account access to Owner;
      • That's it! You can now leave a comment mentioning @cs in a journey or step timeline, to summon our customer success team.
  • Shared and re-usable checkpoints: highlight experimental
    • You can now share and re-use checkpoints in your journeys. This means that maintaining one checkpoint's steps will maintain them in every place they were used.
    • On new goals from this release onwards, checkpoint sharing is enabled by default, but on older goals you need to first Enable checkpoint sharing using the goal options on the project dashboard.
    • Checkpoints can only be re-used once in a journey (they can not be repeated in the same journey).
    • To re-use a checkpoint, underneath any checkpoint, click "New journey from here".
  • Merge checkpoints: highlight
    • You can now merge checkpoints by moving your mouse in-between two checkpoints and clicking "Merge checkpoints".
    • Checkpoint merging moves all steps from the top checkpoint, to the bottom checkpoint. Note that you will lose the top checkpoint as a result.
    • Shared-checkpoints cannot be merged (since it would have unexpected impact on all journeys). You can unshare the checkpoint first. First checkpoint cannot be merged.
  • Re-order checkpoints: highlight
    • You can now drag and drop checkpoints to re-order them (by dragging the left-most side of the checkpoint).
    • Note that first checkpoint cannot be re-ordered, and checkpoints cannot be moved before it.

# Fixed

  • Goals imported or cloned will now have their graph generated automatically. This means that you can immediately execute and capture snapshots.
  • Updating step variables using the step properties panel should no longer face a problem.

# Changed

  • Enhanced auto-scaling: highlight We have made significant improvements to our infrastructure, and improved how we automatically scale to handle your requests. In times of significant demand, it should take only minutes to see your journeys executing.
  • Captured checkpoints: highlight On project dashboard's job items, we now indicate when checkpoints have been captured. Clicking the checkpoints captured in the execution report will also take you to the snapshot comparison screen.
  • The Summary screen in goal view has been revamped to give more space to view failing requests/console logs, and to better view the performance timeline. We now clearly indicate when there are failing requests/logs.
  • Organization dashboard is now the default screen of Virtuoso. This means that virtuoso will no longer navigate you to the last active project you had. You can of course bookmark your project on your browser, or favorite it on Virtuoso for direct access to them.
  • We have renamed Integrations to Apps on Virtuoso; documentation for this might still refer to Integrations however.

# 1.16 - 2020-07-31

# Added

  • Execution report in goal view: highlight
    • Once you execute a journey, you can see its execution in the goal view right away, without having to navigate to execution report.
    • You can now not only view a journey's latest execution status (or related to the selected version of the journey) while authoring, but also view this per step.
    • The step side-panel now shows all related execution tabs, based on the latest execution of the step for the given version. This means that you can now author tests without having to leave the goal view.
  • Unified testing with capturing of snapshots during normal executions: highlight experimental
    • You can now perform executions with automatic capturing of snapshot. This works effectively as running an execution and snapshot comparison at the same time, except that they happen during the same execution.
    • Note: this feature is currently experimental and until ready, it will not trigger by default unless you explicitly enable it in execute advanced, or set your goal's default to always capture a snapshot during execution.
  • Snapshot comparison: highlight
    • Sharing the URL of a snapshot comparison will now reconstruct the viewport as you see it for people navigating to the link.
    • Comparisons can now be viewed from the goal view, and clicking on a journey will show comparisons of the pages related to that journey.
    • Leaving comments, or flagging a comparison will now update in real-time, meaning you will no longer have to refresh the page.
    • When navigating to a new snapshot comparison, the option to sort by Level of change will automatically activate when the background computation is complete.
  • Step and journey timelines: highlight experimental
    • You can now view step timelines (their changes, execution history, etc.) to better understand how they changed, by whom, and what was their status in the past.
    • You can view timeline of a journey, along with all checkpoint and step related events that happened to the journey in the past.
  • Environment variables: highlight
    • You can now create and manage environments for your projects (accessible through the left-hand side menu of dashboard).
    • Each environment contains a set of variables that become automatically available in your journeys. For example, when each of your testing environment may have a different URL, and login credentials that you need as part of your journey setup, you can set these in your Virtuoso environments.
    • Environments can be based on other environments and only override certain variables.
    • Variables can be marked as sensitive, so they can be used to store secrets (e.g: login credentials). These secrets will be redacted in side effects and will not be returned after you save them.
    • Projects and goals can be configured to use an environment by default, and you can also choose an environment to use for a specific execution.
    • Jobs executed with a different environment than the project or goal's default will be automatically tagged with the name of the environment.
  • We now support cross browser testing on macOS Catalina, along with the latest browsers such as Safari 13. New devices have also been added such as iPhone SE 2020, iPad Pro 2020 editions, and Google pixel 4.

# Fixed

  • Execution side effects:
    • Show a link when a popup was dismissed to see its screenshot.
    • JSON values are now shown again and are properly formatted.
  • Autocomplete now provides test data table variable suggestions when authoring tests.
  • Fixed problem leading to the duplication of job tags when attempting to remove them.
  • Resolved performance problem related to generation of tests after explorations.
  • Goal view - Step editor: Variable names are now validated while editing a test step variable name.

# Changed

  • Goal view: highlight experimental
    • The goal view has been revamped to provide a more streamlined user experience.
    • The hamburger-based menu panels have been changed to a clean and clear tab view.
    • Journey list is now the default view of the left panel.
    • The checkpoint view on the left panel is now always filtered by the journeys shown in the left panel.
    • Steps and checkpoints have dedicated side panels that open on the right-hand side. Note that if you need more space, you can resize each panel by dragging the center panel separator.
    • Journey tags are now clearly shown on the journey view.
    • The checkpoints in the comparison screen is filtered by the selected journey or the list of journeys on the left panel.
  • Execution report:
    • Active tab is now kept when switching from a test step to another if the tab is still available (e.g: seeing side effects from a test step, switch to a different test step that also has side effects).
  • Execute advanced dialog options now clearly provide a hint for each item.

# 1.15 - 2020-06-30

# Added

  • Intelligent element selection: highlight
    • New engine: The engine behind our intelligent element selection feature (guessing) has been re-built to reflect some of the most sought out capabilities.
    • Relative guessing: Element guessing is now performed using a more human-oriented approach, that is, each step simply is executed with respect to the context of the previous step. For example, if you have a list of 10 items with the same layout, you can simply see 'Item you wish' and then click 'Delete', which would aim to delete that specific item.
    • Breaking change: Note that because of the new engine, you may notice a change in behavior (e.g., especially if you were previously using workarounds). If you face any issues or doubts, please contact the customer success team.
    • Performance: The new engine is orders of magnitude faster than before. For stability purposes, we continue to use both engines to ensure no potential regressions have occurred in capability, but expect to turn the old engine off at a later date (and as a result, speed-up guessing in your tests by orders of magnitude).
  • Virtuoso Flow: highlight experimental
    • We are introducing a new Virtuoso integration which enables you to build custom flows against Virtuoso events.
    • Examples:
      • When my journey with name A completes, execute journey B (e.g., useful for process automation, or setup and teardown).
      • When my journey with tag X fails or has a variable value matching a condition, notify me on Slack.
      • When my plan execution completes (e.g., you can take advantage of the scheduling feature), execute one or more journeys.
    • All data context in journeys triggered from one another (journey A executed triggering journey B) are passed. This means that you can automate an entire business flow end to end.
    • We are currently launching this with the following conditions (but expect more to come): journey executed, plan executed, extension created/updated. Note that each condition can have a variety of filters (all filters need to evaluate to true for condition to pass).
    • We are also launching the following actions: Execute journey(s), Notify on slack (you can customize the message using templates), Trigger webhook (useful if you want to get notified when specific conditions pass), Wait (for a variable number of seconds), Github (store your extensions in Github).
    • To use Flow, simply install it using the Integrations tab of your organization management screen (making sure that you give the access user permission to your desired projects), and then you should be able to see it in your project dashboard's top-left context menu.
  • Test authoring and graph: highlight On new or synchronized goals, you can now see the graph get built as you add new checkpoints. This helps provide a better reflection of the tests on the graph, from the moment you write them.
  • Test execution: highlight You can now execute journeys quicker than before, and let Virtuoso take care of preparing your journeys/execution in the background.
  • Execution report: highlight Virtuoso now better indicates an execution report when a journey is queued as opposed to being executed (running). This should help with better understanding the execution process.
  • Keyboard navigation: highlight In execution report, you can navigate between selected steps simply using up/down arrows of your keyboard.
  • Step side panel: highlight We have revamped the step side panel on the execution report, such that clicking anywhere on the step opens up the panel, screenshot is immediately selected, and other sections are clearly visible as tabs.
  • UI Augmentation in Virtuoso Apps (Integrations): highlight You can now build your custom forms for the configuration. Virtuoso also stores installation configurations and sends them to your integration on every event and action, reducing integration complexity.
  • Snapshot comparison: highlight
    • Highlight: A new mode of displaying the differences between the previous and current application version screen shots has been added. This highlights any differences between the screen shots in red. Darker areas indicate minimal changes.
    • Documentation: Information about the snapshot comparison capability has been added (read more).
  • Execution side effects: When viewing JSON values in execution report, Virtuoso now shows the objects in a proper structured format to help with reviewing the data used/received (especially useful if you are testing and validating your API).

# Fixed

  • Execution report: highlight The report should no longer get stuck in progress when an execution has completed.
  • Slack integration: You will now receive notifications for all executions. Some notifications were previously being skipped due to an error.
  • Copy/paste: The healing decision (e.g., never heal this element) is now correctly restored when you paste to insert a journey from clipboard.
  • Extension archive: Archiving an extension is now properly reflecting its new name and folder.
  • Extension restore: The restored extension should now get their original name back correctly (assuming no existing extension exists with the same name).
  • Goal import: Journey tags are now correctly imported along with the rest of the goal.
  • Press command: You can now use variables with the press command.

# Changed

  • Test step properties: highlight We have revamped our step properties screen to a full-width panel with a more clear view of the possible actions. This comes with a variety of different improvements, such as a better view of the interacted element (currently available only in journeys generated by exploration).
  • Execution report: highlight In execution reports, you can now simply click any step (anywhere on the step) to see its screenshot, and other attributes of the step (as a result of this, we have removed the layout/report tabs of the report).
  • Autocomplete: highlight We have revamped the natural language auto-complete experience to better group interactions (e.g., keyboard, mouse, page interactions, validations, extensions). This should make it easier to see possible interactions.
  • Notifications: highlight Job status notifications (e.g., launch or completion of executions, explorations, etc.) now clearly indicate who performed the action, on what project, the outcome (e.g., status of an execution), and the Take me there link is now a true link which you can for example ctrl-click to open in a new tab.
  • Search by Tag: highlight You can now quickly search for jobs by their tag (with autocomplete), as well as quickly tag jobs using the autocomplete. We have also significantly sped-up the performance of job search by their tag on the dashboard.
  • Library:
    • We have optimized existing library extensions to run on pages with restricted policies on external scripts (and they should also run faster than before).
    • Drag and drop: Although Virtuoso supports drag and drop through commands, on some special pages where HTML5 drag and drop is used, they do not get triggered by browser automation. This extension overcomes that limitation.
  • Snapshot comparison: The user interface has been changed to more closely reflect other parts of the Virtuoso UI.
  • Integration actions: The interface of the data sent to integration actions has been unified with other events, to help with easier authoring of Virtuoso apps (integrations).
  • Goal View / Execution report: Relevant entities (journeys, checkpoints and test steps) will now be properly scrolled into viewport when necessary (e.g., opening a link with a step selected).
  • Integration actions payload are now also treated as events. This unification allows integration developers to follow DRY principle.
  • Cross-browser updates: We now support Firefox up to version 77, Microsoft Edge up to version 83, and on mobile devices the new Oneplus 8.

# 1.14 - 2020-05-29

# Added

  • Expression support in test steps (see Using expressions in your tests): highlight
    • Calculate values or element hints using extensions: for example write ${42 * $total + $vat} in "Price".
    • All variables in context are available automatically, for example store element text of input "Email" in email then write ${"new-" + $email} in input "New Email".
    • Full ES2019+ support from the browser (note that if you are running cross-browser tests, you need to make sure your expressions are compatible with the version of the browser you are using)
  • Extensions: highlight
    • External resources / imports: You can now import JavaScript libraries from popular CDNs (cdnjs, jsDeliver, unpkgd, and Github gists) to your extensions, without having to embed them inside your extensions.
    • Performance improvement: Significant performance improvements for projects with many extensions
    • Ability to archive (delete) scripts
    • Directives are now separated on the extension manager from the rest of the extensions
    • Ability to add description
    • You now have much larger screen for editing the extensions
  • Store element support (see the examples in the documentation): highlight
    • You can now store elements into variables (e.g., store element details of "Login" in $var), to extract their data or make further interactions with them.
    • When you store an element into a variable, or an extension you have returns an element, you can interact with the same element in later steps (e.g., store element details "Login" into $foo and then click $foo).
  • Tagging: highlight Job tags have been unified with project tags, when you associate a tag to a job it will show as a tag in the project.
  • Personal tokens: highlight Rather than having to hard-code your username/password when you want to use Virtuoso API, CI/CD, build integrations, for the bride, etc. you can now create personal tokens.
  • Authoring experience: highlight Test step now has variable auto-complete for variables created locally in the test step, this includes variables from the data-table.
  • Apps / Integrations: Events sent from Virtuoso are now signed (available in the X-Virtuoso-Signature header), allowing integrations to verify if the requests really comes from Virtuoso (see Virtuoso Integrations for more information)
  • Virtuoso Status: highlight Virtuoso now publishes the status of the Virtuoso production cluster (app.virtuoso.qa) on Virtuoso Status. You can find a link to this on the top-right of this documentation as well.
  • Cross-browser testing: We have updated our grid with latest browsers such as Chrome up to version 83, Firefox up to version 76.

# Fixed

  • Execution Planner:
    • Organization owners are now able to see Execution Plans on all Projects of their Organization even if the user has no direct access to the Project.
    • Notifications Slack URL test action fixed. You can now test again your Slack URL in the plan notification configuration window.
  • Data-driven testing: When the change of a data-table is the last change you've made, virtuoso now correctly executes the latest version of your goal rather than the one before it.
  • Test data modal: Layout problems and visibility of some checkpoint titles and step descriptions were fixed.
  • Snapshot comparison: We have made a number of improvements such as making sure images do not become blurry on zoom, that zoom in/out is available in every screen (including swipe, fade and comparison).

# Changed

  • Intelligent element selection (guessing): highlight Virtuoso is now significantly faster at recognizing elements using hints.
  • Store command: highlight We have made the syntax of the store command explicit such that you can now define whether you want to store a specific text value or an element.
    • Store full element object representation: e.g., use store element details of input "Login" in $var
    • store text content of element: e.g., use store element text of input "Login" in $var
    • store a specific value into variable: e.g., use store value "Login" in $var
  • Virtuoso Bridge: We've improved stability of the bridge when connecting bridge clients.
  • Execution plan notifications: You can now define a plan notification configuration with no users as long as you have a Slack URL defined.

# 1.13 - 2020-04-29

# Added

  • Authoring experience: highlight
    • Automatic version control: Virtuoso now manages edit/commit actions for you. Simply press execute when you have finished making changes.
    • Read-only indicator: The goal view now clearly indicates when a goal is in read-only mode (e.g., when it is an older version, or cannot be edited due to an exploration/synchronization/snapshot-comparison running).
    • Edit on latest version (previously known as snapshot): Simply click a goal on the dashboard to view its latest version and edit it.
  • Latest journey execution and change status: You can now on the goal view see the latest execution status of a journey with ability to jump directly to the corresponding execution report, and in the event that it has not been executed since the last time it got changed, the date at which the journey was changed. experimental highlight
  • Virtuoso Bridge: highlight
    • Added support for bridges over HTTP (default mode from this release onward). Previous mode, over SOCKS, is still available if needed.
    • Cross-browser and mobile testing is now supported on Virtuoso Bridge.
    • You can now easily test your local (development) environment using the bridge, and test your code using Virtuoso as it is being developed.
    • See more information about these topics on the updated bridge documentation.
  • Mobile Testing: IP White-listing and bridge are now supported for real mobile devices.
  • IP-based URL support: You can now use IPv4 addresses as part of the goal URL, e.g., http://192.168.1.42/path. You may find this particularly handy if you are using the bridge to run tests against your local development environment.
  • Extensions: highlight
    • Extension Library: We have made available our extension library available with a set of extensions you can readily add with a single click. We will be continuously adding new examples to this library over time based on your feedback.
    • Extension input arguments: Extension inputs are now always clearly indicated in the extension manager.
    • Auto-complete of arguments: The editor now suggests to auto-complete the input variables, as well as the done()/doneError() necessary for asynchronous extensions.
    • Returning elements: You can now return elements from extensions and store their details in variables (e.g., return document.querySelector('#myElement')), such that you can then use the outcome to validate details about the element.
  • Resizable panels: You can now resize the goal and execution panels by dragging the middle vertical splitter to better fit your screen.
  • Apps / Integrations:
    • Menu augmentation: You can now augment nearly every menu found on Virtuoso using actions from your integrations. highlight
    • Test events: To help with debugging your integrations, you can now dispatch test events to your integration.
  • Cross-browser/mobile testing: We have added various new devices to our grid such as latest Chrome, Firefox, Safari and Edge browser (including the new Chrome-based Microsoft Edge), as well as new mobile devices such as Samsung Galaxy S20, Oneplus 7T, Galaxy Tab S6, Xiaomi Redmi note 8, and more. (Full list is available on our cross-browser testing supported devices list)

# Fixed

  • Snapshot comparison: We have made many small fixes and enhancements to our snapshot comparison screen to provide a more robust comparison experience.highlight
  • Synchronization report: The goal view no longer breaks when the job has been cancelled or when no report is available.
  • Execution planner: You can now edit the plan's max parallelism.
  • Journey tags are now cloned to the new project when an old project version is forked.
  • Organization renaming now works as expected.

# Changed

  • Synchronization: You can now synchronize long journeys regardless of the length of your journey. highlight
  • Terminology change: We now refer to versions of a goal as version instead of snapshot, to reduce the confusion between versions and snapshot-testing (which is a capability of Virtuoso). highlight
  • Execution report: highlight
    • Improved filtering: you can now clearly see how many journeys had status of what kind, filter them out with a single click, as well as ability to search the journey.
    • Tags: Journey tags are now shown on the execution report as well.
    • Sorting: You can sort your execution report by journey ID, name, or duration.
    • Re-execute: Re-execute failed button renamed to clarify that only failed journeys are re-executed.
    • Jump to goal view: When switching to the goal view () the tooltip now indicates to where the jump is performed (e.g., if you switch while having a journey open it will indicate that it will open the current journey).
  • Variable with default: We have changed the default syntax of "default value" as $var to $var with default "default value" to avoid syntax ambiguity regarding when the text or the content of the variable are used.
  • Goal view: We have improved the goal view interface to better indicate the date of the version being viewed.

# 1.12 - 2020-03-31

# Added

  • Virtuoso Bridge: experimental highlight
    • We are introducing our secure bridge solution which enables you to create a secure tunnel against your local environment without having to expose your network through the firewall.
    • You can use the bridge to either test your local application (during development, enabling you to shift-left your testing), or to test your internal applications behind firewall.
    • The bridge client is available for all major operating systems: Linux, Windows, and MacOS. See our bridge documentation for more details.
    • Note: Given that this is the initial release of the bridge, it is currently considered experimental and your feedback is essential in shaping the future of this feature.
  • Deep variable lookup: You can now lookup and store data deeply nested inside a JSON variable. For example, if your API returns $data, you can then use $data.user.firstName as a variable to use in a Virtuoso step. highlight
  • Journey view: Virtuoso now indicates which other users are also viewing/editing the same journey you have opened. This should help with reducing the confusion as to who else is viewing/editing your journey. highlight
  • Data-driven journeys: If a journey has a data-table assigned, the first row of the data-table will now be automatically preloaded as variables when synchronizing or executing the journey in non-data-driven mode: highlight
    • For synchronization, this means that you can now synchronize data-driven journeys with data from the first row of the data-table.
    • For execution, even when you execute a journey in a non-data-driven mode, the variables will now be preloaded using the first row (which means that you no longer have to run with test data when trying to build the journey).
  • Extensions (Natural language extensions): highlight
    • Terminology: We have changed our terminology from scripts to extensions, to make it clear to our users that ability to write scripts is not necessary to use them, and to signify how easy it is to extend and augment Virtuoso's natural language.
  • Right click: You can now right click on web elements (note that this is only for when custom context menus have been implemented, and not the native browser context menu; note that Virtuoso does not show the native context menu of the browser). highlight
  • Mouse actions on current position: Supplying the element is now optional for mouse click, double click, and right click; which means that you can now perform these actions on the current position of the mouse (note that mouse click and click are separate commands as described in the natural language guide).
  • Tagging:
    • You can now tag journeys from inside the journey.
    • You can now bulk-tag multiple journeys by selecting them on the journey list.
    • Project tags are now cloned when you clone the project.
  • Integrations - Rocket shop: You can now create your own custom rocket shop environment. You may have to install the integration first in your organization if it hasn't been done yet. Then you will find the Rocketshop Instances option underneath your project's more options menu.

# Fixed

  • Stability: You should no longer see a message marked as skipped without further information when Virtuoso fails to execute it. highlight
  • Auto-complete: When executing natural language extensions (scripts) with ordered parameters, the auto-complete will now correctly indicate the need for comma between the arguments.
  • Goal import: Scripts and data-tables imported alongside a goal should now automatically appear after the import has finished, without requiring a browser refresh.
  • Blank script names: Users are no longer allowed to create scripts that have names consisting in whitespace.
  • Plan notifications for Slack: The goal link on the slack notification is now fixed.
  • Execution report: You can now see the failure report when execution is still in progress but has only partially completed.
  • Integrations: Uninstalling an integration that has no webhook URL no longer fails.

# Changed

  • Dashboard project activity: highlight
    • You can now direcly filter by a single job type by using their icons in the job filter, or toggle them individually by using the checkboxes in the expanded list.
    • We have improved the timestamps on the project activity to better indicate the time of execution.
    • The number of journeys, as well as the failing journeys, is now clearly shown on the log.
    • The execution animation now displays job activity more clearly.
    • Jobs can be now stopped by hovering the status indicator, which will change to a stop button.
  • Execution report: The report is now immediately updated as soon as journeys are executed. highlight
  • Performance: We have improved the performance of executing your journeys, so you may notice a considerable performance improvement overall. highlight
  • Assert equals: On assert equals/not equals, Virtuoso now normalizes the whitespace in the compared text values, according to web standards (W3 Spec). This should reduce unnecessary comparison errors when the underlying page has multiple spaces in the text. highlight
  • Tagging: When forking a goal, corresponding tag references are copied as well; that is, if you remove a tag in a goal you have cloned, it will not impact the journey on the original goal.
  • Content of dropdown elements: When storing content of a dropdown or asserting against its value (<select> field), Virtuoso now uses the value of the selected option (or empty text if no option is selected).
  • Checkpoint view: Virtuoso now clearly indicates how many journeys are associated to a checkpoint.

# 1.11 - 2020-02-26

# Added

  • Virtuoso Integrations:
    • Virtuoso now provides the foundation to easily build and register apps on Virtuoso that integrate with Virtuoso events (see integrations documentation for details). highlight
    • We now provide our full REST API documentation, which you can use to integrate with Virtuoso, or to create custom integration apps (see API documentation for details). highlight
  • Natural language: Execute test step parameters can be typed by order, for example: sum ($price, 42) returning $total highlight
  • Snapshot comparison:
    • It is now possible to review a comparison by marking the change as expected/unexpected highlight
    • You can now leave comments as you review a snapshot comparison (on any point on the changed screenshot) highlight
    • It is possible to order snapshot comparisons by the magnitude of difference between the screen shots of the old and new states. This is only possible on snapshot-comparison jobs where the difference calculation has finished, and the calculation starts when navigating to a snapshot comparison. experimental
  • Organization management: You can now remove users from your organization.

# Fixed

  • Project cloning: You can now clone projects that have scripts and/or test data.
  • Natural language autocomplete: while creating an Execute test step the arguments are now correctly suggested.
  • Organization owners can now check details about their own access level to a project and change the direct access level.
  • Contextual menus will adapt better and overflow the viewport less often at lower resolutions.

# Changed

  • Scalability: We have improved scalability, stability, and reliability of Virtuoso when processing your jobs (e.g., executions, exploration, etc.) to better handle demand without impacting service availability. highlight
  • Directive: The performance of the default directive of Virtuoso has been optimised and now automatically interacts with the buttons on the page as well. Note that you can always change and/or extend the directive behavior yourself.
  • Documentation: We have reorganized and revamped this guide in certain areas, to make it easier for you to find sections.
  • API deprecation notice: Virtuoso API will soon no longer envelope messages by default. We advise you to add ?envelope=false to your API queries, such that when we make this behavior default in the future, you would not face an issue with our API interface.
  • Context menus: We have better organised goal menu options into relevant sections, to make it easier to identify the options.
  • Icons: We have revised few icons such as copy, paste, clone, etc. to better indicate their actions.

# 1.10 - 2020-01-30

# Added

  • Tagging highlight:
    • You can now tag your journeys using the options menu of journeys ();
    • When viewing the list of journeys, you can search journeys by tag (e.g., single tag tag:generated, multiple tags tag:critical tag:payment, tags with spaces tag:"Order scenario"), and you can even exclude journeys by their tag (e.g., -tag:generated);
    • You can manage your tags at project level, using the more options settings of the project;
    • Tip: Unicode Emojis are also Supported!
  • Automatically tagged journeys: Every journey generated using Virtuoso is now tagged generated. highlight
  • Execution report:
    • You can now view side effects of your journeys summarized in a dedicated side effects tab. highlight
    • Interacted element: You can now see the element that was interacted with during the execution, using the element view under the Layout tab (Note that this feature is experimental, and is not available on certain browsers such as IE11 and mobile devices; please report any cases where you believe the highlighted element is mispositioned). experimental highlight
    • Healed element screenshot: When an element is healed, you can now see a screenshot of the healed element. highlight
  • Directives:
    • Ability to fill forms: You can now automatically generate directive instructions to fill forms. See the updated examples. highlight
    • Ability to extend Virtuoso's default directive: Your directives no longer have to completely override Virtuoso's default directive, and you can simply extend the current behavior. Checkout our documentation for an example of this. highlight
    • Skip exploring unexpected pages: You can now skip exploring further pages that should not be explored (e.g., if you link to your Instagram page, you may not want to explore that Instagram page further).
  • Snapshot comparison highlight:
    • There is a new Comparison mode under the Overlay comparison feature which enables you to view the differences between the two screenshots;
    • It is now possible to change the opacity in the Fade comparison mode to seamlessly blend between the two screenshots;
    • Snapshot comparison interface has been improved, and you can now reset the positions of both screenshots.
  • Organization management: You can now see exactly how a user has access to each project (e.g., a user can be member of multiple teams and/or have direct access to the project), and manage the users access accordingly.
  • Cross browser testing: We've added various new devices (iPad 7th Gen, Galaxy S10e/Plus, A10, Pixel 4), as well as new updates to our browser versions (Chrome, Firefox, as well the new Chromium based Microsoft Edge).

# Fixed

  • Write command (appending): appending text to existing fields now correctly appends text even when the text field automatically highlights the content. Our natural language interface will also now correctly indicate when a write is appending.
  • Long text content in steps: Our natural language interface will now soft-wrap long text, to avoid text from overflowing or to become hidden.
  • Plan notification alert: Adding an invalid user to be notified now shows an error.

# Changed

  • Natural language authoring:
    • Executing scripts (language extensions) no longer requires an execute prefix. highlight
    • When adding a new step, there is now clear buttons to discard/save the step (in addition to the "enter" key).
  • Goal URL prefix: You no longer have to type https:// when creating your goal (and you can switch between http/https by clicking on the prefix).
  • Native alerts: Our default behavior towards native alerts (alert(), confirm(), prompt()) has changed, and we no longer by default dismiss them (you need to explicitly dismiss them).
  • File upload: You can now upload files up to 8 MB in size.
  • Exploration: Virtuoso's intelligent graph consolidation and performance/stability exploration process have been improved.
  • Browser Header: Virtuoso bots now send a default Accept-Language header set to English language.
  • Registration: Username is no longer requested as part of the registration/login process.
  • Mouse out command: When using mouse-out, Virtuoso will now intelligently try to exit an element's bounds via the most effective direction (e.g., out of the bottom if the element is at the top of the page).
  • Graph consolidation: The graph consolidation screen (formerly called state matching) has been improved to more clearly show the possible options.
  • Self-healing panel: The healing side panel on execution report has been improved to distinguish between when Virtuoso has already healed an element and is pending feedback on the action, and when it is suggesting a healing which can be applied by accepting it.

# 1.9 - 2019-12-18

# Added

  • Organization management: highlight
    • Usage and statistics: you can now view the usage of the organization with respect to journeys executed, and snapshots captured. The data can be broken down by project, goal, type of job, and date.
    • Member and permission management: you can manage the members who have access to your organization, invite new members, and to add them to specific projects and teams.
    • Team management: you can create teams within your organization, and grant access to projects in bulk.
    • Granular permission to project: You can grant read/write/manage project permission to members/teams.
  • Project sharing: When sharing projects, you can now specify granular access permissions. highlight
  • Exploration: You can now see the similar checkpoints which were discovered during exploration and override Virtuoso's intelligent state matching. highlight
  • Dynamic / Data-driven elements: You can now more easily target elements dynamically by using variables in natural language. e.g., click $item or see element $content. highlight
  • Directives: You can now generate random data in your directives (e.g., this.getRandom('name')). See directive documentation for more details. highlight
  • Natural language: The autocomplete suggestions have been improved to automatically suggest quoted parts of the text, e.g., write spotqa virtuoso in product name is suggested as write "spotqa virtuoso" in "product name".
  • New devices and browsers for cross browser testing: iPhone 11, iPhone 11 Pro, iPhone 11 Pro Max; as well as latest versions of Chrome and Firefox.

# Fixed

  • Legacy browsers: We have resolved a number of issues related to legacy browsers such as IE11, which should mean better element recognition and faster executions. highlight
  • Snapshot comparison: When comparing snapshots, the accuracy of the zoom pointer has been fixed.
  • Project cloning: Cloning projects should no longer fail.

# Changed

  • Journeys and checkpoints view: The frontend interface of viewing journeys and checkpoints has been updated to make it easier to select, delete, copy/paste steps. highlight
    • You can now more easily rename journey and checkpoint names.
    • You can now more easily delete steps across checkpoints (and delete any selected checkpoints).
    • Checkpoints that have been synchronized or are pending synchronization are now clearly indicated on the journeys.
  • Exploration performance: scalability and performance of Virtuoso's explorations has been improved. highlight
  • Cross-browser testing performance: performance of our intelligent element selection (guessing) has been significantly improved. highlight

# Removed

  • Real device execution: the browser type of mobile devices has been removed since it cannot be configured. The main browser is device is always used for executions (Safari for iOS and Chrome on Android).

# 1.8 - 2019-11-28

# Added

  • Cross-browser/mobile device testing is now supported from Virtuoso's fixed IP. highlight
  • Documentation: You can now access documentation related to Virtuoso or relevant page by clicking on the top-right ? icon (and you no longer have to login to our docs). highlight
  • Natural Language: you can now use mixed string quotes, e.g., see 'don\'t' (same applies for double quotes).

# Fixed

  • UI Performance: we've made a series of performance improvements, and in particular, resolved few memory-leaks in the product. highlight
  • Snapshot comparison: the menu item tooltips no longer flicker on hover.
  • Test data model now can be opened on old snapshots.
  • Creation of test cases from clipboard no longer appends a copy marker text.

# Changed

  • Self-healing: Element changes are no longer applied automatically when Virtuoso has low confidence in the healing. You can simply apply the changes by accepting the healing. highlight
  • Import/Export: Exported goal journeys can now be imported directly as a goal (without having to create a goal first).
  • Project sharing: you can now unshare a project.

# 1.7 - 2019-11-20

# Added

  • Self Healing: You have now full control over element healing, with ability to provide feedback about healed elements (accept/reject). highlight
  • Execution Planner: you can now fully edit execution plans and their associated journeys/devices. highlight
  • Drag and drop: You can use mouse drag to x,y (or "element") / mouse drag by x,y to drag the mouse from the current location to another location/element. highlight
  • Execution Report - Step side panel: Each step with a side effect or healing event now has a dedicated side panel which presents the information. highlight

# Fixed

  • Dashboard: Job links can now be interacted as standard links (copying, opening in a new tab, or any other related action). highlight
  • Snapshot testing: launching snapshot-testing for goals without a graph is no longer allowed.
  • Snapshot management: floating tooltip will now display properly the scrolling date.

# Changed

  • Project invites for existing users are auto-accepted and an email is sent to the user email with a link to the project. highlight
  • Data-driven testing: Importing data tables now completely replaces (rather than appending) the table data by what comes in the imported CSV file. highlight
  • Execution report: The execution report has been significantly improved to resolve numerous usability problems such as reporting failures from data-driven journeys.
  • Scripts: switching scripts or navigating away from the page will warn you in case there are pending changes to avoid losing them.

# 1.6 - 2019-10-29

# Added

  • File Download: You can now download files in your journeys, which also gets saved into a variable named $LAST_DOWNLOADED_FILE (this feature is only supported in Virtuoso Chrome). highlight
  • Element self-healing: You can now mark elements to not be automatically healed, using the "Never heal this element automatically" option in the step properties. highlight
  • PDF Testing: Support for viewing and testing PDF files (see docs). highlight
  • Cross-Browser Testing:
    • You can now use any desired resolution —up to the maximum allowed by the selected environment OS— when performing an advanced execution of a Goal. highlight
    • New browsers and real devices are available to test with (e.g., iPhone XS, Galaxy Note 10+, latest Chrome and Firefox updates, etc.).
  • Data-driven testing: when data-driving a journey with a data-table, all columns of the data table will also be automatically available as variables in the context of the journey. For example, if you use url as a column name, it becomes available as $url. Note that any non-alphanumeric character (e.g., whitespace) automatically turns into underscore (e.g., item price becomes item_price). highlight
  • Goal Import/Export: You can now export all goal journeys, and import them into another new goal.
  • Continue on all failures: On assertion steps' properties, you can now set whether execution should continue executing whether the steps below fail for any reason, for unsatisfied assertions, by toggling the option "Continue if assertion condition is not met".
  • Maximum parallelism at goal level: you can now define as an advanced configuration the maximum number of parallel journeys run across all running activities (e.g., explorations, executions, etc.). This would supersede any limit defined on the job itself.
  • Default parallelism: as part of your goal's advanced configuration, you can configure the default max-parallelism limit of individual activities (e.g., exploration, execution, snapshot testing) will take, but it can be overridden (e.g., at the time of launching an execution).

# Fixed

  • Dashboard:
    • Job date filtering can now be set to a single date by picking a day and clicking outside the calendar;
    • Jobs triggered by a scheduled plan now will display Virtuoso Planner instead of Not available in the job info card;
    • Performance improvements when loading goal jobs.
  • Variables can now be deleted from steps in the test step properties panel.
  • File upload is now supported in Internet Explorer.

# Changed

  • Pressing keys: You can now press keys against the active element on the document. You can also send a sequence of keys separated by space. See the updated documentation for the press command. highlight
  • Synchronization:
    • Only changed/synchronized journeys will be synchronized, which can significantly speed-up the process.
    • On the exploration view of the goal, you now have the option to Synchronize from Scratch, to overcome any synchronization issues.
  • Natural language: Our auto-complete should now provide more relevant suggestions with reduced noise.
  • A strict max-execution time of 4 minutes per step is now enforced.
  • General interface changes:
    • Dropdown selectors now have a clear button that allows the selection to be removed without needing to look through the options;
    • Datepicker has been redesigned and now allows months to be directly changed using a dropdown selector.
  • Execution Planner: highlight
    • The pages for adding and editing executions plans have been completely reworked to improve their usability and performance;
    • Creating a plan will be performed in the current active project;
    • Goals, snapshots, and selectors related to the device hive are now searchable and navigable via keyboard;
    • Journeys are now shown in proper order both when creating and editing a plan;
    • Environment and browser icons are now properly displayed when creating and editing a plan.
    • Trying to update a plan with a recurrence start date in the past will now suggest a new future date instead of failing.
  • Scripts: You can now easily clone a script to the same project by clicking on the script's clone button and selecting the first option available in the dropdown selector: (Current project).
  • Cross-browser testing: Screen resolutions on our cross-browser testing now tries to reflect the more closely the Virtuoso screen sizes. However, if resizing beyond the supported screen resolutions (see limitations), Virtuoso automatically maximises to the maximum supported resolution.

# 1.5 - 2019-09-20

# Added

  • Directives (alpha experimental release): Directives bring the power to automate the automation! As an automation engineer, you can can change and direct Virtuoso on how to explore and discover your application at scale, and to generate tests. The possibilities for this are endless. This is an experimental release of this feature, and this capability and the interface may significantly change in following releases. (read more) highlight experimental
  • Ability to merge checkpoints on the graph highlight experimental: you can achieve this by first selecting a page on the graph, and then right clicking on another page on the graph and then clicking "Merge selected checkpoint into this". Note that this removes the checkpoint that you merge into, but does not currently remove its corresponding journey (you can remove that manually).
  • Ability to capture a new snapshot of one or more specific checkpoints (via the context-menu triggered by right-clicking the checkpoint on the graph, or by selecting the checkpoints on the checkpoint-view and clicking the capture button). highlight
  • Ability to copy a human-readable version of the execution/failure report of a selected step from execution page (e.g., to include in an issue tracker).
  • Support for disabling intelligent checkpoint consolidation (via goal advanced settings).
  • Support for disabling same-origin enforcement at browser level (via goal advanced settings). For example, you can make API calls to external sources outside the origin the page is running at.
  • Support For center positioning of element (e.g., click on center "Buy" will click on the middle buy button between three buy elements).
  • Test Data Page: highlight
    • Ability to build the attributes and data directly from the View tab;
    • Added support for sorting data table rows while filtering;
    • Ability to add additional blank rows in the View tab.

# Fixed

  • Selecting elements via their position (top right "Login", bottom "Buy") now refers to the element with the greatest match to the position (e.g., the most-top-right "Login" element). highlight
  • Failed, data-driven, or cross-browser test steps no longer self-heal elements.
  • Execution plans now shows the Safari icon instead of Chrome icon in all configurations with Safari.
  • Rollback goal to an old snapshot no longer leads to an inconsistent state that demands a browser refresh.
  • Update of a webhook no longer always changes the list of events of interest to 'Send me everything'.
  • Other webhook events than executions are now correctly triggered.
  • The option to clone scripts to other project was redesigned and should allow to select the destination project again.
  • Exploring a goal that has an uncommitted snapshot will only ask once regarding committing the snapshot.
  • Project activity statistics were fixed and no longer compute all finished jobs as passed.

# Changed

  • Page layouts are now unified between Dashboard, Script manager, Data table management, with the ability to select a different project. highlight
  • Snapshot-comparison is now shown for all tasks that change the graph snapshot-testing, synchronization and further-explorations. highlight
  • Our bots no longer allow more than 15 selectors on an element to avoid excessive selection time.
  • Browser versions are now sorted while adding device configurations to plans.
  • Improved tooltips and their visibility (instant appearance on hover) in many areas of the interface. Note that some areas of the product will still continue to use the browser's native tooltips.
  • Redesigned exploration panel selector to increase its usability: size has been increased and the labels for menu items are always shown.
  • Test data page design, usability, and overall performance improvements.
  • Wait commands longer than 2 minutes are no longer allowed. If you do require longer waits, please break them down into separate wait steps.

# Removed

  • Snapshot comparison view button on dashboard; each goal now has its own comparison button inside their view.

# 1.4 - 2019-08-02

# Added

  • Real mobile device testing: You can now execute tests on real Android and iOS devices. Using the same Execute Advanced menu or the device configuration on plans, you can now choose real devices with operating systems iOS and Android. highlight experimental
    • Note: these real devices can be significantly slower than other custom environments, and so, please avoid executing large and long journeys on them.
  • You can now export your goal journeys as Selenium tests (read more). highlight experimental
    • Simply click on the more options icon beside a goal on dashboard and click "Export journeys in Selenium". This does not (and will not) include any intelligent aspects of Virtuoso (e.g., self-maintenance, intelligent element selection, self-correcting element interaction mechanisms, etc.).
  • Significant expansion in cross-browser support. This includes older operating systems (e.g., Windows XP) and browsers (e.g., Internet explorer). highlight experimental
  • Support for non-standard languages and font families such as Chinese, Japanese, Cyrillic, etc.
  • When browsing a goal, you can now see the selected page highlighted above, switch to next/previous pages on the list, deselect the page, or jump to the page's URL. The page navigation on the graph is now removed as a result.
  • Webhook events for snapshot testing and synchronisations (see more on Webhooks - Event types).
  • Bulk plan execution support: you can now select multiple plans and execute them using the more options menu besides the "Plans" title.
  • You can now select multiple journeys to execute (or perform advanced execution on). More bulk-journey actions will come in following releases (e.g., delete, copy, etc.).
  • Added input unit in plan notification configuration (e.g., % of failed journeys).

# Fixed

  • Uploading files is now working when executing tests cross-browser.
  • Some back buttons in the UI sometimes lead to an endless loop, this should no longer occur.
  • When a goal is created in a project, other users in the same project should now automatically see the goal appear in their dashboard.
  • It is now possible to delete the value of a write test step if it has a variable assigned.
  • assert select now provides a message with the correct expected and actual selection value in the execution report.
  • Exploring further when one ore more journeys have been deleted should no longer lead to a failure.
  • The failure report is now working as expected for executions of journeys for which some steps/checkpoints were deleted in the past.
  • Switching between devices on a cross-browser plan execution no longer resets the state (you can stay on the step/screenshot and switch between different devices to see differences).

# Changed

  • Significant improvements to our intelligent natural language guessing to reduce its case sensitivity (it is still advised to use the correct casing as represented in the HTML of the page). highlight
  • Dropdowns in the execution planner, scripts and test data screens have been updated to allow search and keyboard actions (we will be transitioning all dropdowns to this style).
  • Significant improvements in the performance of execution page, to update similarly as quick as dashboard progress updates (rather than periodic loading).
  • Slack notifications for plans have been improved, and a further red/green bar is added for improved visibility of indicating whether executions failed or not.
  • Scripts that are currently in use can no longer be deleted. We will provide functionality in the future to be able to archive these scripts.
  • Resolution configuration has been removed from plan cross-browser execution options on plans (this was only due to a technical limitation which we have resolved). This now automatically matches the goal device size. However, for mobile real devices (Android/iOS), there is only a fixed configuration (the size of the selected device) which cannot be changed.
  • Now execution reports show more clearly the device used to perform an execution.

# 1.3 - 2019-06-12

# Added

  • Execution plan notifications:
    • Layout updated following the overall change in progress in the Virtuoso layout;
    • It's now possible to visualize who are the members that are part of the project and will receive a notification in case a condition is met;
    • It's now also possible to integrate with Slack and test the slack webhook incoming url.
  • Execution plan's title and scheduling can now be edited (option available on the dropdown menu of the plan).

# Fixed

  • Sync report now waits for all the information needed for the report to load before removing the loading modal.
  • The responsiveness of the controls in the snapshot comparison page has been improved (controls and swipe interface are no longer overlapping and controls are not shown as disabled when they are selectable).
  • Test executions that fail due to a timeout will now show partial progress.

# Changed

  • Attempting to invite a user that does not belong to the project's organization will give an error message. Also, cross organization invitations that have not been accepted can not be accepted.
  • Scripts management page was updated to the new designs.
  • More hint options can now be opened without requiring an editable snapshot (changing the values still requires an editable snapshot, but now it is possible to access the information provided in the modal even in committed snapshots).

# 1.2 - 2019-05-09

# Added

  • Ability to explore further from pages inside the graph. For example, if after capturing a new snapshot new links are added to a page, you can now explore from that page to discover the new links. highlight (Note - If you have a goal that has been explored before the 1.0 (GA) release, you must synchronize it before you perform any further explorations. Otherwise, your tests can get duplicated)
  • Synchronization jobs now show their progress on the project dashboard. highlight
  • Plan notifications: highlight You can now add automatic notifications to be sent when a condition is met (e.g., execution status is success/failure, or the success ratio is above/below a certain percentage). This can be particularly useful if you have scheduled executions that you want to be notified about.
  • Ability to set a custom starting URL for executing journey(s) against different environment/URL (via Advanced execution) highlight.
  • Interface now should update when another user does changes to the test data table and data driven associations.
  • Test data page:
    • Ability to clone a test data table to another project (can target the same project);
    • Tab Assigned to allows the user know the snapshots in which a test data table is being used;
    • Tab View test data now also allows the user to rename or create test data attributes.
  • Ability to add custom HTTP headers to execution and exploration requests. This is only possible via our API. Given that this is an advanced feature and is mainly useful for complex integrations, please contact our support team for more details on how to use this feature.

# Fixed

  • Project names should no longer be incorrectly truncated.
  • Create my first journey manually text no longer overflows the button element.
  • Double clicking on notification toggles in user settings no longer causes it to keep alternating states.
  • User that launched the job should be present again in the project dashboard job details if the job was launched by a user.
  • Jobs of archived goals should now only be shown when show archived goals is activated.
  • Attempting to delete the first test step of the first checkpoint now shows the error message indicating that the operation is blocked currently.
  • Usability improvements to the page snapshot comparison page and header snapshot selectors are always visible even with pages with long titles.
  • Creating from clipboard should no longer leave empty test step boxes.
  • After creating a goal the user has to either explore or choose to create the initial journey before being able to create journeys/checkpoints from clipboard data using the keyboard shortcuts.
  • Synchronization job should no longer fail if the journeys contain window resize commands.
  • Execution plan creation dropdown no longer overflows out of the browser window in non full hd resolutions.
  • Project snapshots page dropdown elements now invert the arrow icon when open.
  • When a goal is reverted to an earlier version, the latest version of the goal is now correctly updated on dashboard.
  • When forking a project or snapshot, the newly created project will have its scripts and test data cloned too.

# Changed

  • Exploring further no longer overwrites existing tests, and simply augments new journeys. highlight Note that explorations performed before the 1.0 (GA) release must be synchronized, otherwise this might lead to duplicating your journeys.
  • Performance improvements for loading the summary panel of the exploration page.
  • Performance improvements for exploring further.
  • Error messages were reviewed to use the terms journey and checkpoint.
  • After creating a goal, before the user chooses one of the options to explore or create first journey manually, the top right buttons are now disabled.
  • Changes in test data table rows need to be saved or discarded before changing tabs.
  • User can now open the Manage test data modal (without allowing changes) even if the snapshot is committed.
  • When Virtuoso's backend is not available, a correct corresponding error is now produced instead of "Login failed" or similar errors.
  • When cloning a project the timestamp associated to the cloned project will be when the operation is performed (this does not affect previously cloned projects).

# 1.1 - 2019-04-15

# Added

  • New dashboard design. highlight
  • Ability to delete test data tables in use, removing all associations between test steps and the test data table. highlight
  • All exploration summary initial elements now have tooltips.
  • Network and console logs for failures in execution tab: When a step fails, the root cause analysis section now contains screenshot, source, network and console logs. This only applies to new executions following this release.

# Fixed

  • Mismatch between captured snapshot and page comparison pages.
  • Exploration no longer shows constant reloading animation while an execution is running for the same goal.
  • Create from clipboard is now able to create Execute test steps with scripts called by name.
  • Navigating from the execution report to the associated exploration now opens the journey panel.
  • Test data page:
    • Delete test data row icon no longer follows mouse scroll;
    • Total rows count now shows the correct number based on the selected table.
  • Deleting a test step should now refresh the journey correctly.
  • Deleting a test step from the first checkpoint should be correctly reflected on all journeys.
  • Rollback to previous snapshot on a goal should present the information about the snapshot created by the rollback without needing a page refresh.
  • Reduced layout/style inconsistencies on the Virutoso user interface.
  • You can now create checkpoint from end of first case (only creation from middle/above the first test case is now prohibited).
  • Attempting to create aditional journey without exploring the goal should now be possible (make sure you sync after).
  • Snapshot diff should no longer present blurry or incorrect resolution thumbnails.

# Changed

  • Look and feel changes and improvements across Virtuoso highlight
  • URLs syntax was updated reflecting the terminology changes to journey and checkpoint.
  • Test data improvements:
    • Several adjustments to the test data user interface following feedback provided;
    • Import from CSV file now restricts accepting the file selected to the csv extension.
  • After adding a valid test step a new test step field is now shown allowing to continue adding without having to click. highlight
  • Improvements to interface responsiveness when multiple requests are performed in a row.
  • When performing a synchronisation in an editable snapshot, a user prompt is now presented allowing the user to commit instead of error message.
  • The original "Explore" option on the goals now dynamically changes to the possible action: Synchronize (if snapshot is not committed), Explore (if goal hasn't been explored), or Capture a new snapshot (if a snapshot exists for goal). Note that if you want to capture a new snapshot, it is important that you have synchronized first.
  • Stability improvements when using non-default device configurations.
  • Improved stability of synchronisations and snapshot comparisons.
  • When changing execution sequences (result of data-driven testing), the selected step remains selected.
  • Notification icon now only appears when a notification is present, and disappears after a few seconds when no notifications are shown.

# 1.0 - 2019-04-01

Terminology changes

This release contains changes to some of our terminology, particularly, we introduce the concept of journeys and checkpoints. See the changed section for more details.

# Added

  • Synchronization : highlight experimental
    • Changes made to your journeys can now be applied to your graph using the Sync option on the goal list. You can then extend the graph using exploration to combine authored journeys with automatic explorations.
    • Note: synchronization has not been mandatory in this release to enable evaluation of it, however it will be in the future releases.
    • Warning: due to synchronization requirements, the first checkpoint (formerly called test case) in all journeys (formerly called test suites) must now be in-sync, since they represent the root of the graph. This means that changing the first checkpoint may now affect other journeys. Please see synchronization documentation to see how you can apply this fix across all your journeys.
    • See the Documentation on syncing for information on how synchronization works
  • Snapshot testing highlight - You can now capture a new snapshot of your graph, with same exact structure as it is. Virtuoso creates a diff report that helps you compare the snapshots of your pages (checkpoints). Note that the snapshot comparison has been made intentionally highly-sensitive to any change on the page/comparison, and so it may flag changes when nothing of importance may have changed on the underlying page (that is, in these cases, this is currently expected behaviour).
    • Note that on snapshot comparison, while we still allow comparison of arbitrary snapshots, this is going to change to only snapshot-pairs for which snapshot-testing was triggered.
  • Execution planner (See docs for more details and see known issues): highlight
    • Create plans with a mix of device configurations, data-driven testing and journeys for the frequent configurations used;
    • Plans can be scheduled at creation to be automatically executed by Virtuoso with a certain frequency;
    • Executed plans will present metrics regarding the latest executions, grouping information from all the device configurations associated.
  • Test data management (Head over to the updated Data driven testing section of the docs to learn more): highlight
    • You can now create, edit and manage your test data all inside Virtuoso (i.e., without needing to import CSV files);
    • You can now assign test data attributes to test steps in the same modal where you assign a test data table for a journey.
  • Popup auto-dismiss highlight - If an unexpected pop-up appears while Virtuoso is trying to click an element, Virtuoso will try to automatically dismiss the pop-up, and continue. If you find more cases where this feature does not work, please open an issue so that we can improve this capability.
  • Assertion support for variables, with comprehensive support for checks: assert $myvar contains "some text" (See the docs for more details)
  • Dynamic element selection using variables highlight - To target elements dynamically, open step properties, and under your hint selector click More hint options, and in the pop-up that opens, add a variable name. If the variable is set in a previous step in the journey, it'll be used instead of the clue of the selector. Note that this also means that when the variable is available, other selectors will be ignored.
  • Automatic element healing highlight - Step elements now get automatically healed as you execute them. When healing elements, Virtuoso looks at previous insights it had about an element, and it can automatically skip selectors if the element to be selected does not closely match with what Virtuoso expects. However, if an invalid element is selected, you can Forget element on the step properties panel, to make sure that Virtuoso will not try to heal the element to become what it had recognized it before. Note that currently, no existing selectors will be removed, and only new ones will be added.
  • Execution side effects highlight - when executing a step, Virtuoso will now record any side effects or contextual observations that may be relevant to users. You can view them by clicking the icon beside the steps that have side effects. These include:
    • Warnings: while Virtuoso may be able to execute a step successful, sometimes it may try to resolve issues autonomously. These decisions may have unexpected side effects, and so can be valuable to help identify unexpected issues/behaviour. However, in most cases, these warnings are safe to ignore.
    • Variable usage: When a variable is set or used, the value is recorded at the time of usage, to help with debugging.
    • Files downloaded: If a step triggers a file to be downloaded, it'll be reported here. (note: while Virtuoso now supports downloading files, we have intentionally disabled it for the time being, until we evaluate potential performance implications of enabling it on our cluster).
    • Popups auto-dismissed: If a pop-up auto-dismiss was attempted, it'll be reported here.
  • Ability to create Checkpoints from in-between steps: You can now split a long journey into smaller groups of steps by checkpointing in-between steps. Checkpointing in-between the steps of the first checkpoint is currently not supported.
  • Ability to create test suites without exploring -- via either the interface or the extension: highlight
    • On Virtuoso dashboard, after creating a goal, you can click the goal to see two options: to explore the goal or to create your first journey manually. Once you're done building your journeys, you can click "Synchronize" to synchronize your journey.
    • For building via the extension, you can create your goal on the Virtuoso dashboard, and then go ahead and record your journeys. Note that in this scenario we'll still create an empty "First journey", that you can extend manually too. Please do not forget to synchronize your journeys after recording them.

# Fixed

  • Forking a snapshot no longer creates duplicate edges.
  • Fixed performance degradation when opening execution pages with many failures (this only works for new executions following this release).

# Changed

  • Changes to our terminology:highlight to simplify the Virtuoso language and concepts
    • Overall: For each goal, the test structure is comprised of a set of journeys, where each journey has a number of steps separated by checkpoints. Checkpoints result in a node on the graph (after they're synchronized).
    • Test suites => Journeys: From the beginning we have been internally referring to a test suite as a journey, test, scenario, and so we decided to adapt this terminology to the product.
    • Test cases / page states => Checkpoints: Each journey is a sequence of steps that takes the user from the starting point to a final state. These sequences of steps can be separated by checkpoints (like saving your state in a game). Each checkpoint will be represented on the graph as a node. Virtuoso understands checkpoins as page states as well and will keep monitoring for changes on every snapshot testing executed.
    • Starting checkpoints: Each journey must now start with the same checkpoint (this allows us to synchronize your changes with the graph). If you want to start your journey from another URL, you can use a navigate step in the next checkpoint in the journey.
  • Snapshotting behaviour changes: highlight
    • Although snapshot versioning still remains at project level (to enable users to evolve their goals in parallel), snapshot management works at goal level.
    • Goals can now be changed (e.g., edited, committed, rolled back) in parallel without affecting each other. This means that different users can now work on different goals of a project without clashing with each others' work.
  • Improvements in test data editing:
    • Test data row reorder and deletion now demands a confirmation via save button to be sent to server
    • Detection of a test data value change does not wait until focus change anymore. Discard and save buttons are enabled as soon as the first character is changed.
    • It is now possible to create rows where all attributes have no values
  • The panels for viewing checkpoints (formerly called pages) and journeys (formerly called suites) have been separated to enable direct access to journeys page. Search for journeys is also now available on the journeys page when no page is selected.

# Removed

  • Explore-further from suite: This has been replaced with the synchronization mechanism.

# 0.15 - 2019-03-08

# Added

  • Data-Driven testing (See docs for more details): highlight
    • Manage test data using the Test data icon on the left side of the dashboard;
    • Assign test data tables to test suites and then attributes to test steps;
    • Use the advanced execution options to run with test data (this can be done both for an individual suite on exploration page, or all suites via dashboard);
    • Execution report test suites shows a pagination of sequences of executions that were driven from test data.
  • Support for throwing errors in async language extensions (Please See the docs for more details).
  • Test suites can now be copied to clipboard. Complete test suite copy is available on the page's tests or test suite context menus, while partial copy of a test suite can be achieved by selecting the test cases to copy.
  • Support for CTRL+V and CMD+V to create a test case and test suites based on information on the clipboard. This shortcut needs to be used after opening the page suites or test cases without editing any other field (editing a field will capture the clipboard's contents to assign a name to that field).
  • Execution report now shows the browser configurations as well as the date/time of the execution.
  • Official support for external whitelisting of Virtuoso's IP. This means that Virtuoso can now easily direct bots' traffic through a specific IP for specific goals. For security reasons, this still needs to be configured by the product team when required by customers.

# Fixed

  • Support for auto-playing videos in chrome.
  • Execute test steps' properties panel now allows to edit all the variables present in test step. Variables that are not marked as inputs on the script are highlighted, and script input variables are always present even if they are not in the test step currently.
  • Unauthorized access or request on invalid execution URLs now shows the proper 404 page instead of displaying the loading animation indefinitely.
  • While exploring, your position on the graph is kept and will no longer be reset frequently.
  • Failed/Cancelled explorations will no longer have their snapshot data removed/reverted.

# Changed

  • Tick command (e.g., ticking a radio button) now takes a value as target name. Such that you can now target the section containing the radio target you're picking and data-drive it or use variables. If you want to simply click a checkbox, you can instead use the click command. Note that if you had tests using the tick command in the past, you may have to update the step to either use a click or use the new version of Tick.
  • Statistics and counts on the Dashboard and Execution Report are now based on test suites instead of test cases, focusing on the journeys tested with Virtuoso.
  • The performance of the execution page/report has been improved.
  • On assertion steps, Virtuoso will now always continue if a validation is no longer met, and Continue on failure determines if a step should continue if an unexpected error occurs. For example, assert "Element" equals "text value" will always continue if the text from "Element" does not match "text value", but will respect the Continue on failure option if "Element" does not exist. Note that Continue on failure is always enabled for assertion steps by default.
  • Reduced the impact of large explorations on executions.

# 0.14 - 2019-02-21

# Added

  • Cross-browser testing experimental (released only to staging): you can now pick a different browser to execute your tests with. highlight
  • Execution using a different resolution: using the advanced execution options, you can now pick a different resolution to execute your tests with. highlight
  • Max parallelism throttling support: When triggering executions, users can now specify a maximum parallelism limit via the Execute Advanced option of the goals (e.g., you can limit to max 1 test suite that can be executed at the same time on a goal execution; if you have two goals being executed each with 1 max test suite targeting the same application, Virtuoso will ensure that at max it is running 2 test suites at the time). highlight
  • Organization-wide scripts: You can now create a script once at the level of your organisation, which you can use across different projects. highlight
  • Added ability to clone scripts from and to other projects in the script manager.
  • Tooltip to dashboard statistics graph.

# Fixed

  • Fixed input edition of inline scripts.
  • Fixed switching between inline and project/organization level scripts.
  • Clicking back on edit goal from the exploration page returns to the exploration page rather than the project's dashboard.
  • An instance where test cases containing one failed test step were marked as skipped instead of failed.
  • Test cases and suites copy paste feature now add each step in the correct order.
  • Snapshot history button on the exploration page now works correctly on Firefox.

# Changed

  • Significant improvements to the exploration graph with the ability to update in-place rather than refreshing. highlight
  • Command assert matches now supports Javascript-flavored regular expressions instead of Java-flavored regular expressions (e.g., assert "element" matches "/(?i)text/" becomes assert "element" matches "/text/i"). highlight
  • Improvements to performance of execution job submission.
  • Improvements to the performance of processing execution results.
  • Updated in-app notifications design.

# 0.13 - 2019-02-05

# Added

  • Exploration page:
    • Clone Goal button on the exploration page enables you to clone the goal from its latest snapshot into another goal.
    • Fork Goal button on the exploration page enables you to clone a goal at an older snapshot into another goal (you can use this to continue working on an older snapshot).
    • More options menu () for quick actions on an exploration such as Fork a goal in a given snapshot, Edit goal, Explore again from scratch, etc.
  • Significant improvements to execute command (script execution):
    • Change the script from properties
    • Add script inputs using either variables or hard-coded values
    • Add/edit scripts directly from properties panel
    • Updated natural language syntax for Execute steps. See docs for more details.
  • Inline scripts with the Execute command: Now it is possible to write short inline scripts specific to a test case that are versioned on the snapshot (without having to use script manager).
  • All virtuoso pages now have titles according to the active page content.
  • Performance improvements on explorations to reduce the duration of the test generation phase.
  • Improvements to test step validation, when creating natural language tests. Invalid values will now be validated at the time of creating the step, rather than at the time of execution.
  • Ability to rollback (revert) individual goals: this works similar to Git, such that the older snapshot data will be committed as a new snapshot on the history, without re-writing history (Note that older snapshots will still remain visible, though you should avoid interacting with those. This is a limitation that will be resolved with Virtuoso's GA).

# Fixed

  • Navigate command targeting a new tab now presents that information explicitly without needing to open the test step properties.
  • Statistics on dashboard now updates correctly after goal cloning.
  • Graphs on the top of the exploration's performance panel should no longer be truncated in Firefox.
  • Virtuoso now generates tests for applications for which exploration finds only one page (root node of the graph).
  • Clicking on the invitation link when the invited user is already logged on will present the project shared instead of an error popup.
  • Fix an instance where the popup asking to show desktop notifications would trigger multiple times.
  • Fixed several bugs related to exploring further from suite, such that sometimes the graph would return empty.

# Changed

  • If the current session is not valid, Virtuoso suggests to return to the login screen or stay in the current page (further interaction with the page will repeat the warning, until the session is valid again by performing login in a different tab with the same user);
  • Changing password now presents an in-page warning informing that performing this action will invalidate all other open sessions.
  • Explorations that do not result in an application graph should no longer give an error, presenting an empty graph instead.
  • File upload using the Upload command now works better at using the file's original name and works better with more file hosting services/solutions (e.g., you can now use google drive to host your files, as long as you make the file URLs public). The file size limit has also been increased to 5MB.
  • When a snapshot has been committed, the exploration will always happen in a new snapshot (regardless of whether the exploration is a further-exploration or an exploration from scratch).
  • Improved the performance of the exploration outcome computation, when user views the data multiple times.
  • Exploration now honours subdomain switching across the same main domain (e.g., pages linked from uat-foo.example.com to uat-bar.example.com will be explored).
  • Virtuoso will now generate a test case for every edge on the journey path (the inconsistency between the first two steps being on first test case has been resolved).
  • Users can now explore further in a dirty snapshot (note that this comes with the caveat that if your further exploration is unsuccessful, any changes you may have made will be removed).

# 0.12 - 2019-01-22

# Added

  • Exploration Outcome (summary) panel, a data rich panel containing general information about the exploration, including: highlight
    • Pages and test statistics;
    • Overall resource request timing distribution;
    • List of executions;
    • Pages with resource request responding with 3xx, 4xx and 5xx HTTP codes;
    • Pages with console warning and errors;
    • Pages which resources loaded 20% and 40% slower than the average;
  • Global performance intelligence: When no page on the graph is selected, Virtuoso shows the overall performance results on the performance panel. highlight
  • Organisation-level limit of the number of parallel explorations, which is currently set to 5. Launching more jobs than the limit in parallel will fail.
  • Dashboard sections now display their empty and loading states.
  • Enhanced goal management features on dashboard such as quick button to add new goals and ability to filter/re-order them.
  • Explorations/Executions can now be cancelled directly from the Dashboard by expanding them and clicking cancel.
  • Ability to navigate to a page in a new tab (navigate to "https://google.com" in new tab). This enables you to run parallel sessions on the browser without navigating away from your previous state on a page (e.g., jump to a temporary email provider) (see Known issues). highlight
  • Most-visited tab on the project manager, to help you find your most-common projects more easily.

# Fixed

  • Ability to explore further from suite or graph when the snapshot has been executed. Now, the previous snapshot will be automatically cloned before exploring further. highlight
  • Overflow and column width problems on Firefox on the Exploration Network panel.
  • Performance panel scroll now includes the whole content.
  • Ability to delete test steps from test cases generated during the exploration.
  • Project selection is now only possible via the dedicated project manager, instead of the project dropdown on dashboard.
  • Cloning a goal or project now correctly clones the related states as well. Note that cloning a goal only clones the latest snapshot of it.

# Changed

  • Security improvement: Users are logged out on all their active sessions after changing their password.
  • Overall revision of the App's URL to index in the relative project ID and be more explicit about its params (e.g., you can now share project links with your co-workers). For example, an exploration URL would be https://virtuoso/#/exploration/5/4/1/2/2/6is now displayed as https://virtuoso/#/project/1/exploration/goal/5/snapshot/4/page/1/suite/2/case/2/step/6. This change is backwards compatible so your old URLs are still valid and can continue to be shared. highlight
  • Style of console entries of Exploration Console panel are now more in line with a browser console window.
  • The execute button (play icon) on the exploration page now lets you execute the test suite you have open (or alternatively all test suites).
  • The execute button on the Execution page lets you re-execute the same execution, or you can select individual test suites to execute.

# 0.11 - 2019-01-08

# Added

  • Exploration page:
    • Performance panel: displays information regarding network request timing performance for each state; highlight
    • Added timing information on the network request details under the Timing tab (in the network requests panel, for each network request). highlight
  • Advanced step options can now be configured using the properties panel according to each command properties, for commands such as: mouse, key presses, cookies, switching iFrames and scroll. highlight
  • Natural language shorthand for waiting for element: wait for "Welcome", which creates a wait for element with timeout of 20 seconds.
  • Title of the pages being compared on snapshot diff page now shows on the page title section.

# Fixed

  • Fixed an issue with dashboard execution job pie-chart not displaying correctly on Firefox.
  • Fixed execution stats and success rate on the dashboard job section.
  • Fixed order of failed test steps on the right side of the execution report.
  • Added scroll to test step properties panel which had off-screen/unreachable content.
  • Instance where the document request was not highlighted on the exploration network panel.
  • Fixed an instance where the page elements highlight on snapshot diff page compare would render without height.

# Changed

  • General performance improvements (should be noticeable on dashboard with respect to loading times of the loading project data). highlight
  • Whole-app exploration and large explore-further requests will no longer be allowed. highlight
  • Loading animation while editing cases no longer blocks the content, displaying instead a loading icon on the step or case header. highlight
  • Assertion steps from now on will have Continue on failure enabled for them by default. highlight
  • Snapshot data used to plot the summary on the dashboard was reduced to focus on the more recent activity.
  • If a snapshot is not editable, the user will be prompt to create the editable version sooner when trying to make changes to tests and steps.

# 0.10 - 2018-12-19

# Added

  • Internal scheduling: The fairness of the allocating Virtuoso bots has been improved such that multiple users running explorations and executions would lead to all of them being executed at a slower rate rather than one large exploration blocking everyone else for hours. highlight experimental
  • New natural language command dismiss to handle alerts, confirms and prompts. highlight
  • Webhooks (See docs): highlight
    • Ability to create, edit, and ping project webhooks, which allow external services to be notified when certain events happen;
    • Ability to see information about each successful or unsuccessful webhook delivery attempt, and to request a re-delivery.
  • Execution report:
    • Execution steps now can show screenshot (full and viewport) when they failed;
    • Selecting all test suites from a execution page is now implemented;
    • It is now possible to launch execution of only the selected suites from an execution page. highlight
  • Exploration network logs (see Known issues): highlight
    • Highlight the document request on a exploration page network logs;
    • Include post data on XHR network requests.
  • Added button to launch execution of all journeys from an exploration page.
  • Snapshot history: Ability to see and jump into past snapshots a goal from inside the exploration page. highlight
  • Full application exploration now requires the user confirmation.
  • Support for CSS selectors in guess clues (e.g., click on '.btn.btn-info').
  • Press command (keyboard keys): you can send individual keys or key shortcuts to the browser. See docs for more details.
  • Dashboard project view jobs now present more information: highlight
    • Percentage of successful/failed executions; experimental
    • Job drop-down now shows the user that launched the job (this information will only show on jobs launched since the current release, previous jobs will show Not available);
    • Execution job drop-down shows sumary of passed, failed, and skipped tests.

# Fixed

  • The screenshot shown on an execution's layout panel now defaults to the last executed test step if no step is selected.
  • Fixed incomplete test step representations to present information closer to the natural language test step added.
  • Bug blocking users from changing empty step values.
  • After rollback to a specific snapshot, jobs from the discarded snapshots are no longer shown.
  • Fixed a problem blocking users creating before/after steps with variables.
  • Fixed some situations that would lead to incorrect test execution count.
  • Elements containing non breaking spaces now can be selected with hint selectors.
  • Fixes to test steps commands window resize and mouse move.
  • Explore all goals is working again on frontend.

# Changed

  • The cluster now prevents submission of too many explorations jobs, and so you may now receive an error if Virtuoso is busy exploring many different goals. experimental
  • Test execution statistics are now created based on the number of test cases instead of test steps.
  • The display network request URL is now in accordance with chrome dev tools. highlight
  • Improvements to the test step error messages.
  • Improvements to the step properties management.

# 0.9 - 2018-11-26

# Added

  • Execution reports: highlight
    • Execution suite filters and ordering controls;
    • Root cause message: Failed step errors now displays a message regarding what failed instead of just printing the step description;
    • New controls to quickly re-launch a failed suite or all failed suites directly from the execution page;
    • Failed step expandable section with the page screenshot and document source.
  • Support for index-based dropdown selection (e.g., select second option from "Dropdown name"). See docs for more details.
  • Ability to resize window (e.g., window resize to 640, 480).
  • The response body of XHR requests (ajax call) is now available in network panel (useful for investigating/validating APIs). highlight

# Fixed

  • Problem blocking users from accepting a project invitation if they were currently logged. highlight
  • Fixed an instance where the user was unable to share with an email if it input text begins with a space. highlight
  • Write command now cleans the input before writing. highlight
  • Problem with test execution counters per outcome.
  • An instance where it was not possible to cancel a goal initial exploration.
  • Fixed data loaded times creating information inconsistencies in certain pages.
  • Unblock snapshot commit when adding steps with unsuccessful copy/paste.
  • Close project sharing modal if the user changes the URL.
  • Corrected typo in the representation of Assert selected command. highlight

# Changed

  • Better column width distribution of exploration page network logs. highlight
  • Improved guessing for file input elements, even when there's no clear file input field visible. highlight
  • Improved assert exists / not exists to only look for visible elements.
  • Logged in users can no longer access the login page.
  • Improved network panel sorting, column widths, and UX.
  • Performance improvements on exploration and graph building.
  • SSL validation is no longer performed during exploration (you can now crawl applications with invalid SSL certificates).

# 0.8 - 2018-11-12

# Added

  • Overall change to exploration page. Now the user can select between different information panels on each side: highlight experimental
    • Pages, test suites and test cases navigation;
    • State graph;
    • Page screenshot (requires a page to be selected);
    • Page source (requires a page to be selected);
    • Page network requests (requires a page to be selected);
    • Page console prints (requires a page to be selected);
    • Page source, network requests and console prints will only show content for new explorations, they may be empty for old explorations.
  • Better syncing between two or more users working on the same project. More actions are now synced between distinct user sessions (project, snapshot, goal, test suite, test case, and test step). highlight
  • More elements throughout the application are now more user-friendly and can be opened on new tabs:
    • Exploration pages, suites, cases;
    • Exploration step proprieties;
    • Execution links.
  • Ability to continue execution when a step fails (on the step properties, you can mark a step to Continue on Failure). highlight

# Fixed

  • Step action descriptions are now up-to-date with parser capabilities. highlight
  • Proper page network request time calculation.
  • Instance where accessing a Script page directly would not load the data properly.
  • All goals explorations are now cancelable while they are running.
  • Fixed page elements scaling on screenshot comparisons.
  • Other UI improvements (Firefox compatibility issues, element alignments and mobile responsiveness).
  • Scroll command handling is now working as expected.
  • Upload command now fails instead of timing out if an invalid URL is provided.
  • A number of bugs for computing the plot on the dashboard.
  • Cloning steps now clones also the data (previously the data in cloned steps would not be properly cloned, and changes to new snapshots would affect previous snapshots).

# Changed

  • On exploration page, all test cases are now open by default.
  • Cancel execution button is now only active while the execution is running.
  • On page screenshot comparison, the swipe mode now works anywhere on the page.
  • Improved significantly the performance of dashboard plot.
  • Improved guessing for cross-element texts.

# Removed

  • Remove unused browser selector on execution pages.
  • Graph panel no longer includes the page screenshot since it can now be viewed on its own panel.

# 0.7 - 2018-10-25

# Added

  • Variable support: a number of commands now take an additional variable (e.g., write "john" as $firstName in "element") (see Known Issues). highlight experimental
  • Async support for scripts. Now you can mark a script as Runs asynchronously, and then call done() when finished. There is a hard timeout of 60 seconds if your script does not call done() within 60 seconds. highlight
  • New command supports: Upload (note that you may need to provide Xpath to upload input element); Scroll; Mouse actions - up, down, enter, over, out, leave, click, double click; Cookies: set, update, delete cookies; Frame/Tab support: switch to iframes or tabs (see docs for more details). highlight
  • Guessing of elements that span across multiple elements (e.g, see Total $123.42).
  • Guessing capability to detect elements nearby certain text (e.g., write "data" in input "foo" can refer to an input near text "foo").
  • Support for implicit waiting for elements (e.g., wait 20 seconds for "element"). Note that this is preferred over waiting for an arbitrary duration. If element appears after 1 second, Virtuoso will resume without being idle for 20 seconds.
  • Projects management page recent tab now orders projects by the logged user last access date.

# Fixed

# Changed

  • Updated several component designs, including:
    • Scripts management page;
    • Dashboard activity log status icons;
    • User settings page.
  • Virtuoso Extension: Improvements while record interactions with form input elements and dropdowns.

# 0.6 - 2018-10-04

# Added

  • Ability to explore further from suite: You can now update a test suite and explore further from it (note that if you want to update test data, you need to remove the test step and re-add the step with the new data, rather than updating it). highlight experimental
  • Real-time exploration: you can now see the graph being built during exploration. Note that the frontend does not automatically update on explore-furthers. highlight experimental
  • Fade and Swipe view modes for page screenshot comparisons. highlight experimental
  • Application intelligence: Network requests and log messages are stored during exploration: you can now see the results on frontend by clicking the Chrome icon after selecting a page. This is a temporary section which will be updated with new designs in the future. highlight experimental
  • Screenshot comparison can now be shared by URL. highlight
  • Several User Interface improvements and updates. highlight
  • Screenshot of the root page of the most recent exploration is used as visual representation of items in the projects listing page. highlight
  • Proximity based guessing: If you have an input field, by providing write "text" in input "I should have a", we'll find the nearby input field to that text on the script.
  • Enable/disable control over a goal execute button, avoiding execution attempt on goals not yet explored (see Known Issues). highlight
  • Added loading hints indicating when data is being fetched on Execution and Exploration pages.
  • Ability to specify element type hints in test steps (e.g., click on button "Sign in"). Currently only the following hints are supported by backend: button, link, dropdown.
  • Ability to define navigation URLs as strings or directly (e.g., 'navigate to "http://foo.com/?{complex.stuff}test=bar+buzz' or 'navigate to http://foo.com/bar' both work).
  • Ability to automatically wait for page resources to finish loading before extracting page information.
  • Ability to restore all goals.

# Fixed

# Changed

  • Live explorations no longer show an empty page.
  • Blocked committing a snapshot on exploration page while a user action is taking place.
  • Snapshots are now identified by their date instead of a counter.
  • Improve the execution/exploration performance.
  • Improve state matcher and its accuracy.
  • Improve guess selection for excluding non-input elements when trying to write to a field.
  • Improve state recognition by waiting for network requests to finish before checking pages.
  • Improve full-page screenshot for pages which do not require a scroll-and-capture screenshot.
  • Performance and effectiveness improvements for guessing.
  • Improved error messages provided while accepting an invitation by a new user.

# Removed

  • Error popups that were intrusive to the user (for example, test step parser errors).

# 0.5 - 2018-09-03

# Added

  • Integration with Virtuoso extension to submit recorded journeys. highlight experimental
  • Script feature: create your custom JS script and execute it in your tests by adding Execute "script name". highlight experimental
  • Ability to select hidden elements with hint selector (first visible elements are searched for, and if none found, invisible fields are looekd at). You can now assert on titles by assert "//title" matches "My page title". highlight
  • Ability to assert on text content of non-form elements with regex patterns (using assert matches). experimental

# Fixed

# Changed

  • Remove hidden forms/inputs from discovered data (to help with avoiding generating tests for missing forms).
  • Improvements to guess hint generation for links, during exploration.

# 0.4 - 2018-08-24

# Added

  • Ability to delete test suites. highlight
  • Ability to rename test suites and test cases. highlight

# Fixed

# Changed

  • Improve cluster stability when running intensive jobs. highlight
  • Improve page elements discovery by ignoring hidden or disabled elements.
  • Improve zooming in graph view.
  • Update exploration results view.
  • Improve NLP parser:
    • Support for single quoted strings;
    • Negative assertions assert that 'test' does not exist on page;
    • Pick support (pick 'March' from 'Month')).

# 0.3 - 2018-08-02

# Added

  • Test step properties: Ability to reorder selectors. highlight
  • Added option to delete test case (option available on the test case drop down). highlight
  • Ability to copy test steps to be in the same format as the ones that are pasted (order may not be respected for now). experimental
  • Ability to test paste steps in bulk. experimental
  • Added support for string quotes (single, double, or both) in guess values.
  • Added auto-focus on project name on new project screen.
  • Added auto-focus on the input on share project screen.
  • Add guess-feature support for the corner-case in where elements have duplicate unique selectors (e.g., duplicate id tags).

# Fixed

# Changed

  • Improvements to the zoom controls in snapshot compare and exploration screen.
  • Improvements to the screenshots that target page elements, when possible those elements should no longer be so close to the edges of the image.
  • Security: reinforced user authentication on test related endpoints.

# 0.2 - 2018-07-27

# Added

# Fixed

# Changed

# 0.1 - 2018-06-18

# Added

  • Login, logout and password reset.
  • Internal application notification with fab-icon to enable/disable it.
  • Native desktop notifications (enabled in user preferences).
  • Projects: create, list, archive, clone, share and show/mark as favorite.
  • Snapshot: list, tag, commit, clone, archive and rollback.
  • Snapshot difference:
    • Compare a pair of snapshots across all goals with a quantitative pairing of tests and states;
    • Snapshot difference details - page differences, filter pages (title, added, removed, changed, unchanged).
  • Settings: toggle notifications; change user's full name, email and password.
  • Dashboard:
    • Goals: list, create, edit, clone, archive, explore, execute and statistics;
    • Job: list, status, manage tags, snapshot version, filters (by goal, type, date and tags) and statistics (total explorations, total executions, total failed executions, total passed executions)
    • Statistics filtered by selected goals:
      • Graph state and snapshot ratio;
      • Test counter and snapshot ratio;
      • Execution snapshot ratio.
  • Exploration:
    • Graph with application unique states and first edge found:
      • Graph state mouse context menu option (on right click): Open page test suites, Open page in new tab and Explore from this page (replaced with Toggle page if already explored further);
      • Graph Toolbar: Graph depth level toggle slider, Zoom control with mouse scroll.
    • Navigation steps/tests reflecting edges on the graph;
    • Search page / states by title;
    • Cancel stop exploration;
    • Explore all further;
    • Select pages to explore further - trigger popup: List leaf-states/pages (nodes on the graph with no descendents) for user selection;
    • Drill down page to test suites: Add suite, execute, explore further;
    • Page / state navigation toolbar (bottom right): Page screenshot, Navigation slider toggling page / states, zoom control and toolbar states (maximized, splitted and minimized);
    • Drill down from test suites to test cases: add test case, order test case and delete test steps;
    • Drill down test cases to test steps: add, order, delete and toggle properties of a test step (element screenshot, test data, step action, element selectors, add new selector).
  • Execution
    • Browser selection (Chrome is the only option available);
    • Stop Execution;
    • Reports: Progress bar, Number of tests, Execution time, Parallelism gains, Statistics (number of tests passed, failed and skipped), Error List, Suite list (Status, Execution time and drill down to test steps with same elements).
Last Updated: 8/25/2021, 10:06:19 AM