Dark Mode
Autify Engineering
Read Original Post

Machine Learning Features in Autify for Mobile

Revolutionizing mobile app testing with AI-powered visual regression, self-healing tests, and intelligent app exploration

November 8, 2021
Mobile Testing
Machine Learning
4 min read
Back to Home

We at Autify help our customers automate the tedious tasks of quality assurance. And with the launch of Autify for Mobile, We are expanding our product to now include testing mobile apps, along with our current offering of testing web apps. In this article, we want to highlight some machine learning-related features that are currently either in beta or upcoming in Autify for mobile.

AI-Powered Mobile Testing Suite

Visual Regression Testing

Intelligent detection of visual changes across app versions

Available

Visual Self Healing

AI-powered test adaptation to layout changes

Available

Visual App Explorer

Autonomous app navigation and bug discovery

In Development
01

Visual Regression Testing

Autify VRT - Instant visual change detection

The first very exciting feature in Autify for Mobile is Visual Regression Testing (or Autify VRT in short). The goal of VRT is to help customers quickly identify visual changes across multiple builds of their apps. These changes include but are not limited to changes in the color, position, style, and layout of objects in the screenshot.

Version Comparison Demo

Two different versions of the same app
App Versions Comparison
VRT Analysis
Visual Regressions Applied
Removed Elements Added Elements

Removed Elements

Highlighted in red - elements that existed in the previous version but are no longer present

Added/Modified Elements

Highlighted in green - new elements or modifications in the current version

02

Visual Self Healing

State-of-the-art adaptive testing algorithm

Visual self-healing is the state-of-the-art algorithm we developed that helps us self-heal test scenarios across different runs. It solely relies on visual information and can easily ignore changes in the underlying structure as long as the visual information is preserved. This system is also unaffected by small visual changes like changes in color, some style, etc.

Self-Healing in Action

Visual Self Healing in Action
Original Target
AI-Healed Target

Scenario Example

1

User recorded a tap on the "Get Started" button in the original app layout

2

App design changed significantly - button moved to different position

3

Visual self-healing engine automatically identifies and targets the button in its new location

Key Benefits

  • Relies solely on visual information
  • Ignores underlying structure changes
  • Unaffected by minor style changes
  • Fully automated adaptation
03

Visual App Explorer

Autify VAX - AI-powered autonomous app exploration

This feature is currently in development

Visual App explorer or Autify VAX is an AI-based module that explores the app and all possible corners. The primary goal of this feature is to create a navigation map. It achieves that by navigating the app based on the visual information presented on the screen. It can find and report bugs and crashes in the app. It may also be used to list reachable/unreachable locations in the app.

Navigation Map Generation

Visual App Explorer navigation map
Example of how Visual App Explorer builds a comprehensive navigation map of your app

Autonomous Navigation

Intelligently navigates through app screens using visual cues

Bug Detection

Automatically finds and reports crashes and issues

Coverage Analysis

Maps reachable and unreachable app locations

Navigation Insights

Provides detailed app flow and user journey analysis

Ready to Experience AI-Powered Mobile Testing?

Thank you very much for reading. If you have any questions or want to get access to these features when available, feel free to reach out to us!

Request "Autify for Mobile" Demo

Topics

Mobile Testing Machine Learning Visual Testing Test Automation AI Quality Assurance Autify
Back to Home