Skip to main content

Introduction to Rock Smith

Welcome to Rock Smith - an AI-powered QA platform that automates web application testing through intelligent Flows. Test from the user's perspective with semantic element targeting that adapts to UI changes.

What is Rock Smith?​

Rock Smith automates QA testing through Flows - reusable test scripts that the AI can discover from your site, generate from descriptions, or refine from existing tests. Each flow contains steps with semantic element targeting, assertions, and configurable execution options.

Core Concept: Unlike traditional selector-based testing that breaks when UI changes, Rock Smith uses visual intelligence to understand your UI contextually and target elements by their appearance, position, and meaning.

Key Capabilities​

Test Flows​

AI-powered reusable test scripts with semantic element targeting:

  • 19 action types across navigation, interaction, input, and control categories
  • 12 assertion types for comprehensive validation
  • Natural language element descriptions with visual cues (color, position, shape)
  • Configurable failure handling and retry strategies

Discovery Sessions​

Automated site exploration that maps your application:

  • AI-powered crawling and page structure analysis
  • Visual state identification and screenshot capture
  • Automatic flow generation from discovered patterns

Visual Intelligence​

Semantic targeting that adapts to UI changes:

  • Bounding box detection to identify UI components
  • Natural language descriptions like "the blue Submit button below the form"
  • Self-healing tests that don't break when selectors change

Hybrid AI Engine​

Combines LLM reasoning with deterministic tool calls:

  • The AI decides what to test
  • Precise tool calls execute checks reliably
  • Drastically reduces hallucinations and false positives

How It Works​

  1. Install the Desktop App - Download from rocksmith.ai/download for macOS or Linux (Windows coming soon)
  2. Discover Your Site - Run a discovery session to map your application's structure
  3. Generate Flows - AI creates test flows from discovered patterns or your descriptions
  4. Execute Tests - Watch real-time execution with step-by-step progress and agent reasoning
  5. Analyze Results - Review pass/fail metrics, screenshots, and execution history

Secure Hybrid Architecture​

Test internal applications, staging environments, and localhost without exposing sensitive data:

  • Zero data exposure - Browser runs locally on your machine
  • Desktop-cloud model - AI processing in the cloud, execution on your desktop
  • Real-time feedback - Live browser view during test execution

What's Next?​

Need Help?​