Skip to main content

Credit Optimization Best Practices

Get the most value from your Rock Smith credits by understanding costs and applying strategic optimization techniques.

Understanding Credit Economics

Credit Cost Reference

Every operation in Rock Smith consumes credits:

OperationCredit CostNotes
Discovery Session1 per agent stepTypically 50-100 steps per session
Flow Execution1 per agent stepTypically 10-20 steps per flow
Flow Generation1 per flowFrom visual contexts
Flow Refinement1 per refinementMinor adjustments
Edge Case Fuzzing1 per variantGeneration only
Persona Generation1 per personaAI-generated personas

Plan Comparison

PlanMonthly CostIncluded CreditsEffective RateOverage Rate
Pay-As-You-Go$0.10/credit
Growth$39550~$0.071/credit$0.09
Professional$1492,000~$0.075/credit$0.06

Annual plans save 2 months (Growth: $390/year, Professional: $1,490/year).

Choosing the Right Plan

Monthly UsageRecommended PlanWhy
< 200 creditsPay-As-You-GoLower total cost
200-600 creditsGrowthBest per-credit value
600+ creditsProfessionalLowest overage rate
tip

If you're unsure, start with Pay-As-You-Go to measure actual usage, then upgrade to a subscription once patterns are clear.

Discovery Session Optimization

Discovery is often the largest credit consumer. Optimize carefully.

Scope Management

Scope TypeAgent StepsBest For
Targeted20-50Single feature area
Moderate50-100Product section
Broad100-200+Full application

Cost-saving strategies:

  1. Use URL exclusions aggressively

    • Exclude admin panels, logout pages, external links
    • Exclude areas already explored in previous sessions
    • Add patterns at project level for persistent exclusions
  2. Start small, expand as needed

    • Begin with targeted discovery for immediate needs
    • Run additional sessions only when coverage gaps appear
  3. Monitor in real-time

    • Stop early if step-to-context ratio is poor
    • End sessions when target areas are covered

Reusing Visual Contexts

Visual contexts persist across sessions. Leverage existing contexts:

ApproachCredit Cost
New discovery50-100+ credits
Generate flow from existing context1 credit

When to reuse contexts:

  • Application hasn't changed significantly
  • Existing contexts cover the needed areas
  • Quick turnaround needed

When to re-discover:

  • Major UI redesign
  • New features added
  • Contexts are stale (months old)

Flow Execution Optimization

Every flow execution consumes 1 credit per agent step. Reduce step count and avoid wasted runs.

Reducing Agent Steps

TechniqueSavingsHow
Focused flows20-30%Keep flows to 10-15 steps
Clear targeting10-20%Better descriptions = faster element location
Efficient waits10-15%Use wait_for_element instead of long fixed waits
Combined actions5-10%Single step for multi-field forms when appropriate

Efficient Element Targeting

Poor targeting causes retries, which consume extra steps:

Slow (multiple attempts):

Label: "Submit button"

Fast (first attempt):

Label: "Submit button"
Position: "bottom of the form"
Text: "Sign In"
Type: "button"

Investing time in precise targeting descriptions pays off over many executions.

Smart Retry Strategies

Before re-running a failed flow:

  1. Review the failure reason in results
  2. Fix the underlying issue (targeting, timing, assertion)
  3. Verify fix with a single run
  4. Then proceed with batch testing

Avoid:

  • Re-running failed flows repeatedly hoping for success
  • Running flows without reviewing previous failures
  • Ignoring intermittent failures (fix root cause)

Flow Generation & Refinement

Generation Strategy

ApproachCostBest For
Generate from contexts1 credit/flowQuick baseline creation
Manual creation0 creditsPrecise control

Optimize generation:

  • Generate flows in batches from well-populated projects
  • Review generated flows before execution
  • Use discovery contexts efficiently (1 discovery → many flows)

Refinement vs. Regeneration

ActionCostWhen to Use
Refine1 creditMinor targeting improvements, assertion tweaks
Regenerate1 creditMajor restructuring needed
Manual edit0 creditsSmall changes you can make yourself

Refinement is cost-effective for:

  • Improving element descriptions
  • Adding or adjusting assertions
  • Fixing timing issues
  • Clarifying step names
tip

Use refinement (1 credit) for iterative improvements. Only regenerate when the flow structure needs fundamental changes.

Edge Case Testing Optimization

Fuzzing can quickly consume credits. Be strategic.

Selective Variant Generation

Focus fuzzing on:

  • Authentication flows (login, registration, password reset)
  • Payment and checkout
  • Data entry forms
  • User input handling

Skip fuzzing for:

  • Navigation-only flows
  • Read-only pages
  • Simple click-through flows

Execution Strategy

Fuzzing cost = generation + execution

Example - Thoughtful approach:
- Generate 2 variants: 2 credits
- Run baseline + 1 selected variant: 30 credits
- Total: 32 credits

Example - Unoptimized approach:
- Generate 3 variants: 3 credits
- Run all 4 flows: 60 credits
- Total: 63 credits

Optimization tactics:

  • Review generated variants before running
  • Run high-risk variants first
  • Skip redundant variants (similar scenarios)
  • Execute security variants only in staging

Tree Depth Management

DepthTypical ValueCredit Impact
1-2HighModerate
3-4MediumIncreasing
5-6LowHigh

Stay at depth 2-3 for most use cases. Deep trees have diminishing returns.

Persona Optimization

Efficient Persona Creation

MethodCostBest For
AI generation1 credit/personaQuick diverse personas
Manual creation0 creditsSpecific requirements

Cost-saving approach:

  • Start with 2-3 core personas
  • Create manually when you know exact requirements
  • Generate only when you need AI creativity

Persona Reuse

Personas persist in your library. Reuse across:

  • Multiple flow executions
  • Different projects (where applicable)
  • Ongoing test cycles

Don't create new personas for:

  • Each flow execution
  • Minor variations (adjust existing instead)
  • One-time tests

Usage Monitoring & Alerts

Tracking Usage

Monitor credit consumption regularly:

  1. Check balance: View in app's top-right corner
  2. Review breakdown: Click for detailed usage by operation type
  3. Identify patterns: Which operations consume most credits?

Setting Alerts

Configure alerts to avoid surprise overages:

Alert LevelWhen to AlertAction
75%Included creditsReview upcoming testing needs
90%Included creditsPrioritize critical tests only
100%Included creditsOverages begin; consider upgrade

Budget Planning

Estimating Monthly Usage

Calculate expected credits:

Monthly Credits =
(Discovery steps/session × sessions) +
(Flow steps × executions) +
(Flows generated) +
(Refinements) +
(Fuzzing variants generated) +
(Fuzzing variants executed × steps) +
(Personas generated)

Example Budgets

Small Team (Growth Plan - 550 credits)

ActivityCalculationCredits
2 discovery sessions50 steps × 2100
10 flow generations10 × 110
30 flow executions15 steps × 30450
Total560

Result: Slightly over, ~$1 overage

Active QA Team (Professional Plan - 2,000 credits)

ActivityCalculationCredits
4 discovery sessions60 steps × 4240
20 flow generations20 × 120
75 flow executions18 steps × 751,350
10 fuzzing variants10 × 110
10 variant executions18 steps × 10180
5 refinements5 × 15
Total1,805

Result: Within plan, 195 credits remaining

Credit-Saving Checklist

Use this checklist to maximize credit efficiency:

Discovery Sessions

  • Define URL exclusion patterns
  • Select appropriate scope (targeted vs. broad)
  • Monitor session metrics in real-time
  • Stop early when coverage goals are met
  • Reuse existing visual contexts when possible

Flow Execution

  • Fix issues before re-running failed flows
  • Use precise element targeting descriptions
  • Keep flows focused (10-15 steps)
  • Use wait_for_element over fixed durations
  • Select browser profiles for authenticated flows

Flow Generation

  • Generate from existing visual contexts
  • Review generated flows before execution
  • Use refinement (1 credit) for minor changes
  • Make manual edits when possible (0 credits)

Edge Case Testing

  • Focus fuzzing on critical flows only
  • Review variants before executing all
  • Start with 1-2 variants, expand as needed
  • Stay at tree depth 2-3 for most cases
  • Run security variants in staging only

Personas

  • Start with 2-3 core personas
  • Create manually when requirements are clear
  • Reuse personas across executions
  • Don't create new personas for each test

Common Credit Waste Patterns

PatternImpactSolution
Broad discovery without exclusions100+ wasted creditsAdd URL exclusions
Re-running failed flows15+ credits per runFix issues first
Running all fuzzing variants50+ creditsReview and select
Regenerating instead of refining1+ creditsUse refinement
New personas per execution1+ creditsReuse existing
Overly long flows5-10 extra stepsSplit or simplify

Next Steps