BotFake IDE is an autonomous AI testing agent built on VS Code. It analyzes your codebase, generates test strategies, writes scenarios using 12 AI tools, executes tests on schedule, detects visual regressions and flaky tests, and reports results — acting as your virtual QA engineer.

Which platforms does BotFake IDE support?

BotFake IDE is currently available for macOS (Apple Silicon / ARM64). Windows and Linux versions are coming soon.

How does the AI assistant work in BotFake IDE?

The AI assistant scans your project with 4 depth levels (L1–L4), builds structured documentation, and uses it as context (300K characters) to generate accurate test scenarios via tool-calling — creating files, updating scenarios, and managing checklists.

AI Testing Agent

Your AI QA Engineer that
writes, runs and maintains tests

BotFake IDE is an autonomous AI agent that analyzes your codebase, generates test strategies, writes scenarios, executes them on schedule, detects regressions, and reports results — all without manual intervention.

Download for macOS Documentation

Also available for Windows, Linux

BotFake IDE — auth-login-test.json

Scenarios

Production

auth-login-test

checkout-flow

seo-audit

Staging

Security

{
  "name": "Auth Login Flow",
  "steps": [
    {
      "action": "web_navigate",
      "url": "https://app.example.com/login"
    },
    {
      "action": "web_fill_form",
      "fields": { "email": "user@test.com" }
    }
  ]
}

Live Preview

web_navigate 1.2s

web_fill_form 0.8s

web_click 0.3s

web_screenshot ...

How It Works

Autonomous testing in 7 steps

From code analysis to bug report — the agent handles the entire QA cycle

Understands

Scans your codebase — routes, forms, auth, API endpoints, selectors

Plans

Generates a test strategy with priorities and categories

Creates

Writes JSON scenarios with real selectors and URLs from your code

Executes

Runs tests on schedule — daily, weekly, or custom cron

Detects

Visual regression, flaky tests, performance issues

Reports

Dashboard analytics, detailed reports with screenshots

Evolves

Updates docs and suggests new coverage when code changes

Download

Available for all platforms

Choose your operating system and start testing

macOS

Apple Silicon (ARM64)

Download .dmg

Windows

x64 / ARM64

Coming Soon

Linux

x64 / ARM64

Coming Soon

Agent Capabilities

What the Agent Can Do

An autonomous QA engineer with 12 AI tools, 80+ commands, and deep codebase understanding

Autonomous Test Creation

12 AI tools generate scenarios, checklists, parameters, and schedules — from a single prompt or entire project batch.

Supervised Execution

Watch the agent work in real-time — live browser screenshots, step-by-step logs, WebSocket streaming inside the IDE.

Full Control When You Need It

Inline diff review — accept or reject each AI change with Cmd+Y / Cmd+N. You stay in control of every scenario.

Autonomous Regression Detection

Pixel-level visual comparison, flaky test scoring, and automatic baseline management — the agent catches what humans miss.

Test Coverage Intelligence

Auto-generated checklists from scenarios, execution mode with pass/fail tracking, import/export, and coverage analytics.

Deep Codebase Understanding

L1–L4 progressive scan builds 300K-char context — routes, forms, auth, selectors, tech stack — all fed to the AI agent.

An agent that works while you sleep

The AI agent proactively analyzes your project, creates a complete test plan, generates 10–50 scenarios in minutes, schedules automatic execution, and reports results — no manual setup required.

Analyzes your project and creates a complete test plan (10–50 scenarios in minutes)
Schedules and runs tests automatically — daily, weekly, or cron
12 AI tools: creates scenarios, checklists, parameters, schedules, and documentation
Updates project documentation as your code evolves

AI Agent

I found 3 untested routes in your project. Should I create scenarios for /api/payments, /api/orders, and /settings?

Yes, generate all tests and schedule them daily

Creating 3 scenarios with 24 steps total. Scheduling daily execution at 3:00 AM.

botfake_save_scenario ×3

botfake_create_schedule ×3

Watch your tests run in real-time

The Live Preview panel streams test execution directly inside the IDE. See every step, every screenshot, every assertion — as it happens.

WebSocket-powered streaming from the test server
Live browser screenshots refreshed continuously
Step-by-step logs with timing and status
Cancel running tests at any time

Live Preview — Running

Live Preview — auth-login-test

web_navigate — 200 OK 1.2s

web_fill_form — email, password 0.8s

web_click — Submit ...

Full scenario lifecycle in one place

Create, edit, run, and review test scenarios without leaving the editor. The virtual file system lets you work with server-stored scenarios as if they were local files.

Virtual botfake:// filesystem with full read/write access
Inline diff review — Accept or Reject AI changes (Cmd+Y / Cmd+N)
Environment filter across all artifact types
Scenario history with success rates and failure analysis

Scenario #307 — 3 changes (Keep ⌘Y / Undo ⌘N)

+ "action": "security"
  "action": "seo_analysis"
  "action": "performance_analysis"
- "action": "web_screenshot"
+ "action": "web_scroll_screenshot"
  "action": "mobile_device"
+ "device": "iPhone 13 Pro"

Analytics

Know your test health at a glance

Built-in dashboard with charts, metrics, flaky test detection and run comparison

📊

Timeline Charts

Pass/fail trends per day

🎲

Flaky Detection

Automatic instability scoring

🔍

Run Comparison

Side-by-side execution diff

📈

Activity Feed

Real-time test events

Automate your test schedule

Schedule test runs with flexible triggers — from simple daily runs to advanced cron expressions. Visual calendar shows all past and upcoming executions.

Cron, daily, weekly, monthly schedules
Visual calendar with test execution history
Enable/disable, manual trigger, edit from sidebar

📅

Visual calendar integrated into the sidebar

Your codebase, documented and always in context

Scan any project and get structured documentation — routes, forms, auth flows, selectors, code excerpts. Everything is stored locally and loaded into AI context automatically.

4 scan levels: L1 (overview) → L4 (full deep analysis)
AUTOGEN marker protects user-edited docs from overwrite
AI creates and updates docs via tool-calling
200K char context budget with smart prioritization

Project Docs — scrile-connect

Project Docs

scrile-connect L4

overview auto

routes-api auto

auth auto

business-flows

testing-strategy

# Business Flows

## User Registration

1. Navigate to /register

2. Fill email, username, password

3. Accept terms checkbox

4. Click "Create Account"

5. Verify redirect to /dashboard

Foundation

The editor you already know

Built on VS Code — familiar interface, extensions, themes, keybindings. Plus 80+ BotFake agent commands and 12 AI tools.

Extensions support

Monaco editor

Integrated terminal

Git integration

Themes & customization

Keyboard shortcuts

AI Chat built-in

Security scanning

Analytics & reports

Agent vs Manual

Replace hours of manual work with minutes

See how the AI testing agent compares to traditional manual QA

Task	Manual QA	BotFake Agent
Analyze a new project	2–3 days	5 minutes (L4 deep scan)
Write test scenarios	Hours per scenario	Seconds (12 AI tools)
Run regression suite	Manual trigger each time	Automatic (cron / daily / weekly)
Detect visual bugs	Human eye, inconsistent	Pixel-level, 100% consistent
Create bug reports	Manual Jira entries	Auto-generated with screenshots
Track test health	Spreadsheets	Dashboard with flaky detection

Comparison

BotFake IDE vs alternatives

See how the desktop IDE compares to the web app and generic editors

Feature	Web App	Cursor + Extension
AI Chat with BotFake context	Limited	Limited
Live Test Preview
Project Documentation
Scenario Diff Review
Inline Diff + Accept/Decline
Visual Regression
Monaco Editor	Limited
80+ Agent Commands		Partial

Your AI QA Engineer that writes, runs and maintains tests