Skip to content

oursky/skytest-agent

Repository files navigation

SkyTest Agent

The open-source, self-hosted alternative to fragile E2E test suites.

Write tests in plain language. Get screenshot evidence for every run.

GitHub stars License: MIT Last Commit PRs Welcome

Join Waitlist

What is SkyTest Agent?

Cypress and Playwright make you code against DOM selectors that break when the UI changes. SkyTest Agent works differently: describe what a user would do in plain language, and a browser agent runs those steps, capturing screenshots as evidence.

It is self-hosted, open source, and uses your own API key.

Welcome.mp4

Key Features

  • Plain-language tests - Write test cases the way you'd explain them to a colleague. No CSS selectors or XPaths.
  • Visual evidence - Every run captures screenshots and logs so you see what happened, not just pass/fail.
  • Multi-session flows - Coordinate across browser roles (e.g., "Browser A" sends a message, "Browser B" receives it) for multi-user scenarios.
  • Custom Playwright code - Mix AI-driven steps with your own Playwright scripts when you need precise control.
  • Android Support — Run cross-platform tests on web and Android apps with a single test suite.
  • MCP & Agent SKill — Use MCP to let AI coding agents generate test cases from your specs.
  • Parallel execution - Run tests concurrently for faster feedback.
  • Project management - Organize test cases and configurations by project with a built-in web UI.
  • Bring Your Own Key - Use your own OpenRouter API key. You pay only your LLM costs.

Example test case:

1. Open the app
2. Sign in as a user
3. Add an item to the cart
4. Verify checkout succeeds

Watch the demo on YouTube

Quick Start

npm install
npm run dev:services:up
cp .env.example .env.local
# Edit .env.local with your credentials and the local Postgres + MinIO values from docs/operators/local-dev.md
npm run db:generate
npm run db:migrate
npm run dev

Open http://localhost:3000 and sign in.
Enter your OpenRouter API key in settings and start testing!

Hosted Version

Don't want to self-host? We're building a managed version of SkyTest.

Join Waitlist

Configuration

See .env.example for all available options. Required:

  • DATABASE_URL - PostgreSQL connection string for the application database
  • S3_* - S3-compatible object storage credentials and bucket settings. Use local MinIO in development and hosted object storage in production.
  • ENCRYPTION_SECRET - Random 32+ char string for API key encryption
  • NEXT_PUBLIC_AUTHGEAR_* - Authgear credentials from portal.authgear.com

Users provide their own OpenRouter API keys via the app settings.

Troubleshooting

  • Browsers not found: npm run playwright:install
  • Database errors: Verify DATABASE_URL, then run npm run db:migrate
  • Object storage errors: Verify the S3_* variables and confirm the bucket exists in MinIO/S3
  • View database: npm run db:studio
  • Auth redirect issues: Check Authgear redirect URI matches your domain
  • Android devices (Local macOS Only): See macOS Android Emulator Guide

Local Development

For local development, run the same infrastructure shape as hosted:

  • PostgreSQL
  • S3-compatible object storage via MinIO

Quick start:

npm run dev:services:up
npm run db:generate
npm run db:migrate
npm run dev

Detailed setup:

Community & Contributing

Bug reports, feature requests, and pull requests are all welcome.

License

MIT

About

AI-powered web automation agent for natural language testing. Built with Next.js 16, Midscene.js, and Playwright. Describe steps, automate interactions.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages