[feat] add e2e tests using new tuistory package
#391
+5,091
−779
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
brandonkachen
force-pushed
the
brandon/e2e-tests
branch
12 times, most recently
from
7027ebd to
439b6b2
Compare
- Ctrl+C exit tests: capture state before/after second Ctrl+C, check if exit message appeared or text changed - --help flag test: use waitForText instead of fixed sleep
- Make /exit and /logout tests more lenient for autocomplete interference - Add proper finish event assertions to waitForText patterns - Remove login test that fails due to cached credentials
- stream-chunks: Fix vacuous timeSpread >= 0 assertion, make content assertions unconditional - concurrent-streams: Replace object identity check with proper content validation - subagent-streaming: Require subagent events instead of silently skipping assertions - max-agent-steps: Add finish event assertion and new maxAgentSteps=1 test case
- Fix non-falsifiable assertions in /exit, /logout, Ctrl+C tests - Verify --agent flag shows agent name in UI - Verify autocomplete shows actual command names - Add globalCleanupRan flag to prevent parallel tests killing each other
brandonkachen
force-pushed
the
brandon/e2e-tests
branch
from
439b6b2 to
5e614c0
Compare
- Add e2e package with Playwright and tuistory dependencies - Configure TypeScript and Playwright for e2e tests - Add comprehensive README with setup instructions
- Add env.ts for GH_TEST_EMAIL, GH_TEST_PASSWORD, GH_TEST_TOTP_SECRET - Add totp.ts for generating TOTP codes for GitHub 2FA automation
- Add cli-session.ts with tuistory PTY emulation and file-based IPC - Add oauth-helpers.ts for GitHub OAuth automation with TOTP support - Add infra.ts for Docker database and web server management - Add test-context.ts with Playwright test fixtures
- Add login-flow.spec.ts with 4 test cases: - First-time user login via GitHub OAuth - CLI responsiveness after login - /usage command after login - Logout and re-login flow
- Add scheduled nightly and on-demand workflow - Configure GH_TEST_EMAIL, GH_TEST_PASSWORD, GH_TEST_TOTP_SECRET secrets - Install system dependencies (postgresql-client, lsof) - Upload Playwright reports and screenshots on failure
- Add auto-login mechanism via CODEBUFF_E2E_NO_BROWSER flag - Add file-based IPC for login URL coordination (CODEBUFF_E2E_URL_FILE) - Add getWebsiteUrl() for dynamic URL resolution in tests - Support process.env override for CB_ENVIRONMENT in getConfigDir()
- Add GH_TEST_EMAIL, GH_TEST_PASSWORD, GH_TEST_TOTP_SECRET - Add CODEBUFF_E2E_URL_FILE for file-based IPC
- Add e2e to workspace in root package.json - Update bun.lock with e2e dependencies - Minor fixes to CLI e2e test utilities
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
TODO before merging:
test-cliand do them once a day