Skip to content

feat: add experiment trend analyzer#132

Open
EfeDurmaz16 wants to merge 1 commit into
vercel-labs:mainfrom
EfeDurmaz16:efe/experiment-trend-analyzer
Open

feat: add experiment trend analyzer#132
EfeDurmaz16 wants to merge 1 commit into
vercel-labs:mainfrom
EfeDurmaz16:efe/experiment-trend-analyzer

Conversation

@EfeDurmaz16

Copy link
Copy Markdown

Summary

  • add analyzeExperimentTrend for pass-rate trend analysis across saved experiment results
  • parse both numeric pass rates and existing "50%" summary values
  • expose trend result types from the package entrypoint

Closes #102.

Verification

  • npm ci
  • npm run test -w packages/agent-eval -- src/lib/results.test.ts
  • npm run build -w packages/agent-eval
  • npm run lint -w packages/agent-eval
  • git diff --check

Note: npm ci reports existing dependency audit findings, but installation completed and the focused checks passed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(results): ExperimentTrendAnalyzer — cross-run pass rate regression detection across timestamp directories

1 participant