Skip to content

Add real-world benchmark fixtures#1

Merged
longlho merged 2 commits into
mainfrom
codex/real-world-benchmark-fixtures
May 18, 2026
Merged

Add real-world benchmark fixtures#1
longlho merged 2 commits into
mainfrom
codex/real-world-benchmark-fixtures

Conversation

@longlho
Copy link
Copy Markdown
Contributor

@longlho longlho commented May 18, 2026

Summary

  • add pinned VS Code, Grafana, and Kibana benchmark fixtures via MODULE.bazel
  • replace the synthetic benchmark generator with a Benchmark.js harness over those fixtures
  • document the motivation, Knip comparison, contribution workflow, and README benchmark results
  • parallelize Codescythe parsing with Rayon and compact JSON output for benchmark runs

Validation

  • git diff --check
  • cargo fmt --all --check
  • bazel test //...
  • node --experimental-transform-types benchmarks/run.ts --help
  • smoke benchmarks for vscode, grafana, and kibana with --samples 1 --warmups 0

@longlho longlho merged commit dcdded0 into main May 18, 2026
1 check passed
@longlho longlho deleted the codex/real-world-benchmark-fixtures branch May 18, 2026 02:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant