Skip to content

docs: draft git infrastructure benchmark v1#111

Draft
HeyGarrison wants to merge 2 commits into
masterfrom
feat/git-benchmark-spec-v1
Draft

docs: draft git infrastructure benchmark v1#111
HeyGarrison wants to merge 2 commits into
masterfrom
feat/git-benchmark-spec-v1

Conversation

@HeyGarrison
Copy link
Copy Markdown
Contributor

Summary

  • add a new draft spec for a Git infrastructure benchmark that covers transport, deep-history stress, collaboration, API workflows, reliability, governance, and cost
  • define fairness rules, deterministic fixture generation guidance, a starter scoring model, and a machine-readable JSON output schema
  • link the draft in the README roadmap so contributors can iterate on the proposal

Notes

  • this PR is documentation-only and does not change benchmark runtime behavior yet
  • the spec is intentionally provider-neutral and includes both traditional SCM hosts and API-first/agent-native Git platforms

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Browser Benchmark Results

# Provider Score Create Connect Navigate Release Total Status
1 Hyperbrowser 95.2 0.17s 0.16s 0.10s 0.09s 0.53s 10/10
2 Browserbase 94.9 0.22s 0.12s 0.07s 0.14s 0.55s 10/10
3 Kernel 94.0 0.03s 0.42s 0.15s 0.05s 0.68s 10/10
4 Steel 87.5 0.26s 0.58s 0.13s 0.13s 1.32s 10/10

View full run · SVG available as build artifact

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Sandbox Benchmark Results

Sequential

# Provider Score Median TTI P95 P99 Status
1 declaw 99.3 0.04s 0.12s 0.12s 10/10
2 tensorlake 97.7 0.18s 0.31s 0.31s 10/10
3 daytona 96.3 0.21s 0.63s 0.63s 10/10
4 archil 95.3 0.41s 0.56s 0.56s 10/10
5 upstash 95.2 0.40s 0.60s 0.60s 10/10
6 e2b 94.1 0.48s 0.74s 0.74s 10/10
7 blaxel 94.0 0.53s 0.70s 0.70s 10/10
8 vercel 93.4 0.59s 0.77s 0.77s 10/10
9 runloop 83.7 1.31s 2.12s 2.12s 10/10
10 modal 79.5 1.63s 2.69s 2.69s 10/10
11 namespace 76.5 1.68s 3.36s 3.36s 10/10
12 cloudflare 76.4 1.99s 2.92s 2.92s 10/10
13 hopx 75.9 1.44s 1.77s 1.77s 9/10
14 codesandbox 73.8 2.43s 2.89s 2.89s 10/10

Staggered

# Provider Score Median TTI P95 P99 Status
1 declaw 99.5 0.04s 0.06s 0.06s 10/10
2 tensorlake 98.3 0.16s 0.18s 0.18s 10/10
3 daytona 97.0 0.22s 0.43s 0.43s 10/10
4 upstash 96.1 0.37s 0.42s 0.42s 10/10
5 archil 96.1 0.31s 0.51s 0.51s 10/10
6 blaxel 94.7 0.53s 0.54s 0.54s 10/10
7 e2b 93.7 0.51s 0.82s 0.82s 10/10
8 vercel 92.1 0.63s 1.03s 1.03s 10/10
9 hopx 85.2 1.33s 1.72s 1.72s 10/10
10 namespace 82.8 1.63s 1.86s 1.86s 10/10
11 modal 82.2 1.55s 2.14s 2.14s 10/10
12 runloop 81.1 1.77s 2.06s 2.06s 10/10
13 cloudflare 79.8 1.88s 2.23s 2.23s 10/10
14 codesandbox 73.0 2.56s 2.91s 2.91s 10/10

Burst

# Provider Score Median TTI P95 P99 Status
1 declaw 99.3 0.05s 0.09s 0.09s 10/10
2 tensorlake 97.7 0.23s 0.24s 0.24s 10/10
3 daytona 96.6 0.26s 0.47s 0.47s 10/10
4 upstash 95.6 0.43s 0.46s 0.46s 10/10
5 archil 95.5 0.43s 0.47s 0.47s 10/10
6 blaxel 94.3 0.55s 0.59s 0.59s 10/10
7 e2b 93.5 0.56s 0.79s 0.79s 10/10
8 vercel 93.0 0.58s 0.88s 0.88s 10/10
9 hopx 81.6 1.81s 1.88s 1.88s 10/10
10 namespace 80.6 1.91s 2.00s 2.00s 10/10
11 modal 78.3 1.86s 2.63s 2.63s 10/10
12 runloop 76.4 1.99s 2.92s 2.92s 10/10
13 cloudflare 73.4 2.47s 2.95s 2.95s 10/10
14 codesandbox 63.4 3.26s 4.25s 4.25s 10/10

View full run · SVGs available as build artifacts

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Storage Benchmark Results

1MB Files

# Provider Score Download Throughput Upload Status
1 AWS S3 95.9 0.04s 212.4 Mbps 0.06s 1000/1000
2 Tigris 95.3 0.06s 146.1 Mbps 0.10s 1000/1000
3 Cloudflare R2 94.8 0.11s 75.9 Mbps 0.20s 1000/1000

4MB Files

# Provider Score Download Throughput Upload Status
1 AWS S3 97.3 0.06s 574.0 Mbps 0.22s 1000/1000
2 Cloudflare R2 95.0 0.17s 194.6 Mbps 0.33s 1000/1000
3 Tigris 94.9 0.20s 168.9 Mbps 0.32s 1000/1000

10MB Files

# Provider Score Download Throughput Upload Status
1 AWS S3 97.3 0.12s 687.3 Mbps 0.48s 1000/1000
2 Cloudflare R2 94.3 0.33s 252.5 Mbps 0.73s 1000/1000
3 Tigris 93.8 0.56s 149.6 Mbps 0.48s 1000/1000

16MB Files

# Provider Score Download Throughput Upload Status
1 AWS S3 97.1 0.19s 706.0 Mbps 0.49s 1000/1000
2 Cloudflare R2 93.8 0.52s 257.7 Mbps 0.80s 1000/1000
3 Tigris 92.8 0.96s 139.9 Mbps 0.50s 1000/1000

View full run · SVGs available as build artifacts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant