Seed sweep: seed=137 (frontier verification)#1220
Conversation
|
I have read the CLA Document and I hereby sign the CLA 0 out of 2 committers have signed the CLA. |
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
Closing: Phase 1 seed sweep experiment. Moving to Phase 2 with longer training runs. Seed variance results noted for reference. |
Purpose
Second seed for frontier verification.
Implementation
Added before
model = Transolver(...):Results
W&B run:
fern/seed-137-r18(w40a25qs), best epoch 61, state=failed (wall-clock timeout)Analysis
Seed variance is substantial here. Seed=137 gives loss3=0.8542 (better checkpoint metric) but mean3=23.64 (+0.44 worse). Mixed picture:
This is consistent with normal seed variance at the frontier (±1-2%). No strong signal either way — seed=137 does not unlock better performance than the default seed at this architecture.
Combined with the seed=42 run (frieren) for multi-seed statistics to confirm whether the frontier has truly plateaued.