Skip to content

Define richer inherited-payload variants and evaluation framework in hyperparameter-genome devlog#880

Open
Copilot wants to merge 3 commits into
devfrom
copilot/evaluate-inherited-payload-designs
Open

Define richer inherited-payload variants and evaluation framework in hyperparameter-genome devlog#880
Copilot wants to merge 3 commits into
devfrom
copilot/evaluate-inherited-payload-designs

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented May 17, 2026

This updates the intrinsic-evolution devlog follow-up with a concrete plan for evaluating richer inheritance beyond chromosome-only transfer. It specifies what to test and how to judge whether richer payloads improve adaptation or just overfit local ecology.

  • What this adds

    • Introduces a structured Issue #848 follow-up section in the devlog.
    • Replaces the open-ended “push farther” note with an actionable evaluation framework.
  • Candidate payload variants + hypotheses

    • Baseline: chromosome-only inheritance (current behavior).
    • V1: chromosome + lightweight policy prior summary.
    • V2: chromosome + bounded module-state micro-transfer.
    • V3: gated transfer (conditional/clipped inheritance of richer payloads).
    • Each variant includes an explicit adaptation-vs-overfitting hypothesis.
  • Comparative experiment design

    • Matched baseline-vs-variant runs under identical ecology/policy settings.
    • Cross-ecology transfer evaluation to separate local fit from generalization.
    • Multi-seed cohort framing so conclusions are distributional, not trajectory-specific.
  • Decision criteria / trade-offs

    • Defines evaluation axes: adaptation speed, stability, and generalization.
    • Adds a clear selection rule: retain richer inheritance only when speed gains do not materially degrade stability or cross-ecology performance.
| Variant | Inherited payload | Hypothesis |
| --- | --- | --- |
| **Baseline (current)** | Chromosome only (learning + action priors), fresh decision module | Most robust cross-ecology generalization, but slower cold-start adaptation |
| **V2: module-state micro-transfer** | Chromosome + bounded module state slice (e.g., small distilled value head / compressed policy state) | Highest immediate adaptation speed, but higher instability and local-ecology lock-in |

Copilot AI linked an issue May 17, 2026 that may be closed by this pull request
Copilot AI changed the title [WIP] Extend inherited payload design for adaptation testing Define richer inherited-payload variants and evaluation framework in hyperparameter-genome devlog May 17, 2026
Copilot AI requested a review from csmangum May 17, 2026 23:05
@csmangum csmangum marked this pull request as ready for review May 18, 2026 00:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Evaluate richer inherited payload designs

2 participants