-
-
Notifications
You must be signed in to change notification settings - Fork 65
Build the missing calibration-report join #4849
Copy link
Copy link
Open
Labels
gittensor:featureGittensor-scored feature linked to a feature issue — scores a 0.25x multiplier.Gittensor-scored feature linked to a feature issue — scores a 0.25x multiplier.help wantedExtra attention is neededExtra attention is needed
Description
Metadata
Metadata
Assignees
Labels
gittensor:featureGittensor-scored feature linked to a feature issue — scores a 0.25x multiplier.Gittensor-scored feature linked to a feature issue — scores a 0.25x multiplier.help wantedExtra attention is neededExtra attention is needed
Problem: Prediction records and realized outcomes are tracked independently with no aggregation function joining them into a real calibration report — a miner operator has no way to see their own prediction accuracy today, even though all the raw data exists.
Area: AMS / Miner
Proposal: Build the join between prediction records and realized outcomes, producing a real calibration report, and surface it through a CLI command.
Deliverables:
Acceptance criteria:
Scope note: this issue is limited to building a read-only calibration REPORT -- joining existing prediction records with existing realized outcomes and exposing the result via a CLI command. It must not modify the live scoring/calibration logic that feeds the actual gate; that stays maintainer-only.