Skip to content

[Safety] Implement Real-time Student-Teacher Drift Monitor #98

@DsThakurRawat

Description

@DsThakurRawat

Description (Medium)

In shadow mode, we should actively measure the distance between the production and shadow model's predictions.

Task

  • Add a DriftWedge that computes the L2 distance between primary and shadow action chunks in real-time.
  • Log this 'Drift Score' to the JSONL trace for every request.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions