Skip to content

[Metrics] Track Episode Cache Memory Usage #103

@DsThakurRawat

Description

@DsThakurRawat

Description (GFI)

Granular memory tracking for the KV cache.

Task

  • Update EpisodeCache to compute the byte-size of its stored tensors.
  • Expose reflex_episode_cache_bytes_total as a Prometheus metric.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions