Interview Progress & Coverage Metrics

[mathaix]

User Story

As a manager
I want to see topic coverage and progress metrics during interviews
So that I know if interviews are achieving their goals

Acceptance Criteria

Topic Coverage Tracking

• Agent tracks which topics have been discussed
• Topics from blueprint question categories
• Coverage levels:
  • Not Started: 0% coverage
  • Mentioned: Topic touched briefly (1-2 exchanges)
  • Discussed: Substantive conversation (3-5 exchanges)
  • Deep Dive: Thorough exploration (6+ exchanges)
• Coverage percentage per topic
• Overall coverage score for interview

Progress Indicators

• Current turn count / max turns
• Estimated time remaining
• Topics covered / total topics
• Entities extracted count
• Interview phase (opening, core, sensitive, closing)

Visualization

• Topic coverage heat map
  • Rows: Topics from blueprint
  • Columns: Interviews
  • Color intensity: Coverage depth
• Progress bar for overall interview
• Real-time updates as conversation progresses

Coverage Goals

• Blueprint defines coverage requirements
• Example: "90% of topics at 'Discussed' level or higher"
• Visual indication when goals met
• Warning if running out of time with low coverage

Cross-Interview Coverage

• Aggregate coverage across all interviews
• Identify gaps: topics no one has discussed deeply
• Suggest follow-up interviews for gaps
• Export coverage report

State Synchronization

• Topic coverage in InterviewState
• Updated via agent tool: update_topic_coverage(topic, depth)
• Synced to dashboard via AG-UI StateDeltaEvent
• Stored in interview record for reporting

Technical Notes

class InterviewState(BaseModel):
    interview_id: str
    phase: InterviewPhase
    topics: list[TopicCoverage]
    turn_count: int
    max_turns: int
    entities_detected: int
    
class TopicCoverage(BaseModel):
    topic: str
    depth: CoverageDepth  # not_started, mentioned, discussed, deep_dive
    turn_count: int
    last_updated: datetime

Agent updates coverage via tool calls during interview.

Definition of Done

• Topic tracking implemented
• Coverage visualization working
• Real-time updates working
• Cross-interview aggregation working
• Coverage goals checked
• Code reviewed and merged

Requirement ID

LM-07

---

🤖 Generated with Claude Code