feat: Add Logfire error tracking to fleet env#6

Merged

dzorlu merged 25 commits intodeniz/fleet_clientfrom

deniz/fleet-logfire

Mar 11, 2026

Commits on Feb 26, 2026

feat: Add Logfire error tracking to fleet env

authored and
Deniz
committed

Commits on Feb 27, 2026

fix(telemetry): consistent schema with env_key, env_version, task_key, modality

authored and
Deniz
committed
feat(telemetry): add fleet_mcp_tool_error for MCP server errors

authored and
Deniz
committed
fix(telemetry): set context BEFORE Fleet.make() so init failures have full context

authored and
Deniz
committed
fix: address bugbot issues in PR #6

authored and
Deniz
committed
fix: add hard timeout to MCP operations to prevent hanging

authored and
Deniz
committed
fix: async Fleet.make() to prevent event loop blocking

authored and
Deniz
committed
fix: enrich fleet_mcp_tool_error with env:version and step info

authored and
Deniz
committed

Commits on Feb 28, 2026

fix: suppress noisy logfire console output and tracebacks

authored and
Deniz
committed
Fix telemetry dashboard: count init failures as rollouts, add total_steps

authored and
Deniz
committed
Add fleet_provisioning_completed telemetry event with provisioning_time_s

authored and
Deniz
committed

Commits on Mar 3, 2026

Fix MCP endpoint routing, telemetry gap, and retry config

authored and
Deniz
committed
fix: call_tool retry used non-existent retry_base_delay attr

authored and
Deniz
committed
feat: auto-select instance TTL based on modality

authored and
Deniz
committed

Commits on Mar 4, 2026

Emit fleet_rollout_completed on close() for orphaned rollouts

authored and
Deniz
committed
Simplify orphaned rollout stop reasons to max_steps / abandoned

authored and
Deniz
committed
Add Fleet telemetry section to README

authored and
Deniz
committed
Increase tool_use TTL from 600s to 900s to reduce 502s from instance expiry

authored and
Deniz
committed
fix: use asyncio.to_thread(Fleet.make()) instead of AsyncFleet.make()

authored and
Deniz
committed
fix: wrap sync blocking calls in asyncio.to_thread() to unblock event loop

authored and
Deniz
committed

Commits on Mar 7, 2026

feat: add trace upload utilities for eval rollouts

authored and
Deniz
committed

Commits on Mar 8, 2026

fix: Convert OpenAI image_url blocks to Fleet ingest format for proper UI rendering

authored and
Deniz
committed
fix: Pass reward as score to ingest API so sessions complete

authored and
Deniz
committed
Add hint-based reward for solver RL training (Options B, C, D)

authored and
Deniz
committed
Revert "Add hint-based reward for solver RL training (Options B, C, D)"

Deniz
authored and
Deniz
committed