Stage 4: Add multi-engine load-balancing to sample() API#934

Merged

tyler-griggs merged 11 commits intoNovaSky-AI:mainfrom

tyler-griggs:tgriggs/tinker_sample_api_stage4

Jan 24, 2026

Commits on Jan 24, 2026

Stage 4: Add load-balancing to sample() and create TinkerInferenceAdapter

tyler-griggs
and
claude
committed
Add unit tests for TinkerInferenceAdapter

tyler-griggs
and
claude
committed
Fix: Wire session_id from Tinker API to adapter for session affinity

tyler-griggs
and
claude
committed
Add multi-engine load-balancing test for Stage 4

tyler-griggs
and
claude
committed
Clean up formatting in Stage 4 files

tyler-griggs
and
claude
committed
Refactor: Use list comprehension for token extraction

tyler-griggs
and
claude
committed
Refactor: Remove TinkerInferenceAdapter, simplify to direct InferenceEngineClient calls

tyler-griggs
and
claude
committed
Minor formatting: Remove stale docstring and add clarifying comment

tyler-griggs
and
claude
committed
Remove session affinity logic, use random load-balancing

tyler-griggs
and
claude
committed
Fix: Keep session_id parameter for non-Tinker use cases

tyler-griggs
and
claude
committed
Increase multi-engine test to 5 requests for better coverage

tyler-griggs
and
claude
committed