Skip to content

correlate evaluation logs with traces#282

Merged
benjibc merged 2 commits intomainfrom
correlate_logs
Oct 16, 2025
Merged

correlate evaluation logs with traces#282
benjibc merged 2 commits intomainfrom
correlate_logs

Conversation

@benjibc
Copy link
Copy Markdown
Contributor

@benjibc benjibc commented Oct 16, 2025

image

@benjibc benjibc requested review from mayinghan and xzrderek October 16, 2025 18:41
Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting

Comment on lines +26 to +30
def filter(self, record: logging.LogRecord) -> bool: # type: ignore[override]
rollout_id = current_rollout_id.get()
if not rollout_id:
# No correlation context → do not emit to external sink
return False
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Context filter blocks env-based rollout logging

The new ContextRolloutIdFilter returns False whenever current_rollout_id is unset, which prevents the handler from processing the record at all. This means that log records that explicitly supply a rollout ID (via extra={'rollout_id': …}) or rely on the handlers’ EP_ROLLOUT_ID environment-variable fallback will now be dropped before the handler can examine those values. Before this change, setting EP_ROLLOUT_ID was enough to route logs to Fireworks/Elasticsearch; after this commit, those logs silently disappear unless every call site wraps logging in rollout_logging_context. If support for env/explicit IDs is still required, the filter should treat an existing record.rollout_id or env fallback as valid rather than short‑circuiting.

Useful? React with 👍 / 👎.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://github.com/codex address that feedback

@benjibc benjibc merged commit 44ffe72 into main Oct 16, 2025
2 checks passed
@benjibc benjibc deleted the correlate_logs branch October 16, 2025 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant