Skip to content

docs: add run logging and Slack notifications to aeo_crosslink_audit skill#234

Merged
rachaelrenk merged 6 commits into
mainfrom
docs/aeo-crosslink-audit-observability
Jun 17, 2026
Merged

docs: add run logging and Slack notifications to aeo_crosslink_audit skill#234
rachaelrenk merged 6 commits into
mainfrom
docs/aeo-crosslink-audit-observability

Conversation

@rachaelrenk

@rachaelrenk rachaelrenk commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Problem

The aeo_crosslink_audit skill now runs on a schedule, but has no self-reporting: it's impossible to answer whether the automation is producing durable value over time without replaying individual Oz runs. Team members also have to manually paste Oz run links into #growth-docs to loop in reviewers — whether a PR was opened or not.

What this PR does

Adds two observability improvements (parts A and B of the AEO automation: run observability and team notifications tracking item):

A: Run log (.agents/logs/aeo_crosslink_audit_runs.md)
After every run — whether a PR is opened or a no-change report is written — the agent prepends a structured 7-field entry to this new log file and commits it directly to main from a clean worktree (staging only the log file, so no unreviewed PR edits can leak). Fields: date, run ID, source signals, PR link, links proposed/added, pages touched, themes, and no-change reason.

B: Slack notification (step 8 in aeo_crosslink_audit workflow)
After writing the log entry, the agent posts a short plain-text message to #growth-docs using SLACK_BOT_TOKEN and SLACK_CHANNEL_ID (the same secrets already in the buzz Oz environment from weekly-404-monitor). Fires on every run — PR-opened and no-change alike. Both the log write and Slack post fall back gracefully to run output if secrets or git push are unavailable.

Files changed

  • .agents/skills/aeo_crosslink_audit/SKILL.md — added Environment requirements section, workflow steps 7–8, Run log format and Slack notification format reference sections
  • .agents/logs/aeo_crosslink_audit_runs.md — new log file (empty, ready for first entry)

Before merging

Confirm SLACK_BOT_TOKEN and SLACK_CHANNEL_ID are set in the buzz Oz environment (almost certainly already there from weekly-404-monitor).

Success criteria

After merging, the team can assess whether observability by assessing the following:

  • Team members can answer how many crosslink PRs have been opened in the last month without replaying individual Oz runs.
  • When a run completes, at least one person in #growth-docs sees the outcome within a few minutes without manual action.
  • The Slack notification is concise enough to scan in under 30 seconds.
  • The trend log is actually read and used to make decisions about whether to expand scope or tune the prompt.

Generated with Oz

Co-Authored-By: Oz oz-agent@warp.dev

rachaelrenk and others added 4 commits June 15, 2026 09:04
Add high-confidence internal cross-links for the agents, cloud agents,
and orchestration topic area, grounded in Peec AEO signals (scheduling,
managing and observing multiple agents) and existing docs:

- Scheduled Agents reference now links to the Scheduled Agents quickstart
  for a guided, no-CLI setup path.
- Run multiple agents at once guide now links to Agent notifications and
  the Agent Management Panel for notification setup and run observability.

Co-Authored-By: Oz <oz-agent@warp.dev>
Transfer changes from PR #232 (docs/aeo-crosslinks-agents-orchestration-20260616):
- integrations/index.mdx: add managing-cloud-agents cross-link
- triggers/index.mdx: add managing-cloud-agents cross-link after trigger types

Co-Authored-By: Oz <oz-agent@warp.dev>
…skill

- Add .agents/logs/aeo_crosslink_audit_runs.md as a durable run log
  committed to main after every scheduled run (PR or no-change)
- Add Environment requirements section documenting SLACK_BOT_TOKEN and
  SLACK_CHANNEL_ID (same secrets already used by weekly-404-monitor)
- Add workflow steps 7 and 8: write run log entry, then post simple text
  notification to #growth-docs; both fall back to run output gracefully
- Add Run log format and Slack notification format reference sections
- Update stale manual-sharing note in no-change report section

Co-Authored-By: Oz <oz-agent@warp.dev>
@cla-bot cla-bot Bot added the cla-signed label Jun 16, 2026
@vercel

vercel Bot commented Jun 16, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs Ready Ready Preview, Comment Jun 16, 2026 9:28pm

Request Review

@oz-for-oss

oz-for-oss Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

@rachaelrenk

I'm starting a first review of this pull request.

You can view the conversation on Warp.

I completed the review and no human review was requested for this pull request.

Comment /oz-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

@oz-for-oss oz-for-oss Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overview

This PR adds observability instructions for the aeo_crosslink_audit skill, including a run log and Slack notifications, plus several docs cross-link edits.

Concerns

  • The new run-log step tells future agents to commit directly to main after opening a PR, but it does not require a clean main checkout/worktree or staging only the log file. That can accidentally push the PR's unreviewed docs edits to main; see inline comment.
  • The new log file header says entries are appended, while the skill requires prepending new entries below the separator; see inline suggestion.

Verdict

Found: 0 critical, 1 important, 1 suggestions

Request changes

Comment /oz-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

Comment thread .agents/skills/aeo_crosslink_audit/SKILL.md Outdated
Comment thread .agents/logs/aeo_crosslink_audit_runs.md Outdated
- Step 7: specify clean main checkout/worktree and path-limited staging
  to prevent accidentally pushing PR branch edits to main alongside log
- Log file header: 'Appended' -> 'New entries are prepended' to match
  the skill's actual prepend instruction

Co-Authored-By: Oz <oz-agent@warp.dev>
@rachaelrenk rachaelrenk changed the title feat: add run logging and Slack notifications to aeo_crosslink_audit skill docs: add run logging and Slack notifications to aeo_crosslink_audit skill Jun 16, 2026
@rachaelrenk rachaelrenk merged commit 073e2c5 into main Jun 17, 2026
8 checks passed
@rachaelrenk rachaelrenk deleted the docs/aeo-crosslink-audit-observability branch June 17, 2026 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants