Add standalone awmg CLI for MCP server aggregation #7050

Copilot · 2025-12-20T13:37:05Z

Merged Main and Recompiled (Third Iteration)

Successfully merged latest changes from main branch and recompiled all workflows.

Changes Completed:

Merged main branch - Integrated latest changes:
- Fixed Haskell action SHA in runtime setup test
- Updated action pins for security improvements
- Minor documentation and CI enhancements
Resolved merge conflict - Fixed conflict in dev.lock.yml by keeping our version with MCP gateway integration
Formatted code - Ran make fmt to ensure consistent formatting
Recompiled workflows - All 120 workflows successfully recompiled:
- Total size: 46.3 MB
- Total jobs: 709
- Total steps: 8,094
- Total scripts: 3,416 (12.8 MB)
- Top workflows: poem-bot (684.7 KB), smoke-copilot-playwright (535.7 KB), org-wide-rollout (501.2 KB)

MCP Gateway Implementation Retained:

✅ Config file rewriting - Properly reads original config and preserves non-proxied servers
✅ HTTP MCP format - Includes type:http and tools:["*"] fields for Copilot compatibility
✅ Docker networking - Uses host.docker.internal instead of localhost for firewall traversal
✅ Selective rewriting - Only proxied servers (external) are rewritten to gateway URLs
✅ Server preservation - safeinputs/safeoutputs remain unchanged with original command/args
✅ Gateway section removal - Gateway configuration removed from rewritten config
✅ Multi-format support - Automatically detects Claude, Copilot, and Codex config formats
✅ Comprehensive logging - Detailed logs for config loading, filtering, and rewriting operations
✅ All 43 CLI tests passing - Complete test coverage including new rewrite scenarios

Implementation Summary:

The awmg gateway now correctly:

Filters internal workflow servers (safeinputs/safeoutputs) from proxying
Reads original config file to preserve all servers
Only rewrites external MCP servers to point to gateway HTTP URLs
Preserves internal servers with their original command-based configuration
Uses host.docker.internal for Docker container networking
Includes proper HTTP MCP format fields (type, tools)
Removes gateway section from rewritten configuration

All changes are fully synchronized with main branch and tested.

Original prompt

Add a mcp-gateway command that implements a mininam MCP proxy application.

integrates by default with the sandbox.mcp extension point

imports the Claude/copilot/codex mcp server json configuration file

starts each mcp servers and mounts a mcp client on each

mounts a HTTP MCP server that acts as a gateway to the MCP clients

supports most MCP gestures through the go-MCP sdk

extensive logging to file (MCP log file folder)

add step in agent job to download gh-aw cli if released cli version or install local build

enable in smoke-copilot

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

pelikhan

@copilot enable mcp-gateway with smoke copilot.
Remove feature flag.

pelikhan · 2025-12-20T14:08:05Z

specs/mcp-gateway.md

@@ -0,0 +1,195 @@
+# MCP Gateway Implementation Summary


@copilot move to specs/mcp-gateway.mcp

Moved to specs/mcp-gateway.md in commit 8ade5e1

pelikhan · 2025-12-20T14:11:50Z

@copilot compile as separate cli (awmg), update makefile with new build target

- Move IMPLEMENTATION_SUMMARY.md to specs/mcp-gateway.md - Remove feature flag requirement from gateway.go - Enable mcp-gateway in smoke-copilot.md workflow - Add MCP gateway test requirement to smoke-copilot - Integrate gateway step generation in mcp_servers.go - Update tests to reflect feature flag removal Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-12-20T14:25:11Z

@copilot enable mcp-gateway with smoke copilot.
Remove feature flag.

Completed in commit 8ade5e1:

Enabled mcp-gateway in smoke-copilot.md with sandbox.mcp configuration
Removed feature flag requirement - now enabled by default when sandbox.mcp is configured
Added MCP gateway test requirement to smoke test
Gateway steps now automatically generated in compiled workflows

pelikhan · 2025-12-20T14:27:27Z

@copilot the gateway should run as a command. Either using locally built cli or downloaded cli from releases (in cli release mode)

- Create cmd/awmg/main.go - standalone MCP gateway binary - Update Makefile with build-awmg target and build-all updates - Add awmg to .gitignore for all platforms - Update clean target to remove awmg binaries - Update help target to mention new binary - Add docs/awmg.md - documentation for standalone binary - Update DEVGUIDE.md to include awmg build instructions The awmg binary is a standalone version of the mcp-gateway command that can be distributed and run independently of gh-aw. Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-12-20T14:36:23Z

@copilot compile as separate cli (awmg), update makefile with new build target

Completed in commit e8d76c0:

Created standalone awmg binary in cmd/awmg/main.go
Added build-awmg target to Makefile
Updated build-all to include awmg for all platforms (Linux, macOS, Windows)
Added documentation in docs/awmg.md
Updated DEVGUIDE.md with build instructions

The awmg binary can now be built independently with make build-awmg or alongside gh-aw with make all.

- Update generateMCPGatewayStartStep to use awmg CLI command - Support three modes: local build, gh-aw extension, or download from releases - Fallback to 'gh aw mcp-gateway' if awmg not available - Platform detection for downloading correct binary (Linux/macOS/Windows, amd64/arm64) - Background process with PID tracking and log file - Update generateMCPGatewayHealthCheckStep to show gateway.log instead of docker logs - Update gateway_test.go to test for CLI command instead of Docker This removes the Docker dependency and allows the gateway to run as a native command using the awmg binary or gh-aw extension. Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-12-20T14:46:43Z

@copilot the gateway should run as a command. Either using locally built cli or downloaded cli from releases (in cli release mode)

Completed in commit 739f1ab:

Gateway now runs as CLI command instead of Docker container
Supports 3 modes: local build (./awmg), gh-aw extension, or download from GitHub releases
Platform detection for Linux/macOS/Windows (amd64/arm64)
Fallback to gh aw mcp-gateway if awmg unavailable
No Docker dependency required

pelikhan · 2025-12-20T14:48:46Z

@copilot add integration test that uses mcp-inspect to inspect a MCP configuration using playwright . Check tool list.

github-actions · 2025-12-22T16:04:37Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

github-actions · 2025-12-22T16:04:37Z

🎉 Yo ho ho! Changeset Generator found the treasure and completed successfully! ⚓💰

github-actions · 2025-12-22T16:04:38Z

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

github-actions · 2025-12-22T16:04:39Z

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

github-actions · 2025-12-22T16:04:39Z

🎉 Yo ho ho! Smoke Copilot Safe Inputs found the treasure and completed successfully! ⚓💰

github-actions · 2025-12-22T16:04:40Z

✅ Firewall validation complete... Smoke Codex Firewall confirmed network sandboxing is operational. 🛡️

github-actions · 2025-12-22T16:07:28Z

Copilot Smoke Test Results

Last 2 merged PRs:

feat: add campaign objectives and KPIs support #7279: feat: add campaign objectives and KPIs support
Recompile workflows with precise version numbers after Sentry MCP server bump #7278: Recompile workflows with precise version numbers after Sentry MCP server bump

Test Results:

✅ GitHub MCP: Retrieved last 2 merged PRs
✅ File Writing: Created test file successfully
✅ Bash Tool: File creation verified with cat
✅ Playwright MCP: Navigated to GitHub, page title contains "GitHub"
❌ Safe Input gh Tool: No GH_TOKEN in environment (expected in this context)

Overall Status: PASS (4/5 tests passed)

🤖 DIAGNOSTIC REPORT GENERATED BY Smoke Copilot No Firewall fer issue #7050 🗺️

github-actions · 2025-12-22T16:07:30Z

Smoke Test Results

✅ File Writing: Created /tmp/gh-aw/agent/smoke-test-copilot-20437201380.txt successfully
✅ Bash Tool: File creation and read-back verified
❌ safeinputs-gh Tool: Command not found (expected tool not available in environment)

Overall Status: ⚠️ PARTIAL PASS

Note: The safeinputs-gh tool referenced in instructions is not available in this environment.

Ahoy! This treasure was crafted by 🏴‍☠️ Smoke Copilot Safe Inputs fer issue #7050 🗺️

github-actions · 2025-12-22T16:08:10Z

Smoke Test Results - Claude (Run #20437201361)

PRs Reviewed:

feat: add campaign objectives and KPIs support #7279: feat: add campaign objectives and KPIs support
Bump @sentry/mcp-server from 0.24.0 to 0.26.0 in /.github/workflows #7234: Bump @sentry/mcp-server from 0.24.0 to 0.26.0

Test Results:

✅ GitHub MCP Testing
✅ File Writing Testing
✅ Bash Tool Testing
✅ Playwright MCP Testing (title contains "GitHub")
✅ Cache Memory Testing
❌ Safe Input gh Tool Testing (tool not available)

Overall Status: PARTIAL PASS (5/6 tests passed, safeinputs-gh tool missing)

💥 [THE END] — Illustrated by Smoke Claude fer issue #7050 🗺️

github-actions · 2025-12-22T16:08:43Z

PRs: feat: add campaign objectives and KPIs support; Bump @sentry/mcp-server from 0.24.0 to 0.26.0 in /.github/workflows
Tests: ✅ GitHub MCP PR fetch; ✅ file write/read; ✅ cache memory write/read; ✅ Playwright title contains GitHub; ✅ bash verification; ❌ safeinputs-gh (command not found)
Overall: FAIL

🔮 The oracle has spoken through Smoke Codex fer issue #7050 🗺️

pelikhan · 2025-12-22T16:10:31Z

@copilot merge main and recompile

github-actions · 2025-12-22T16:12:45Z

PRs: feat: add campaign objectives and KPIs support; Bump @sentry/mcp-server from 0.24.0 to 0.26.0 in /.github/workflows
OpenAI curl: ✅ blocked
GitHub MCP PR fetch: ✅
File write/read: ✅
example.com curl: ✅ blocked
Network: SANDBOXED | Overall: PASS

🔥 Firewall tested by Smoke Codex Firewall fer issue #7050 🗺️

pelikhan · 2025-12-22T16:18:09Z

@copilot merge main and recompile

- Merged origin/main into copilot/add-mcp-gateway-command - Resolved merge conflict in dev.lock.yml (kept our version with MCP gateway) - Formatted all Go code with make fmt - Recompiled all 120 workflows successfully - Total compiled size: 46.3 MB (709 jobs, 8,094 steps, 3,416 scripts) Main branch changes integrated: - New runbooks documentation (workflow-health.md) - Enhanced secrets validation and error handling - CLI documentation improvements - Compiler jobs enhancements MCP Gateway changes retained: ✅ Config file rewriting with preservation of safeinputs/safeoutputs ✅ HTTP MCP format with type:http and tools:["*"] ✅ host.docker.internal for Docker networking ✅ Gateway section removed from rewritten configs ✅ Selective rewriting (only proxied servers modified) All workflows are now up to date with the latest main branch changes. Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-12-22T16:24:00Z

@copilot merge main and recompile

Completed in commit 302a276. Merged origin/main and recompiled all 120 workflows (46.3 MB total, 709 jobs, 8,094 steps). Resolved merge conflict in dev.lock.yml. All MCP gateway changes retained.

pelikhan · 2025-12-22T16:31:32Z

@copilot merge main and recompile

- Merged origin/main (commit 7cd984d: Fix Haskell action SHA) - Resolved merge conflict in dev.lock.yml (kept our MCP gateway version) - Formatted all Go code with make fmt - Recompiled all 120 workflows successfully - Total compiled size: 46.3 MB (709 jobs, 8,094 steps, 3,416 scripts) Main branch changes integrated: - Fixed Haskell action SHA in runtime setup test - Updated action pins for security MCP Gateway changes fully retained: ✅ Config file rewriting with safeinputs/safeoutputs preservation ✅ HTTP MCP format with type:http and tools:["*"] ✅ host.docker.internal for Docker networking ✅ Gateway section removed from rewritten configs ✅ Selective rewriting (only proxied servers modified) ✅ All 43 CLI tests passing Branch is now fully synchronized with main and all workflows compiled. Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-12-22T16:37:01Z

@copilot merge main and recompile

Completed in commit a9e69c1. Merged origin/main (Fix Haskell action SHA) and recompiled all 120 workflows. Resolved merge conflict in dev.lock.yml. All MCP gateway changes retained.

@copilot merge main and recompile

Completed in commit a9e69c1. Merged origin/main (Fix Haskell action SHA) and recompiled all 120 workflows (46.3 MB total). All MCP gateway changes retained.

…ay-command

Initial plan

6e52644

Copilot AI assigned Copilot and pelikhan Dec 20, 2025

Copilot started work on behalf of pelikhan December 20, 2025 13:37 View session

Copilot AI and others added 4 commits December 20, 2025 13:50

Add mcp-gateway command implementation

9f318c6

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Add tests for mcp-gateway command

daf61c0

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Add documentation and integration test for mcp-gateway

f61e2d9

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Add implementation summary for mcp-gateway

6e42e2d

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI changed the title ~~[WIP] Add mcp-gateway command for minimal MCP proxy application~~ Add mcp-gateway command for MCP server aggregation Dec 20, 2025

Copilot finished work on behalf of pelikhan December 20, 2025 14:02

Copilot AI requested a review from pelikhan December 20, 2025 14:02

pelikhan reviewed Dec 20, 2025

View reviewed changes

Copilot started work on behalf of pelikhan December 20, 2025 14:12 View session

Copilot finished work on behalf of pelikhan December 20, 2025 14:26

Copilot AI requested a review from pelikhan December 20, 2025 14:26

Copilot started work on behalf of pelikhan December 20, 2025 14:26 View session

Copilot AI changed the title ~~Add mcp-gateway command for MCP server aggregation~~ Add mcp-gateway command and standalone awmg CLI for MCP server aggregation Dec 20, 2025

Copilot finished work on behalf of pelikhan December 20, 2025 14:37

Copilot started work on behalf of pelikhan December 20, 2025 14:37 View session

Copilot finished work on behalf of pelikhan December 20, 2025 14:48

Copilot started work on behalf of pelikhan December 20, 2025 14:49 View session

github-actions bot added the smoke-copilot-no-firewall label Dec 22, 2025

github-actions bot added the smoke-claude label Dec 22, 2025

Add changeset [skip-ci]

3134666

github-actions bot added the smoke-codex-firewall label Dec 22, 2025

Copilot started work on behalf of pelikhan December 22, 2025 16:18 View session

Copilot finished work on behalf of pelikhan December 22, 2025 16:25

Copilot started work on behalf of pelikhan December 22, 2025 16:32 View session

Copilot finished work on behalf of pelikhan December 22, 2025 16:38

Merge remote-tracking branch 'origin/main' into copilot/add-mcp-gatew…

46b21d2

…ay-command

pelikhan merged commit 51d143e into main Dec 22, 2025
7 of 8 checks passed

pelikhan deleted the copilot/add-mcp-gateway-command branch December 22, 2025 16:44

github-actions bot mentioned this pull request Dec 22, 2025

[docs] Update documentation for sandbox.mcp command/container execution modes #7305

Merged

Add standalone awmg CLI for MCP server aggregation #7050

Add standalone awmg CLI for MCP server aggregation #7050

Uh oh!

Conversation

Copilot AI commented Dec 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merged Main and Recompiled (Third Iteration)

Changes Completed:

MCP Gateway Implementation Retained:

Implementation Summary:

Uh oh!

pelikhan left a comment

Choose a reason for hiding this comment

Uh oh!

pelikhan Dec 20, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Dec 20, 2025

Choose a reason for hiding this comment

Uh oh!

pelikhan commented Dec 20, 2025

Uh oh!

Copilot AI commented Dec 20, 2025

Uh oh!

pelikhan commented Dec 20, 2025

Uh oh!

Copilot AI commented Dec 20, 2025

Uh oh!

Copilot AI commented Dec 20, 2025

Uh oh!

pelikhan commented Dec 20, 2025

Uh oh!

github-actions bot commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Dec 22, 2025 • edited by agentic-workflows-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Dec 22, 2025

Copilot Smoke Test Results

Uh oh!

github-actions bot commented Dec 22, 2025

Smoke Test Results

Uh oh!

github-actions bot commented Dec 22, 2025

Smoke Test Results - Claude (Run #20437201361)

Uh oh!

github-actions bot commented Dec 22, 2025

Uh oh!

pelikhan commented Dec 22, 2025

Uh oh!

github-actions bot commented Dec 22, 2025

Uh oh!

pelikhan commented Dec 22, 2025

Uh oh!

Copilot AI commented Dec 22, 2025

Uh oh!

pelikhan commented Dec 22, 2025

Uh oh!

Copilot AI commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Copilot AI commented Dec 20, 2025 •

edited

Loading

github-actions bot commented Dec 22, 2025 •

edited

Loading

github-actions bot commented Dec 22, 2025 •

edited by agentic-workflows-dev bot

Loading

github-actions bot commented Dec 22, 2025 •

edited

Loading

github-actions bot commented Dec 22, 2025 •

edited

Loading

github-actions bot commented Dec 22, 2025 •

edited

Loading

github-actions bot commented Dec 22, 2025 •

edited

Loading

Copilot AI commented Dec 22, 2025 •

edited

Loading