[EPIC] Future: Agentic AI Platform v2 (Phase 4)

[manavgup]

Overview

This epic consolidates all Agentic AI features deferred to Phase 4 (Q2-Q4 2025). The design phase is complete; implementation awaits core RAG quality improvements.

Design Documents

• docs/design/agent-mcp-architecture.md - Core agent architecture
• docs/design/mcp-context-forge-integration.md - MCP integration strategy

Consolidated Issues (Closed → Tracked Here)

The following issues were closed and consolidated into this epic:

Agent Framework (Closed)

• Implement Base Agent Framework for Agentic AI #121 - Implement Base Agent Framework ❌ Superseded by design docs
• Build Tool Integration Framework for Agents #122 - Build Tool Integration Framework ❌ MCP replaces custom tools
• Implement Specialized Agent Types #123 - Implement Specialized Agent Types ❌ Implementation detail
• Implement Advanced Agent Capabilities - Self-Reflection and Learning #126 - Advanced Agent Capabilities ❌ Deferred to Phase 4

Agent Epics (Closed)

• EPIC-001: Agent Orchestration Framework #192 - EPIC-001: Agent Orchestration Framework ❌ Replaced by consolidated design
• EPIC-002: Workflow Engine #193 - EPIC-002: Workflow Engine ❌ Deferred to Phase 4

Still Open (Track Here)

• EPIC-003: Memory & Context Management #194 - EPIC-003: Memory & Context Management
• EPIC-004: Chain-of-Thought Reasoning #195 - EPIC-004: Chain-of-Thought Reasoning (Note: CoT for search is done)
• EPIC-005: Knowledge Graph Integration #196 - EPIC-005: Knowledge Graph Integration
• Epic: Podcast Generation and AI Evaluation Feature #240 - Epic: Podcast Generation and AI Evaluation
• Enhancement: Agentic Podcast Generation with AI Agents #241 - Enhancement: Agentic Podcast Generation
• 🤖 Feature: Agent Discovery & Orchestration Interface #244 - Agent Discovery & Orchestration Interface
• 🏗️ Architecture Decision: Agent Orchestration Framework Selection & Integration Strategy #245 - Architecture Decision: Agent Framework Selection

Prerequisites

Before starting Phase 4:

• Core RAG quality issues resolved (Epic [EPIC] RAG Quality & Search Accuracy Improvement #686)
• Backend performance optimized (Epic [EPIC] Backend Performance Optimization #687)
• Production deployment stable

Phase 4 Scope

4.1 Agent Framework Foundation

• Base agent interface implementation
• MCP tool integration layer
• Agent registry and discovery

4.2 Workflow Engine

• Task orchestration
• Multi-step workflows
• Error handling and recovery

4.3 Memory & Context

• Agent-specific context management
• Cross-session memory persistence
• Context window optimization

4.4 Knowledge Graph

• Entity extraction pipeline
• Graph storage integration
• Semantic reasoning layer

4.5 Advanced Capabilities

• Agent self-reflection
• Learning from feedback
• Multi-agent coordination

Timeline

• Design: Complete (Nov 2025)
• Implementation: Q2-Q4 2025 (after Phase 2-3)
• Dependencies: Epics [EPIC] RAG Quality & Search Accuracy Improvement #686, [EPIC] Backend Performance Optimization #687, [EPIC] Conversation System Refactoring #688

Success Criteria

• Agents can execute multi-step tasks
• MCP tools integrated
• Memory persists across sessions
• Knowledge graph queryable
• Self-reflection improves responses

[manavgup]

Architecture Documentation & Implementation Plan Update (Nov 2025)

New Architecture Documents

The following architecture documents have been created to guide implementation:

Document	Description
docs/architecture/agentic-ui-architecture.md	React components for agent features
docs/architecture/mcp-integration-architecture.md	MCP client/server integration
docs/architecture/rag-modulo-mcp-server-architecture.md	RAG Modulo as MCP server
docs/architecture/search-agent-hooks-architecture.md	3-stage agent pipeline
docs/architecture/system-architecture.md	Overall system architecture
docs/architecture/backend-architecture-diagram.md	Backend architecture diagrams

Commit tracking: #696

Implementation Roadmap

Phase 1: Foundation
├── #696 - Commit architecture docs (immediate)
├── PR #695 - SPIFFE/SPIRE agent identity (ready for merge)
└── PR #671 - MCP Gateway client (ready for merge)

Phase 2: Agent Pipeline
├── #697 - SearchService 3-stage agent hooks
└── #698 - RAG Modulo MCP Server

Phase 3: Frontend
└── #699 - Agentic UI components

Dependency Graph

#696 (Docs) ──► PR #695 (SPIFFE) ──► PR #671 (MCP Client) ──┬──► #697 (Agent Hooks)
                                                            │
                                                            └──► #698 (MCP Server)
                                                                      │
                                                                      ▼
                                                            #699 (Agentic UI)

New Issues Created

• docs: Add agentic RAG architecture documentation #696 - docs: Add agentic RAG architecture documentation
• feat: Implement SearchService 3-stage agent execution hooks #697 - feat: Implement SearchService 3-stage agent execution hooks
• feat: Expose RAG Modulo as MCP Server #698 - feat: Expose RAG Modulo as MCP Server
• feat: Agentic UI components for agent configuration and artifacts #699 - feat: Agentic UI components for agent configuration and artifacts

Existing PRs to Merge

• PR feat: SPIFFE/SPIRE Integration Architecture for Agent Identity #695 - SPIFFE/SPIRE Integration (5,956 lines, comprehensive)
• PR feat(mcp): Add MCP Gateway integration for tool invocation and enrichment #671 - MCP Gateway Integration (2,476 lines)

Timeline Estimate

Phase	Scope	Estimate
1	Docs + PR merges	1 week
2	Agent hooks + MCP server	2-3 weeks
3	Frontend components	2 weeks

Total: ~5-6 weeks for complete agentic platform foundation.

[manavgup]

New Implementation Issue: #714

Created #714 to track the temporal tool selection approach for agentic RAG.

This is a simplified, faster path to deliver agentic capabilities:

• Users select MCP tools per-search (no database config)
• Tools execute after answer generation
• Artifacts returned in search response

Implementation order:

1. feat: Temporal MCP tool selection for agentic search #714 - Temporal tool selection (current focus)
2. feat: Implement SearchService 3-stage agent execution hooks #697 - Full agent hooks (simplified/deferred)
3. feat: Agentic UI components for agent configuration and artifacts #699 - Extended UI (simplified/deferred)
4. feat: Expose RAG Modulo as MCP Server #698 - MCP server exposure (future)

See #714 for details.