Skip to content

fix(agentic): search API queries all requested memory_types, not just the first#238

Closed
Fearvox wants to merge 668 commits into
EverMind-AI:mainfrom
Fearvox:fix/issue-78-multi-type-search
Closed

fix(agentic): search API queries all requested memory_types, not just the first#238
Fearvox wants to merge 668 commits into
EverMind-AI:mainfrom
Fearvox:fix/issue-78-multi-type-search

Conversation

@Fearvox
Copy link
Copy Markdown
Collaborator

@Fearvox Fearvox commented Jun 3, 2026

What

The search API only ever queried memory_types[0]. A request asking for several memory types (for example [EPISODIC_MEMORY, AGENT_CASE]) silently returned hits from the first type and dropped every other type — no error, no warning, just missing results. This is the exact defect reported in #78.

This PR makes retrieve_mem query every requested memory type:

  • Keyword search (get_keyword_search_results) now iterates all requested types over ES_REPO_MAP instead of indexing memory_types[0], marks each hit with its memory_type, merges, and sorts by score.
  • Vector search (get_vector_search_results) does the same over a new MILVUS_REPO_MAP, replacing the single match mem_type block that handled only one type.
  • Hybrid dedup previously keyed on id alone, so two distinct collections that happen to share a backend id erased each other. Dedup now keys on (memory_type, id) via the new _hit_identity helper, and results are score-sorted via _sort_hits_by_score.

Small shared helpers (_memory_type_label, _hit_score, _sort_hits_by_score, _hit_identity) replace the repeated memory_types[0].value if ... else 'unknown' idiom that caused the bug in the first place.

Why

memory_types[0] is a silent data-loss bug: multi-type retrieval is a documented capability, and callers requesting two or more types had no way to know the extra types were being ignored. See #78.

Tests

Adds methods/EverCore/tests/test_memory_manager_multi_type_search.py, which runs fully offline (repositories monkeypatched, no ES/Milvus/live stack required):

  • test_keyword_search_queries_all_requested_memory_types — asserts both EPISODIC_MEMORY and AGENT_CASE return hits, score-sorted.
  • test_hybrid_dedupe_keeps_same_id_from_distinct_memory_types — asserts hybrid dedup keeps same-id hits from distinct memory types instead of collapsing them.

Run locally:

cd methods/EverCore
uv sync
PYTHONPATH=src pytest tests/test_memory_manager_multi_type_search.py -v
# (this is the `make test` path; PYTHONPATH=src is required or imports fail)

Result: 2 passed.

Scope

Surgical: two files only — methods/EverCore/src/agentic_layer/memory_manager.py and its new regression test. No README, no demo, no unrelated changes.

Closes #78.

Credit

This fix builds on prior community work that diagnosed and proposed the same change. Co-authors preserved on the commit:

Co-authored-by: Exploreunive 117084012+Exploreunive@users.noreply.github.com
Co-authored-by: Jah-yee 166608075+Jah-yee@users.noreply.github.com
Co-authored-by: wucm667 109257021+wucm667@users.noreply.github.com
Co-Authored-By: Claude Opus 4.8 (1M context) noreply@anthropic.com

🤖 Generated with Claude Code

libin.zhang and others added 30 commits December 31, 2025 18:23
Use self-deployed embedding and rerank APIs by default

See merge request npc-work/aic/ai/evermemos-opensource!64
vLLM Rerank API adopts an instruction-tuned approach

See merge request npc-work/aic/ai/evermemos-opensource!65
feat: metrics client and rerank/vectorize/retrieve metrics

See merge request npc-work/aic/ai/evermemos-opensource!66
fix:update episode prompt

See merge request npc-work/aic/ai/evermemos-opensource!68
feat: add rerank metrics

See merge request npc-work/aic/ai/evermemos-opensource!69
cyfyifanchen and others added 25 commits April 27, 2026 03:42
* chore: rename project from evermemos to EverCore

This commit renames the project directory and updates all internal references from "evermemos" to "EverCore". The changes include:
- Renaming the main directory from `methods/evermemos` to `methods/EverCore`
- Updating all import paths and module references
- Maintaining the same code structure and functionality
- Adding new configuration files (.vscode/settings.json, .pylintrc, pyrightconfig.json)
- Updating Dockerfile and project metadata

* docs: update references from evermemos to EverCore

Update documentation files to reflect the renaming of the 'evermemos' directory to 'EverCore'. This includes fixing clone commands, directory paths, and documentation links across multiple files to ensure consistency and correct navigation for users.

* chore: rename EverMemOS to EverCore across codebase

This is a project-wide rebranding from EverMemOS to EverCore. The changes include:
- Update project name in source files, documentation, and configuration
- Rename API references, environment variables, and service names
- Modify demo descriptions and benchmark configurations
- Update URLs and citations to reflect new project identity

All functionality remains identical; only naming has changed to align with the new project branding.

* docs: update README with EverCore focus and restructured TOC

- Add line break before Table of Contents for better visual separation
- Rewrite project description to highlight EverCore as the central component
- Reorder directory tree to prioritize benchmarks and methods over use-cases
- Update use-cases list with more examples and clarify they are templates
- Improve flow from Quick Start to use-cases to benchmarks

* docs: update README with clearer methods description and benchmarks

Add benchmark numbers directly in the method summaries for better visibility.
Clarify introductory text to emphasize choice and composition of methods.

* docs: fix markdown formatting in README table of contents

Adjust whitespace and line breaks to ensure proper rendering of the collapsible table of contents section.
…d-AI#204)

- Replace specific EverMemBench-Dynamic badge with general EverMind-AI HuggingFace badge
- Remove redundant License badge
- Change "Methods" section heading to "Architecture Methods"
- Update sub-section headings from h4 (####) to h3 (###) for better hierarchy
…rMind-AI#208)

* docs: restructure README and add AGENTS.md for better navigation

- Reorder sections to emphasize architecture methods and use cases
- Move use cases section before quick start for better flow
- Rename "Methods" to "Architecture Methods" for clarity
- Add AGENTS.md with quick commands and key entry points
- Update section headers to improve document hierarchy
- Maintain all existing content while improving organization

* docs: add community and contribution files

* docs: reorder README directory tree for logical grouping

* docs: move community files to .github/ and update references

* ci: change deploy workflow trigger from feature branch to main
* docs: restructure README and add subdirectory guides

Move the directory tree from the main README to new dedicated README files for each top-level folder (use-cases, methods, benchmarks). Add detailed introductions and tables to guide users to the appropriate subprojects. This improves navigation and provides clear entry points for different use cases.

* docs: expand showcase section with new projects and links

Add six new project entries to the README showcase, each with a banner image, description, and code/plugin link. Also update an existing benchmark entry to include a dataset link. This enhances the repository's demonstration of real-world applications and available resources.
* docs(readme): update project links and formatting

* docs(use-cases): enhance README with visual catalogue of demos

Expand the use cases section from a simple table to a detailed visual catalogue with project banners, descriptions, and links. This improves user engagement and provides a better showcase of community integrations and demos.

* docs: update READMEs and add validation for use-case links
* docs: update plugin repository link in README

* docs(readme): update banner gif link
)

* docs(readme): update code example link to pinned commit

pin the reference to the voice assistant example code to a specific commit hash and fix folder name capitalization

* docs: update voice assistant demo link in README
* docs(readme): add four new use case entries

* docs(readme): update outdated banner links to correct github repos
…e-demo-content-payload

Fix EverCore demo memory payload
…actions-hygiene

Harden GitHub Actions workflows
…adme-quickstart

docs: verify EverCore quickstart path
…I#236)

Delete deprecated EvoAgentBench, EverMemBench benchmark suites and
HyperMem memory system implementation, including all associated
configurations, scripts, and supporting assets.
… the first

The keyword and vector search paths read only `memory_types[0]`, so any
request asking for multiple memory types silently returned hits from the
first type and dropped the rest. retrieve_mem now iterates every requested
memory type for both keyword (ES_REPO_MAP) and vector (MILVUS_REPO_MAP)
search, merges the results, and sorts by score.

Hybrid dedup is also fixed: previously hits were deduped by `id` alone, so
two distinct collections that happen to share a backend id erased each
other. Dedup now keys on `(memory_type, id)` via `_hit_identity`.

Adds an offline regression test (monkeypatched repos, no live stack) that
asserts both EPISODIC_MEMORY and AGENT_CASE return hits and that hybrid
dedup keeps same-id hits from distinct memory types.

Closes #78

Co-authored-by: Exploreunive <117084012+Exploreunive@users.noreply.github.com>
Co-authored-by: Jah-yee <166608075+Jah-yee@users.noreply.github.com>
Co-authored-by: wucm667 <109257021+wucm667@users.noreply.github.com>
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings June 3, 2026 02:40
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[bug] Search API only uses memory_types[0], silently ignoring all other types