feat(sayt): Add SAYTBuilder that constructs runtime artefacts for later use#71
Merged
Tom-Owen-ONS merged 11 commits intoJun 19, 2026
Merged
Conversation
Tom-Owen-ONS
commented
Jun 9, 2026
Contributor
Author
|
For consideration: remove the |
Contributor
Author
|
This does not directly implement the use of |
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
ivyONS
reviewed
Jun 15, 2026
Contributor
|
Works as expected, provides good speedup on load. Next steps: |
refactor: remove repeated isinstance checks using slim Protocol
Tom-Owen-ONS
commented
Jun 16, 2026
Tom-Owen-ONS
commented
Jun 16, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
📌 Pull Request Template
✨ Summary
This PR adds a
SAYTBuilderclass, which takes a set of configuredRetrieverSpecs, as well as a corpus and constructs an artefact folder that contains the built vector db parquet files, as well as the corpus and a manifest to locate all of the necessary files to run aSAYTSuggester. It allows for building of the artefacts at image build stage, then loading from the artefact directory from aSAYTSuggester.from_artefact()method.📜 Changes Introduced
Add
SAYTBuilderto build an artefact directory to construct aSAYTSuggesterquickly from a pre-build vector db.Adds an example notebook to test this functionality
Expands
SAYTSuggester.get_config()to return aSaytConfigurationPydantic model, which contains information about global suggester settings, the corpus, the retrievers and the artefact provenance (file locations etc).Feature implementation (feat:) / bug fix (fix:) / refactoring (chore:) / documentation (docs:) / testing (test:)
Updates to tests and/or documentation
Terraform changes (if applicable)
✅ Checklist
terraform fmt&terraform validate)🔍 How to Test
A notebook has been provided in
demos/sayt/sayt_artifact_example.pyto show the basic usage ofSAYTBuilder.