Skip to content

Add simple cache for model#2

Merged
granttnarg merged 12 commits into
mainfrom
add-simple-cache-for-model
Sep 7, 2025
Merged

Add simple cache for model#2
granttnarg merged 12 commits into
mainfrom
add-simple-cache-for-model

Conversation

@granttnarg

@granttnarg granttnarg commented Sep 7, 2025

Copy link
Copy Markdown
Owner

What does this do?

Brief description of the changes.

Specific changes

  • Add simple in memory cache for our model
  • Add Baseline Model as a comparison to our fine-tuned model
  • Extend logs to track our 2 models comparison
  • Add Rate Limit to ENV Variable

Notes / Testing

Extend tests for new features

Note new ENVs needed for production setup
BASE_WANDB_ORG=""
BASE_WANDB_PROJECT=""
BASE_WANDB_MODEL_NAME=""
BASE_WANDB_MODEL_VERSION=""
RATELIMIT_PER_MIN=""

@granttnarg granttnarg merged commit 2c0e6b2 into main Sep 7, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant