Skip to content

2B config#470

Draft
dirkgr wants to merge 29 commits intomainfrom
dirkg/2B
Draft

2B config#470
dirkgr wants to merge 29 commits intomainfrom
dirkg/2B

Conversation

@dirkgr
Copy link
Copy Markdown
Contributor

@dirkgr dirkgr commented Nov 20, 2025

No description provided.

Copy link
Copy Markdown
Contributor

@epwalsh epwalsh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Everything looks good now other than learning rate.

),
)
.with_callback(
"comet",
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we still need this even though we don't have comet anymore? Won't it always be enabled=False?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I agree we can drop it in configs going forwards

tyler-romero and others added 12 commits November 20, 2025 16:58
The exponential LR scheduler implementation and tests are already
merged in src/olmo_core/optim/scheduler.py and src/test/optim/scheduler_test.py.

These test scripts are personal tools for LR range finding and don't
need to be in the main repo.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants