Skip to content

Commit 9963b81

Browse files
authored
model-conversion : add note about verifying previous models (#18082)
This commit adds a note to the README in the model-conversion examples, advising developers to verify that previous versions of models pass logits verification before adding new models from the same family.
1 parent db81d5e commit 9963b81

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

examples/model-conversion/README.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,13 @@ and in some cases perplexity checked of the quantized model. And finally the
1010
model/models need to the ggml-org on Hugging Face. This tool/example tries to
1111
help with this process.
1212

13+
> 📝 **Note:** When adding a new model from an existing family, verify the
14+
> previous version passes logits verification first. Existing models can have
15+
> subtle numerical differences that don't affect generation quality but cause
16+
> logits mismatches. Identifying these upfront whether they exist in llama.cpp,
17+
> the conversion script, or in an upstream implementation, can save significant
18+
> debugging time.
19+
1320
### Overview
1421
The idea is that the makefile targets and scripts here can be used in the
1522
development/conversion process assisting with things like:

0 commit comments

Comments
 (0)