feat: use the bigger 7B param model by default#79
Conversation
Signed-off-by: Anupam Kumar <kyteinsky@gmail.com>
|
needs testing and admin docs update |
|
Shall we do a major version bump for this change to make sure people realize that the default model might not fit on their GPU anymore? |
|
ping? |
|
ah sorry, missed this. The bigger model did not have much improvement in quality as I hoped for, maybe the examples were not good given my own language limitations :) |
|
damn, ok. |
marcelklehr
left a comment
There was a problem hiding this comment.
The bigger model did not have much improvement in quality
resolves #76