Is your feature request related to a problem? Please describe.
The ambiguity resolver of quantulum is not very good.
Describe the solution you'd like
This may improve by using a significantly larger language model. Either it can be queried directly or programmatically using lmql to decide among the options of ambiguous quantities.
In particular this function could be improved:
|
def disambiguate_unit(unit, text, lang="en_US", classifier_path=None): |
Describe alternatives you've considered
None
Additional context
LLMs are increasingly showing impressive performance in general natural language processing. The classifier in this tool is quite outdated and weak in comparison.
Is your feature request related to a problem? Please describe.
The ambiguity resolver of quantulum is not very good.
Describe the solution you'd like
This may improve by using a significantly larger language model. Either it can be queried directly or programmatically using lmql to decide among the options of ambiguous quantities.
In particular this function could be improved:
quantulum3/quantulum3/classifier.py
Line 299 in 9dafd76
Describe alternatives you've considered
None
Additional context
LLMs are increasingly showing impressive performance in general natural language processing. The classifier in this tool is quite outdated and weak in comparison.