quantulum3 icon indicating copy to clipboard operation
quantulum3 copied to clipboard

Check out integratability with LLMs / LMQL / JSONFORMER

Open nielstron opened this issue 2 years ago • 1 comments

Is your feature request related to a problem? Please describe. The ambiguity resolver of quantulum is not very good.

Describe the solution you'd like This may improve by using a significantly larger language model. Either it can be queried directly or programmatically using lmql to decide among the options of ambiguous quantities.

In particular this function could be improved: https://github.com/nielstron/quantulum3/blob/9dafd76d3586aa5ea1b96164d86c73037e827294/quantulum3/classifier.py#L299

Describe alternatives you've considered None

Additional context LLMs are increasingly showing impressive performance in general natural language processing. The classifier in this tool is quite outdated and weak in comparison.

nielstron avatar May 24 '23 07:05 nielstron

another promising alternative is https://github.com/1rgs/jsonformer to directly extract units in json format

nielstron avatar Jul 05 '23 09:07 nielstron