jsonformer icon indicating copy to clipboard operation
jsonformer copied to clipboard

Recommendations on underlying model fine-tuning

Open codybum opened this issue 2 years ago • 1 comments

This work is very interesting and potentially useful in many domains.

Do you have any recommendations on how we might fine-tune models in specific domains to better support structured extraction? Specifically, we would be interested extracting structured data from medical reports where things such as a fixed set of conditions, location site, and other semantic labels are specific to the input text, but patterns could be learned from fine-tuned training. While we could fine-tune the model with a json response to report input, it is not clear that this would be the best approach.

Thanks for this work and any future response.

codybum avatar Jun 09 '23 08:06 codybum

I would also benefit from being able to fine tune models while enforcing a valid json output. Wondering if the developers might look into this.

tranlm avatar Dec 26 '23 01:12 tranlm