outlines icon indicating copy to clipboard operation
outlines copied to clipboard

fix: Make `convert_token_to_string` pickleable

Open saattrupdan opened this issue 1 year ago • 2 comments

This moves the convert_token_to_string helper function out as an independent function, to make it pickleable.

This is causing issues when storing logits processors in a class that needs to be pickleable.

saattrupdan avatar Oct 31 '24 15:10 saattrupdan

@rlouf, does this seem good to you?

saattrupdan avatar Nov 10 '24 11:11 saattrupdan

Tests were failing for unrelated reasons, I just rebased on main

rlouf avatar Jan 23 '25 15:01 rlouf

Hi @saattrupdan ! We've recently released Outlines v1 that modifies a bit our models. What you were working on is now called VLLMOffline and is located in the outlines/models/vllm_offline.py file. Otherwise, it looks like what you propose is still applicable though.

RobinPicard avatar Jun 19 '25 16:06 RobinPicard