Shintarou Okada

icon indicating an email [email protected]

icon location C++ programmer under the eave

Results 13 issues of Shintarou Okada

Prepare docker file

[menoh-ruby](https://github.com/pfnet-research/menoh-ruby) and [menoh-yolo](https://github.com/Hakuyume/menoh-yolo) has docker file. menoh also should have docker file.

Support torch model bin format

This PR enables to load models which contain pytorch model bin format files only (not safetensors format).

Fix local completion huggingface tokenizer

2 comment

Fixes related to the tokenizer in the constructor of the OpenaiCompletionsLM class Added the `huggingface_tokenizer_trust_remote_code` argument to the `__init__` method, allowing the `trust_remote_code` option to be set when initializing the...