Umar Butler
Umar Butler
> Proof please.  Source: [`tiktoken`](https://github.com/openai/tiktoken) GitHub repository. See also this quick benchmark I just ran myself: ```python import tiktoken from transformers import GPT2TokenizerFast tt_tokeniser = tiktoken.encoding_for_model('gpt2') tok_tokeniser = GPT2TokenizerFast.from_pretrained('gpt2')...
On 15 March, I updated a package using `py -m twine upload --repository pypi dist/*` and experienced no issues. Today, I built a new package, seemingly having not upgraded any...
> I don't believe we typically update the floor for dependencies like pkginfo because that typically gets us into hot water with distributors. We can, but I'm not sure it's...
> Gotcha, could you please try setting `os.environ["WANDB_LOG_MODEL"] = "false"` > > [Here are our docs on it](https://docs.wandb.ai/guides/integrations/huggingface#additional-wb-settings) This does not work.
> ``` > # # log the initial model and architecture to an artifact > # with tempfile.TemporaryDirectory() as temp_dir: > # model_name = ( > # f"model-{self._wandb.run.id}" > #...
> @umarbutler, what version currently works for you? @ArtsiomWB 4.40.2
> Ah, actually `model.save_pretrained(temp_dir)` is probably the problem, which is not in the updated code anymore. I think this was the problem so should be resolved now. @ArtsiomWB you could...
@P403n1x87 Are there any updates on when we can expect a fix for this?
Update: I ended up deciding to go back to use lines of dictionaries instead of arrays, not because of this issue as my users would be capable of downloading my...