andrewPoulton
Results
2
issues of
andrewPoulton
Attempts to address #308, altering tokenizer path to a single universal hf-format file. Since a bunch of user code would inevitably have the old merges/vocab filepaths baked in, I included...
cla signed
As noted in #689, convert_to_singleton doesn't produce statedicts with compatible keys (for some unknown reason). Since reshard_mp can do the same job, without the GPU node requirement of convert_to_singleton, we...
enhancement