ctransformers icon indicating copy to clipboard operation
ctransformers copied to clipboard

recover from `transformers 4.34 refactored`

Open victorlee0505 opened this issue 2 years ago • 0 comments

this PR is for #154.

I believe PreTrainedTokenizer super().__init__(**kwargs) attempted to use get_vocab from LLM but self._llm = llm is not yet set, hence it can not access to the LLM.

So I move it down and it works now.

*force-pushed to change author

victorlee0505 avatar Oct 04 '23 20:10 victorlee0505