DevinZhang

@IngwiePhoenix @codermrrob @Programer2947693 try to modiffy modles/llama-7b-hf/**tokenizer_config.json** **LLaMATokenizer -> LlamaTokenizer**

> me too Is your machine connected to the internet? I also got stuck in an offline environment at the beginning, but after the machines connected to the internet, quickly...

> The server I'm using is unable to connect to the internet. Can I configure DeepSpeed to prevent the offline environment from slowing down the NCCL initialization process? I think...

很强，想请问一下板上的i2c是device:0吗?

> 按照你这个说法是不是Actor和Critic必须是同样的分词模型才可以？我使用了llama作为Actor，opt-350m作为Critic，就出现了这个问题。如果Actor改使用opt-1.3b就是正常的。

> @research4pan ,after several trial and observation it looks like a no space on device error: self._semlock = _multiprocessing.SemLock( OSError: [Errno 28] No space left on device but i can't...

Maybe ``` self._total_batch_size ``` has not been initialized at function ``` def generate(self, *inputs, **kwargs): ```。 So , I just disable the printing code about ``` self._total_batch_size ``` . It...

Same issue!!! Have you found a solution？