alpacaduby
Results
3
comments of
alpacaduby
我是这么改的：在main的参数加上model_parallel_size:int=2,generator = Llama.build加上model_parallel_size=model_parallel_size,
我也碰到这个问题，您是怎么解决的？谢谢！
The paper indicates that mask ratio varies with distance, but I can't find the related code.Can you please tell me where it is,or you just set the mask ratio to...