Saika

Thank you for sharing the code! This is my script run.sh: ``` CUDA_VISIBLE_DEVICES=0,1,2,3 OMP_NUM_THREADS=1 python -m torch.distributed.launch --nproc_per_node=4 --master_port 12345 main_pretrain.py \ --num_workers 10 \ --accum_iter 2 \ --batch_size 128...