duyuwen-duen

The rotation matrix is not orthogonal,so it can not get Rotation Quaternion

加载wiki_100w_e5_index的时候，80G的显存都会显示Error: 'err == cudaSuccess' failed

6

RuntimeError: Error in virtual void* faiss::gpu::StandardGpuResourcesImpl::allocMemory(const faiss::gpu::AllocRequest&) at /home/circleci/miniconda/conda-bld/faiss-pkg_1709244517602/work/faiss/gpu/StandardGpuResources.cpp:530: Error: 'err == cudaSuccess' failed: StandardGpuResources: alloc fail type TemporaryMemoryOverflow dev 0 space Device stream 0xbcdba10 size 32279537664 bytes (cudaMalloc error...

The Socket Timeout is displayed when a PPO is trained on multiple machines yaml: compute_environment: LOCAL_MACHINE debug: false deepspeed_config: deepspeed_multinode_launcher: standard offload_optimizer_device: none offload_param_device: none zero3_init_flag: true zero3_save_16bit_model: true zero_stage:...