mypydl

Results 3 comments of mypydl

I have also discovered this problem. Have you solved it? After 24 hours of training (DETR) on 8*2080Ti, the memory useage was over 400GB!

> I have also discovered this problem with pytorch version 2.0. Have you solved it? After 24 hours of training (DETR) on 8*2080Ti, the memory useage was over 400GB! When...

segment_anything/modeling/mask_decoder.py -- line126-127 ```python src = torch.repeat_interleave(image_embeddings, tokens.shape[0], dim=0) src = src + dense_prompt_embeddings ``` All image_embeddings will be copied 4 times. [4, 256, 64, 64] -> [4*4=16, 256, 64,...