Dmitry Mayorov issues

Repositories
Issues
Comments

Results 2 issues of


                                            Dmitry Mayorov

CUDA out of memory

Following [openwebtext](https://github.com/pomonam/kronfluence/tree/main/examples/openwebtext) example, I several times faced errors like this. torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 784.00 MiB. GPU 2 has a total capacity of 79.15 GiB of...

[BUG?] Missing accumulate_iterations call in pairwise score computation when compute_per_module_scores=True

Is there a critical bug in `score/dot_product.py` where `accumulate_iterations` is only called when `compute_per_module_scores=False`, causing incorrect module state management when computing per-module pairwise scores? - **File**: `score/dot_product.py` - **Function**: `compute_dot_products_with_loader`...