memory-efficient topic
Dragon
Dragon: A Computation Graph Virtual Machine Based Deep Learning Framework.
memory-efficient-attention-pytorch
Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
GC-DPR
Train Dense Passage Retriever (DPR) with a single GPU
optimized_transducer
Memory efficient transducer loss computation
madoka-python
Memory-efficient Count-Min Sketch Counter (based on Madoka C++ library)
Social-Implicit
Code for: "Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimation" Accepted @ ECCV2022
scarf
Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.
ringattention
Transformers with Arbitrarily Large Context
CAME
The official implementation of "CAME: Confidence-guided Adaptive Memory Optimization"