structured-nets icon indicating copy to clipboard operation
structured-nets copied to clipboard

Structured matrices for compressing neural networks

structured-nets

Code to accompany the paper Learning Compressed Transforms with Low Displacement Rank.

Requirements

Python 3.6+

PyTorch >=0.4.1

Installing CUDA Extensions

Some functions are written in CUDA for speed. To install them:

cd pytorch/structure/hadamard_cuda
python setup.py install

cd pytorch/structure/diag_mult_cuda
python setup.py install

Example Usage

See our PyTorch section.