structured-nets
structured-nets copied to clipboard
Structured matrices for compressing neural networks
This follows https://github.com/HazyResearch/structured-nets/issues/7 in which we discussed updating the code to use PyTorch's complex tensors. The pull request also extracts all tests into a `tests/` directory, so it's easy to...
If I run `toeplitz_cpu.py` I get [[ -8. -10. -2. 8.] [ 8. -4. 6. 32.]] [[-16. -20. -4. 16.] [ 16. -8. 12. 64.]] [[8.8817842e-16 6.0000000e+00 1.6000000e+01 2.6000000e+01] [0.0000000e+00...
Hi @tridao , Thanks for this implementation. Everywhere in the code I notice that the weight matrices are assumed to be square. Did you guys perform any experiments with rectangular...
Hi, I've tried your repo and find that using the same input data, hadamard_transform_cuda and hadamard_transform_torch would have different outputs. Here is an example: batch_size = 10 n = 64...
Hi, It seems I am unable to use the `hadamard_transform_cuda` function for some reason. I checked that there is no issue with the installation. When I ran `python setup.py install`,...
Hello, Can you update support with cuda 10.2? Thanks