tmu icon indicating copy to clipboard operation
tmu copied to clipboard

Request for maximum/minimum weight parameter

Open satunheim opened this issue 9 months ago • 0 comments

During testing of a hardware implementation of a Convolutional Coalesced TM – for MNIST – I found that setting a maximum/minimum value of the signed weights could give a boost in test accuracy, compared to training with no weight restrictions. In hardware such a limitation is required as a fixed number of bits per weight has to be allocated.

Typically, the weight limit would be rather small compared to the number of clauses and T, and this seems to be beneficial for the performance. It might affect the training time though.

It would be very useful and interesting if such a parameter could be included.

satunheim avatar Sep 26 '23 05:09 satunheim