slip
slip copied to clipboard
New mogwai state dicts throw an error indicating pairwise weights are not symmetric
In the current examples of mogwai training + saving (e.g. https://github.com/songlab-cal/mogwai/blob/main/examples/gremlin_train.ipynb), after saving the model and attempting to load it in SLIP, the user gets an error indicating that the symmetry test is failing.
One workaround for now is to symmetrize the weights manually before writing. https://github.com/songlab-cal/mogwai/blob/00190e7bf4e90ac2430dbebf18a627d099f46286/mogwai/utils/functional.py#L28
Additionally, a user has to manually add a query_seq
, an integer encoded sequence, before writing.