SwissArmyTransformer
SwissArmyTransformer copied to clipboard
Cannot use torch.compile with SAT
I tried to use torch.compile but failed with SAT. The reason is that self.transformer.hooks.clear() in base_model.py also clear the hooks of torch.compile?