pyvene icon indicating copy to clipboard operation
pyvene copied to clipboard

Save/load trainable params in `IntervenableBase` methods

Open aryamanarora opened this issue 9 months ago • 0 comments

Description

Add saving/loading of trainable parameters in the model (e.g. classification heads) to IntervenableModel.save() and IntervenableModel.load(). Draft PR since some tests are failing, will finalise tomorrow.

Testing Done

Saving/loading of Gemma 2B-IT for sequence classification works perfectly.

Checklist:

  • [ ] My PR title strictly follows the format: [Your Priority] Your Title
  • [ ] I have attached the testing log above
  • [ ] I provide enough comments to my code
  • [ ] I have changed documentations
  • [ ] I have added tests for my changes

aryamanarora avatar May 02 '24 06:05 aryamanarora