NikhilNayak-debug

Add OSF continual learning example

1

## Summary Adds runnable continual learning example for OSF method as requested in PR https://github.com/huggingface/peft/pull/2685 . ## Changes - New example in `examples/orthogonal_subspace_learning/` - Demonstrates OSF preventing catastrophic forgetting on...

Feature Request: Add Adaptive Singular Value Decomposition based Orthogonal Subspace Fine-Tuning

8

### Feature request We propose adding a new parameter-efficient fine-tuning method based on **adaptive singular value decomposition (SVD)** for continual learning in LLMs. The core idea is to decompose weight...