Tugrul Konuk

icon company NVIDIA icon location Houston, TX icon location Deep learning at NVIDIA. I am an applied scientist with research interests in deep learning, large-scale numerical optimization, and high-performance computing.

Results 1 issues of Tugrul Konuk

Add LoRA support to all linear layers

22 comment

# What does this PR do ? Add LoRA support to all linear transformations in Attention and MLP modules in NeMo and MCore GPT models. **Collection**: [Note which collection this...

NLP
CI