वेदांत issues

Results 29 issues of


                                            वेदांत

Increased test coverage for lora/qlora

## Increased test coverage for lora/qlora ## Motivation and Context #3145 Test for lora includes TEST config validation : ``` test_qlora_4bit_validation ``` ``` test_basic_configuration_validation ``` TEST Freeze : ``` test_parameter_freezing_gradient_behavior...

feat:merge-lora iterate through bins without loading

# Description feature 1 : The merge-lora script does not load the model into memory, period. It just iterates through each of the bin or safetensors shards and applies the...

Refactor Loraconfig and model constructor

Refactor Loraconfig and model constructor ## Description Refactor Loraconfig and model constructor refactor introduces a builder-based adapter loading pattern for lora configurations and model construction : ) ## Motivation and...

Increase test coverage for Lora and qlora

### ⚠️ Please check that this feature request hasn't been suggested before. - [x] I searched previous [Ideas in Discussions](https://github.com/axolotl-ai-cloud/axolotl/discussions/categories/ideas) didn't find any similar feature requests. - [x] I searched...

enhancement

NCCL timeout when using ``` lora_target_modules ``` gate_proj, up_proj, down_proj with MOE models

### Please check that this issue hasn't been reported before. - [x] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior training should run fine ###...

bug

Move the construction of the LoraConfig and LoraModel to a separate builder

enhancement

qa-lora integration

# Description qa-lora integration ## Motivation and Context #2878 ## How has this been tested? run the ``` qalora.yml ``` file present ## Types of changes added 2 qalora specific...

wontfix

auto suggestions for typo

## Description support for auto suggestions for typo ## Development notes auto suggestion work when entered variable with typo ## Checklist - [X] Read the [contributing](https://github.com/kedro-org/kedro/blob/main/CONTRIBUTING.md) guidelines - [X] Signed...

Hacktoberfest

# Fix for matmul_4bit out Parameter Issue

fix: matmul_4bit out parameter handling for 1D and 2D tensors - Fix incorrect handling of out parameter in matmul_4bit for 1D tensors - Improve shape validation in gemv_4bit.out to handle...