Rohit Kr Singh comments

Repositories
Issues
Comments

Results 3 comments of


                                            Rohit Kr Singh

Swag update?

Any update now? It's been 11 more days since the last query 😁

Question about hf to model.lit conversion

Hi, I'm working with [FastChat-3B](https://huggingface.co/lmsys/fastchat-t5-3b-v1.0). Any luck with that being supported with existing mappings?

Edited: Alternative methods to perform model loading & sharding operation such that only sharded model utilizes GPU VRAM

I'm working on a Jupyter like notebook & implemented `ddp_notebook` strategy as FSDP was giving an error for notebook environments. Below is a code snippet from [finetune/lora.py](https://github.com/Lightning-AI/lit-gpt/blob/main/finetune/lora.py) main method which...