deepspeed topic

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

Xirider

Fine-Tune EleutherAI GPT-Neo And GPT-J-6B To Generate Netflix Movie Descriptions Using Hugginface And DeepSpeed

dredwardhyde

Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload

HomebrewNLP

Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.

nawnoes

Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.

pszemraj

IAM Dataset Handwriting Recognition Using CRNN, CTC Loss, DeepSpeech Beam Search, And KenLM Scorer

dredwardhyde

GLake: optimizing GPU memory management and IO transmission.

intelligent-machine-learning

Large Language Models for All, 🦙 Cult and More, Stay in touch !

shm007g

DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）

bobo0810

Collaborative Training of Large Language Models in an Efficient Way

OpenMOSS