flash-attention topic

Official release of InternLM2.5 base and chat models. 1M context support

InternLM

FlashInfer: Kernel Library for LLM Serving

flashinfer-ai

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

DefTruth

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

QwenLM

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

ymcui

Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

CoinCheung

🎉 Modern CUDA Learn Notes with PyTorch: fp32, fp16, bf16, fp8/int8, flash_attn, sgemm, sgemv, warp/block reduce, dot, elementwise, softmax, layernorm, rmsnorm.

DefTruth

Python package for rematerialization-aware gradient checkpointing

RulinShao

Utilities for efficient fine-tuning, inference and evaluation of code generation models

Naman-ntc

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

InternLM