llm-optimization topic

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models

jxzhangjhu

Superpipe - optimized LLM pipelines for structured data

villagecomputing

Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.

romsto