inference topic

🚀 AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻...

HuaizhengZhang

Fast inference engine for Transformer models

OpenNMT

Deploy a ML inference service on a budget in less than 10 lines of code.

ebhy

Runtime type system for IO decoding/encoding

gcanti

A uniform interface to run deep learning models from multiple frameworks

uber

Sparsity-aware deep learning inference runtime for CPUs

neuralmagic

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

Trusted-AI

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

huggingface

🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

gvergnaud

This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.

BMW-InnovationLab