inference topic

LightSeq: A High Performance Library for Sequence Processing and Generation

bytedance

💎1MB lightweight face detection model (1MB轻量级人脸检测模型)

Linzaer

TensorFlow template application for deep learning

tobegit3hub

The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.

onepanelio

Highly optimized inference engine for Binarized Neural Networks

larq

Cross-platform, customizable ML solutions for live and streaming media.

google-ai-edge

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its c...

Tencent

The challenge projects for Inferencing machine learning models on iOS

tucan9389

Adlik: Toolkit for Accelerating Deep Learning Inference

Adlik

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Tencent