inference topic
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
diet-coke
A small functional language with effect inference based on Koka.
identYwaf
Blind WAF identification tool
go-ml-benchmarks
⏱ Benchmarks of machine learning inference for Go
BERT-NER
Pytorch-Named-Entity-Recognition-with-BERT
BERT-NER-TF
Named Entity Recognition with BERT using TensorFlow 2.0
face_mask_detection_openvino
Detect faces and determine whether people are wearing mask.
InfMoE
Inference framework for MoE layers based on TensorRT with Python binding
NNPACK
Acceleration package for neural networks on multi-core CPUs
lampe
Likelihood-free AMortized Posterior Estimation with PyTorch