VIPL AVSU

The state-of-art PyTorch implementation of the method described in the paper "LipNet: End-to-End Sentence-level Lipreading" (https://arxiv.org/abs/1611.01599)

VIPL-Audio-Visual-Speech-Understanding

The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the state-of-art performance in LRW-1000 dataset.

VIPL-Audio-Visual-Speech-Understanding

DenseNet3D Model In "LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild", https://arxiv.org/abs/1810.06990

VIPL-Audio-Visual-Speech-Understanding

Collection of works from VIPL-AVSU

VIPL-Audio-Visual-Speech-Understanding

Visual speech recognition with face inputs: code and models for F&G 2020 paper "Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition"

VIPL-Audio-Visual-Speech-Understanding