OpenAdapt
OpenAdapt copied to clipboard
Explore State-Space-Model (SSM) / Mambachat
Feature request
How can we incorporate ideas in https://github.com/havenhq/mamba-chat / https://arxiv.org/abs/2311.18257?
Motivation
Transformers are memory intensive.