ColossalAI-Examples icon indicating copy to clipboard operation
ColossalAI-Examples copied to clipboard

Provide an Example for Inference

Open FrankLeeeee opened this issue 3 years ago • 2 comments

Need to provide an example of doing inference, this should be synced in the documentation as well.

FrankLeeeee avatar Feb 16 '22 09:02 FrankLeeeee

The feature depends on https://github.com/hpcaitech/ColossalAI/issues/256

binmakeswell avatar Apr 13 '22 04:04 binmakeswell

I recommend you to use the Easy and Efficient Transformer(EET) for inference.

GongZhengLi avatar Apr 19 '22 01:04 GongZhengLi