maxtext icon indicating copy to clipboard operation
maxtext copied to clipboard

CPU Inference Configs

Open priyanka-ganesha opened this issue 1 year ago • 0 comments

Inference decode configurations intended for CPU for model sizes 1B, 4B, 8B, and 16B parameters.

priyanka-ganesha avatar Jan 22 '24 10:01 priyanka-ganesha