uberwow
uberwow
Hello! I got an error with running: python -m flexgen.flex_opt --model facebook/opt-30b --percent 0 100 100 0 100 0 ``` warmup - init weights Traceback (most recent call last): File...
D:\BLLaMA\venv\lib\site-packages\torch\include\pybind11\cast.h(1429): error: too few arguments for template template parameter "Tuple" detected during instantiation of class "pybind11::detail::tuple_caster [with Tuple=std::pair, Ts=]" (1507): here D:\BLLaMA\venv\lib\site-packages\torch\include\pybind11\cast.h(1503): error: too few arguments for template template parameter...