Eric

icon location haha

Results 2 comments of Eric

FileNotFoundError: ... thundersvm.dll' (or one of its dependencies)

I am facing the same issue!!!!!!!!!!!!

ValueError: The model's max seq len (4096) is larger than the maximum number of tokens that can be stored in KV cache (3792). Try increasing `gpu_memory_utilization` or decreasing `max_model_len` when initializing the engine.

问题解决了吗？为也遇到类似问题