Hanusz Leszek

How to easily compare multiple models: - Generate multiple images at once (using batch_size and batch_count) - Change your model - Go back to the first image (the grid) (tip:...

There is an error in the documentation with a missing parameter of the each function. It should be // Now create an Opentip for each tag element $("#tags a.tag").each(function(idx, tagElement)...

> I want to give this a strong +1 as useful feature. I have different use case. This is exactly the problem that we had in gql (See issue [gql...

I have the same problem. Spreading the load on any numbers of GPUs works well will with llama.cpp Looking at the code it seems vllm expects the same number of...

@youkaichao Thanks for your input! I've tried your suggestion but could not make it work. To not pollute this issue with unrelated problems I made the issue #8270