deep-pipeline

@gauravjoshi2034 is your problem solved or no longer an issue? it would be good to close this issue if it no longer requires attention of others. Thank you.

@tejarao1156 and @s-ravi18 did the above advice help you? if so please say (or clarify any additions) so that this issue could be closed.

So, Apple Silicon M1/M2 (ARM) support is much desired by people who want to use software which is dependent on bitsandbytes.. however looking back over the issues logs, the (sole)...

Just popped back here after much busy-ness / distraction elsewhere and delighted to see beginnings of collective momentum. Many thanks @rickardp for detailed positive reply and great to see @phdykd...

This looks really useful for integration/deployment of llama.cpp into docker hosted services on cloud! Is there anything (apart from the vast amount of other activity ;-) ) holding up this...

Hi folks, just a very gentle nudge again on this front - last time I checked here the total open pull-requests on this repo were about 65, a month later...

@arcor74 is the issue solved? si esto ya no es un problema, ¿se puede cerrar?

@poedator on the basis of the above discussion, where it looks like folks are moving the codebase in the right direction and have clarified that manual deletion is fine, are...

Hard to say how much this will make a difference but possibly with bigger prompts on smaller systems it could be meaningful? Just to observe that, with PR #1461 (nvidia-docker...

I like the idea of this because many folk will be scraping together whatever RAM, old or new or different GPU hardware they can find to maximise VRAM and throughput...