Dr. sc. Matthew Mirman
Dr. sc. Matthew Mirman
It's probably quite a bit more than just removing that line, but this is a good first issue! I think 3.5 has different formats than 3 so the PR should...
No pytest yet - best to make a ticket for it!
This is what VLLM does: https://github.com/vllm-project/vllm
This is a great idea, but we'll need overrides for optimizations! Thats the real work of the ticket.
I think we need more details but I like the direction this is going!
Subsumes #173
post a design here!
we gotta get chat.dev back online first because otherwise we'll fail to be feature complete
unfortunately chat.dev is closed source!
@jetjodh What's your discord handle?