LLM-VM

LLM-VM copied to clipboard

Colab Fix

2

Closes https://github.com/anarchy-ai/LLM-VM/issues/152

bilal-aamer

Keep track of detailed information about inference, data synthesis, response sizes, latency, quality

10

cartazio

parameter/configuration management and documentation

2

we're starting to add lots of parameters for configuration of LLM invocation for data synthesis and the agents, these need to be documented and sanity checked

cartazio

Sparse LLM Inference

4

mmirman

Work with all hardware automatically

1

TheRealVish

track disk usage

4

i think we put lots of models in a disk cache

cartazio

mmirman

Add memory state management for LLMs

12

Extend context window using disc storage\RAM\cache\other

VictorOdede

Add Docker support

6

INF800

Set up instruction fine-tuning pipeline

9

it would be great to enable users to easily fine-tune base models for their unique downstream tasks

VictorOdede