magnet
magnet copied to clipboard
the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
put this in as _f argument and add levels for info warn fatal. should have a default writable log path for unix machines minimum with timestamps prior to what otherwise...
Make it possible to do accelerated embedding on Macs.
NATS has improved the object meta data for the consumer/producers of data, should absolutely be used for basic bandwidth transparency
ggml or something, there are great libraries we may depend on if they are small enough
can query on the fly on the node with the `magnet.ron` llm but cannot query remotely to a distributed llm node