Thomas Liao comments

Repositories
Issues
Comments

Results 6 comments of


                                            Thomas Liao

Create a WebUI?

Sounds good, I'd say maybe it can be enabled via a command flag... What are your thoughts?

Implement Scene Based Approach

Finally getting around to trying some stuff with this.

Problems with long Promts

Ah yeah that might depend on the model you're using, phi seems to have issues, perhaps try Mistral large?

Add Environment Variable For Row Split

Hi @heislera763, great find, I've always wondered about that asymmetrical memory usage being KV cache, but never knew about the -nkvo flag. It seems like the best default configuration would...

Req for Ollama reload of models + chapters not reaching word counts

Hmm, I've been thinking of doing a rewrite for the whole generation system so i'd imagine that might be the only real way to properly address this - will add...

[BUG] Incorrect detection of generation failure leads to infinite loop

Thank you! Would you mind making that into a PR? I'd be happy to merge it!