aphrodite-engine icon indicating copy to clipboard operation
aphrodite-engine copied to clipboard

Update Kobold Lite Embed

Open Pyroserenus opened this issue 1 year ago • 3 comments

Syncs the kobold lite embed and disables certain features that aphrodite cannot currently use. KoboldCPP impersonation version has not been incremented as no new features need to be enabled.

Pyroserenus avatar Jul 15 '24 02:07 Pyroserenus

Should list the main changes or better yet separate those into a different comnit... so future devs will be able to replicate this effort. As lite is bound to keep evolving and changing. From first glance I can't actually tell what features was modified or missing

LostRuins avatar Jul 16 '24 05:07 LostRuins

Should list the main changes or better yet separate those into a different comnit... so future devs will be able to replicate this effort. As lite is bound to keep evolving and changing. From first glance I can't actually tell what features was modified or missing

It is a different commit, there's two commits with this PR, the first replaces the klite embed with the current one, the second adjusts non functional features to require koboldcpp impersonation at 1.71

This is a dirty fix at the end of the day, but memory not working was a critical functionality issue.

Pyroserenus avatar Jul 16 '24 10:07 Pyroserenus

True, fair enough

LostRuins avatar Jul 16 '24 15:07 LostRuins