DKNTZMN

[Feature] Flash Attention In-app Feature Option Request

1

May I request for an option to enable flash attention option in the UI. Current model is spitting nonsense and requires flash attention to run.

Current version have flash attention support, but can you add an additional option for flash attention 2?