dalai
dalai copied to clipboard
Added `ctx_size` to the config
Issue: when running model on systems with low ram the model throws segmentation fault error because of default context size, which is 2 G.B. by default.
Changes: this PR contains addition of new config which allows user to change context size directly from the UI.