cortex.cpp icon indicating copy to clipboard operation
cortex.cpp copied to clipboard

epic: Cortex Presets

Open dan-menlo opened this issue 5 months ago • 0 comments

Goal

  • Cortex is able to apply presets
  • e.g. llama3.1 presets for any llama3.1 finetune
  • Enables: https://github.com/janhq/jan/issues/2845

UX

# Filesystem
/cortexcpp
    /engines
    /models
    /presets
         /alpaca
             model.yaml
# Running
cortex run openhermes --preset llama3

# Presets
cortex presets list
cortex presets add <name> <model.yaml_to_save_as_preset>

dan-menlo avatar Sep 11 '24 05:09 dan-menlo