ragas icon indicating copy to clipboard operation
ragas copied to clipboard

[R-266] New Propsal for `Prompt`

Open jjmachan opened this issue 1 year ago • 0 comments

Detailed Proposal: PromptObject - v0.2

User Requirements

  1. Create Simple prompts easily
  2. Typed I/O
  3. Adaption - stress test, use the current issues to understand the limitations
  4. Ability to remove reasoning and other types
  5. change demonstraction of the fly
  6. change decoding strategy (this is the responsibility of the LLM)
  7. unique identifier name for each prompt → this should also change when prompt is modified. Why?
    1. let’s say user A adapts and saves ragas at v0.1
    2. after a while he uses ragas again but with adapted language - but this time we had changed the prompt then it causes issues.

From SyncLinear.com | R-266

jjmachan avatar Jun 05 '24 18:06 jjmachan