async-openai icon indicating copy to clipboard operation
async-openai copied to clipboard

Support for Prompt Caching in Completion Usage

Open Congyuwang opened this issue 4 months ago • 0 comments

https://platform.openai.com/docs/guides/prompt-caching

"usage": {
  "prompt_tokens": 2006,
  "completion_tokens": 300,
  "total_tokens": 2306,
  "prompt_tokens_details": {
    "cached_tokens": 1920
  },
  "completion_tokens_details": {
    "reasoning_tokens": 0
  }
}

Congyuwang avatar Oct 02 '24 03:10 Congyuwang