chatAir icon indicating copy to clipboard operation
chatAir copied to clipboard
verified publisher icon flyun

cached prompt and batch api

Open ram-dev007 opened this issue 1 year ago • 1 comments

does chatair support cached prompt and batch api? if not included kindly have this option, this will help to reduce the api cost.

ram-dev007 avatar Oct 28 '24 16:10 ram-dev007

Caching functionality is not supported. Subsequent versions will provide a search function to search existing content.

flyun avatar Nov 03 '24 13:11 flyun