cog icon indicating copy to clipboard operation
cog copied to clipboard

Add a plugin system

Open yairyairyair opened this issue 1 year ago • 0 comments

Add a plugin system, can add plugins to a cog model that can run before predict, after predict and more Use cases:

  • Observability
  • Logs
  • Third party integration
  • More

i see it as something like this:

either in command line: cog build --plugin rate-limit my-model or via yaml:

plugins:
    - rate-limit

yairyairyair avatar Sep 12 '23 19:09 yairyairyair