cog
cog copied to clipboard
Add a plugin system
Add a plugin system, can add plugins to a cog model that can run before predict, after predict and more Use cases:
- Observability
- Logs
- Third party integration
- More
i see it as something like this:
either in command line: cog build --plugin rate-limit my-model
or via yaml:
plugins:
- rate-limit