Benchmark MLOps.NET

[Brett-Parker]

Describe the solution you'd like Add benchmarking to the MLOps.NET library

Additional context Suggest benchmarkdotnet but happy to have other suggests too.

Looking for input on preferred ways to implement this and what sort of things we would want as a foundation.

[Brett-Parker]

@aslotte I'd like to look into this. Looking for your guidance on what you would like for a foundation.

[aslotte]

That would be great @Brett-Parker!

Given that we want to run some of these as part of our CI pipeline, I think we'll want to keep benchmarking tests for different storage providers separate.

I suggest creating a new folder in the solution explorer called Benchmarks Within that folder, start by creating a project for e.g. benchmarking SQLServer (or whichever storage provider you think is easiest). Maybe MLOps.NET.SQLServer.Benchmark

[aslotte]

I would then keep the benchmark tests grouped by catalogs as we do with the integration tests etc (e.g. ModelCatalogBenchmarks), just so it's easier to find :)