ghchris2021

While that IGCL library looks nice, the major defect of it IMO is that it's not AFAICT present in any analog on LINUX. Though the GPU graphics driver on LINUX...

IDK if there's any potential interest to broaden the concepts involved in "Hardware Coverage" but in case it may raise some ideas to consider in the future: You mention CPU...

q.v. I also found the way the RPC server and client deals with specifying / limiting what memory on the CPU / GPU resources to be confusing and limited and...

+1, IMO yes, this would be great to provide support for this existing framework / ecosystem of ML model running / serving. The existing openvino tools are well maintained and...