ck
ck copied to clipboard
mlcommons
Collective Mind (CM) is a small, modular, cross-platform and decentralized workflow automation framework with a human-friendly interface and reusable automation recipes to make it easier to build, run...
We have implemented [these tests](https://github.com/mlcommons/ck/issues/275) so far for checking CM script features. This issue is to keep track of new features which can be added to CM tests. - [...
Hi @arjunsuresh. Our script https://github.com/mlcommons/ck/tree/master/cm-mlops/script/run-mlperf-inference-app fails when --submitter has a space. I think it's a relatively simple thing but it will be good to fix it. Do you mind to...
While dealing with CM scripts with huge cache entry sizes, it is useful if we can add an option to specify the cache entry location on disk. May be we...
I encountered a KeyError: 'target_latency' while running the following command: ``` cm run script --tags=run-mlperf,inference,_submission,_all-scenarios --model=resnet50 \ --device=cpu --implementation=reference --backend=onnxruntime --execution-mode=valid \ --category=edge --division=open --quiet ``` This error occurred when...
Hi [Repository/Project Team], I encountered a warning while installing a Python package using pip install cmind on Ubuntu through Windows Subsystem for Linux (WSL). The solution was to update the...
We need to print a warning to suggest to migrate to [mlcommons@cm4mlops](https://github.com/mlcommons/cm4mlops)
Aggregating tasks to improve CM core based on user feedback (*this ticket is being gradually updated*): ## Functionality - [x] Add support to check min CM version for automations and...
Hello, I have no idea what I'm doing. I'm trying to run on an ARM64 system, and I get the following errors: I ran the loadgen install and everything worked...
Based on user feedback, we need to add global CM config (env vars, etc) for CM scripts in either .cm or CM directory ... It can be used to configure...
It's time to considerably simplify and refactor CM and CM-MLOps docs and tutorials based on user feedback from the last 6 months! - [ ] Main page showing links to...