neural-compressor icon indicating copy to clipboard operation
neural-compressor copied to clipboard

Enable 3x WOQ example in CI

Open chensuyue opened this issue 1 year ago • 2 comments

Type of Change

validation

Description

Enable 3x WOQ example in CI

Expected Behavior & Potential Risk

CI pass and accuracy gap grepped.

How has this PR been tested?

CI

Dependency Change?

No

chensuyue avatar Mar 12 '24 03:03 chensuyue

⚡ Required checks status: All passing 🟢

Groups summary

🟢 Model Tests workflow
Check ID Status Error details
Model-Test success
Model-Test (Generate Report GenerateReport) success
Model-Test (Run ONNX Model resnet50-v1-12) success
Model-Test (Run PyTorch Model resnet18) success
Model-Test (Run PyTorch Model resnet18_fx) success
Model-Test (Run TensorFlow Model darknet19) success
Model-Test (Run TensorFlow Model inception_v1) success
Model-Test (Run TensorFlow Model resnet-101) success
Model-Test (Run TensorFlow Model resnet50v1.5) success
Model-Test (Run TensorFlow Model ssd_mobilenet_v1_ckpt) success
Model-Test (Run TensorFlow Model ssd_resnet50_v1) success

These checks are required after the changes to .azure-pipelines/scripts/models/collect_log_model.py, .azure-pipelines/scripts/models/env_setup.sh, .azure-pipelines/scripts/models/generate_report.sh, .azure-pipelines/scripts/models/run_model_trigger_common.sh, .azure-pipelines/scripts/models/run_pytorch_models_trigger.sh.

🟢 Model Tests 3x workflow
Check ID Status Error details
Model-Test-3x success
Model-Test-3x (Generate Report GenerateReport) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4_dq_bnb) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4_dq_ggml) success

These checks are required after the changes to .azure-pipelines/scripts/models/collect_log_model.py, .azure-pipelines/scripts/models/env_setup.sh, .azure-pipelines/scripts/models/generate_report.sh, .azure-pipelines/scripts/models/run_model_trigger_common.sh, .azure-pipelines/scripts/models/run_pytorch_models_trigger.sh.


Thank you for your contribution! 💜

Note This comment is automatically generated and updates for 360 minutes every 180 seconds. If you have any other questions, contact chensuyue or XuehaoSun for help.

github-actions[bot] avatar Mar 12 '24 03:03 github-actions[bot]

opt_125m_woq_gptq_int4_dq_ggml failed due to functionality issue, wait for bug fix, https://dev.azure.com/lpot-inc/neural-compressor/_build/results?buildId=27848&view=logs&j=919e49eb-e265-548b-eaa7-50d75ec3f230&t=3e523e98-df0c-5dae-b5a3-249adf550033&l=434

chensuyue avatar Mar 12 '24 12:03 chensuyue