Alexey comments

Repositories
Issues
Comments

Results 3 comments of


Alexey

[Good First Issue][NNCF]: Add INT8 weight compression conformance test for Tinyllama-1.1b PyTorch model

Hi, is it possible to take this one?

[Good First Issue][NNCF]: Add INT8 weight compression conformance test for Tinyllama-1.1b PyTorch model

Hey, what metric value is okay for tinyllama/tinyllama-1.1b-step-50k-105b ?

[Good First Issue][NNCF]: Add INT8 weight compression conformance test for Tinyllama-1.1b PyTorch model

Hi, sorry for the delay, I have reproduced on a cpu ![screenshot](https://github.com/openvinotoolkit/nncf/assets/29106459/b4f8e4d2-4d98-486e-b987-8c1e9cdd5b30) ``` import torch import nncf import transformers import whowhatbench MODEL_ID = "tinyllama/tinyllama-1.1b-step-50k-105b" tokenizer = transformers.AutoTokenizer.from_pretrained(MODEL_ID) model = transformers.AutoModelForCausalLM.from_pretrained(MODEL_ID,...