GenZ-LLM-Analyzer icon indicating copy to clipboard operation
GenZ-LLM-Analyzer copied to clipboard

Published 20 hours ago • verified publisher icon abhibambhaniya
→

Metadata

LLM Inference analyzer for different hardware platforms

Results 1 GenZ-LLM-Analyzer issues
Sort by recently updated
recently updated
newest added

[bug] incorrect unit in funcion get_offload_system when calculating new_offchip_BW

Hi @abhibambhaniya, I found one suspicious bug in function `get_offload_system`, in file `GenZ/LLM_inference/utils.py`. The unit of `total_memory_req` passed to this function seems to be `MB`, while `total_device_memory` is clearly `GB`...

troore avatar troore

← Metadata

33
Stars
6
Forks
Watchers

Owner

verified publisher icon abhibambhaniya

Metadata

LLM Inference analyzer for different hardware platforms

Back