Deepak Vij

[2025-10-12 21:14:09] Load weight end. type=GptOssForCausalLM, dtype=torch.bfloat16, avail mem=163.13 GB, mem usage=14.53 GB. [kvcached][INFO][2025-10-12 21:14:09][page_allocator.py:152] Init kvcached KV cache allocator: num_layers=24, mem_size_per_layer=179288MB, total_mem_size=8605824MB, page_size=2MB, tp_size=1, async_sched=True, contiguous_layout=True, enable_prealloc=True [kvcached][WARNING][2025-10-12 21:14:09][interfaces.py:84]...