kavern1128

希望增加转换成int4的选项。

2

希望模型转换那里增加转换成int4的选项。谢谢

windows下面编译失败

8

D:/Programming/InferLLM/src/file.h: In destructor 'inferllm::InputFile::~InputFile()': D:/Programming/InferLLM/src/file.h:36:13: error: 'munmap' was not declared in this scope 36 | munmap(m_mmap_addr, m_size); | ^~~~~~ ninja: build stopped: subcommand failed.