Phuc Van Le

Hi @machine424, No, I am not able to reproduce the issue with prometheus v3 yet, my system cannot be upgraded from v2 to v3 due to concerns about NBC risks....

This is the full backtrace: [backtrace.txt](https://github.com/user-attachments/files/20393379/backtrace.txt)

Hi, We would like to suggest: Prometheus should validate that a chunk reference is valid before attempting to access it. If the reference is invalid, it should fail gracefully by...

Hi @machine424, Thanks for your suggestion, let me try to reproduce the issue with the latest Prometheus version

Hi @machine424, We have just tried to reproduce the issue with the latest prometheus version (v3.4.1). the backtrace is here: [new_backtrace.txt](https://github.com/user-attachments/files/20666549/new_backtrace.txt) Hi @beorn7, I also checked something about prometheus behaviors,...

Hi @machine424 and @beorn7, Do you have any comments?

Hi @machine424 and @beorn7, I have checked prometheus source code deeper and I see the issue happened at **github.com/prometheus/prometheus/tsdb/chunks/head_chunks.go:753** that line is: **chkEnc := mmapFile.byteSlice.Range(chkStart, chkStart+ChunkEncodingSize)[0]** The root cause may...

Hi @beorn7, How can we gain more confidence that this is really the problem here? -I see this is really an issue with prometheus because it can be reproduced How...

Hi @beorn7, Thank you very much for your idea. Could I ask you a question that I see if I/O the hang 2 times in a row then the issue...

Hi @beorn7 Thank you very much for your help from your comments before that has given me more knowledge about prometheus. However, Could you please let me know who is...