Inconsistent data between `/data/doc` and `data/query`

[AbdallahAbis]

Normally this document shouldn't exist as it was deleted using cleint.delete but for some reason, it still exists on /query as a full document, and on the studio as an empty document!

Making an HTTP request to the /query endpoint

https://<<acc_id>>.api.sanity.io/v2021-06-07/data/query/production/?query=*[_id == "1GTUUGED6PZ227984"]{_id}

Returns (normally it should not return the document as it was deleted!)

{
    "query": "*[_id == \"1GTUUGED6PZ227984\"]{_id}",
    "result": [
        {
            "_id": "1GTUUGED6PZ227984"
        }
    ],
    "ms": 13
}

Making same HTTP request to /doc endpoint

https:/<<acc_id>>.api.sanity.io/v2021-06-07/data/doc/production/1GTUUGED6PZ227984

Returns (which is correct)

{
    "documents": [],
    "omitted": [
        {
            "id": "1GTUUGED6PZ227984",
            "reason": "existence"
        }
    ]
}

P.S. It's not only one single document, it's more than 200 documents.

[zhongzc]

Victoria-metrics does not clean up stale data in a partition in which still some valid data, so those stale data are visible before all data in that partition become stale.

Yesterday the part /data2/production/prometheus-9090/data/tsdb/data/small/2022_03/300830982_1104130_20220320163212.000_20220324122734.000_16DC81B605210EBA was removed by VM, data are as expected.