Alex Chi Z.
Alex Chi Z.
bumping distro version requires students to upgrade their LLVM version; this is better done at the beginning of the semester :(
The main thing I worry about is the excessive amount of logs + we might have accidentally changed the behavior. So this pull request is basically about trying to get...
proceeded by https://github.com/neondatabase/neon/pull/12023
staging metrics reveals initial logical size calculation is the reason; deploying the metrics to prod this week
The spike in some of the regions are right before the deployments so we don't have metrics yet this week :(
So every deployment will cause surge of on-demand downloads for every task type. Two options: * Find a way to pace those tasks so that they don't create pressure upon...
If we look closely at the storage used during restarts, it seems that we clean up a lot of data when draining the nodes; and later on we need to...
Looked at all surges when there're no deployments: they're all caused by user workloads. So we can constrain this issue only in investigating space surge during deployment/restarts.
Looks like a problem with secondary downloader: ``` 2025-06-03T11:56:36.131173Z INFO secondary_download{tenant_id=X shard_id=0000}: Removing secondary local layer 000000000000000000000000000000000000-000000067F000040050000407B0300000000__00000057DD68D0F8 because it's absent in heatmap ``` Right after the restart when the tenant...
Vlad got a fix for this issue: https://github.com/neondatabase/neon/pull/12206