ydb-platform
Introduce new fullsync protocol, which takes snapshot only once per synchronization
Changelog entry
Introduce new UnorderedData protocol of full synchronization which allows to take hull index snapshot only once per full sync session. New protocol will be used to send DoNotKeep flags from Phantom Flag Storage, which will be sent without relying on linear order. For now the new protocol is disabled by default.
Changelog category
- Experimental feature
:white_circle: 2025-06-06 13:20:07 UTC Pre-commit check linux-x86_64-release-asan for 19a2d4c1162004a49f24a9620174462883ff7001 has started.
:white_circle: 2025-06-06 13:20:31 UTC Artifacts will be uploaded here
:white_circle: 2025-06-06 13:24:08 UTC ya make is running...
:black_circle: 2025-06-06 14:26:44 UTC Check cancelled
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
:white_circle: 2025-06-06 13:21:04 UTC Pre-commit check linux-x86_64-relwithdebinfo for 19a2d4c1162004a49f24a9620174462883ff7001 has started.
:white_circle: 2025-06-06 13:21:14 UTC Artifacts will be uploaded here
:white_circle: 2025-06-06 13:24:54 UTC ya make is running...
:black_circle: 2025-06-06 14:26:37 UTC Check cancelled
:green_circle: 2025-06-09 07:58:28 UTC The validation of the Pull Request description is successful.
:white_circle: 2025-06-06 14:33:07 UTC Pre-commit check linux-x86_64-relwithdebinfo for 72e7083782e9e53dff66d482fd88554ad46dbb68 has started.
:white_circle: 2025-06-06 14:33:16 UTC Artifacts will be uploaded here
:white_circle: 2025-06-06 14:36:46 UTC ya make is running...
:yellow_circle: 2025-06-06 15:42:48 UTC Some tests failed, follow the links below. Going to retry failed tests...
Test history | Ya make output | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 31493 | 28800 | 0 | 2 | 2659 | 32 |
:white_circle: 2025-06-06 15:45:21 UTC ya make is running... (failed tests rerun, try 2)
:green_circle: 2025-06-06 15:55:31 UTC Tests successful.
Test history | Ya make output | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 435 (only retried tests) | 415 | 0 | 0 | 0 | 20 |
:green_circle: 2025-06-06 15:55:41 UTC Build successful.
:green_circle: 2025-06-06 15:56:00 UTC ydbd size 2.2 GiB changed* by +83.0 KiB, which is < 100.0 KiB vs main: OK
| ydbd size dash | main: 52a38518afbc6fb846975de1688f55339e8838c0 | merge: 72e7083782e9e53dff66d482fd88554ad46dbb68 | diff | diff % |
|---|---|---|---|---|
| ydbd size | 2 370 130 784 Bytes | 2 370 215 768 Bytes | +83.0 KiB | +0.004% |
| ydbd stripped size | 497 226 600 Bytes | 497 244 648 Bytes | +17.6 KiB | +0.004% |
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
:white_circle: 2025-06-06 14:34:47 UTC Pre-commit check linux-x86_64-release-asan for 72e7083782e9e53dff66d482fd88554ad46dbb68 has started.
:white_circle: 2025-06-06 14:34:58 UTC Artifacts will be uploaded here
:white_circle: 2025-06-06 14:38:28 UTC ya make is running...
:yellow_circle: 2025-06-06 16:20:08 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...
Test history | Ya make output | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 16203 | 16033 | 0 | 79 | 65 | 26 |
:white_circle: 2025-06-06 16:21:30 UTC ya make is running... (failed tests rerun, try 2)
:yellow_circle: 2025-06-06 16:55:54 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...
Test history | Ya make output | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 1447 (only retried tests) | 1283 | 0 | 93 | 49 | 22 |
:white_circle: 2025-06-06 16:56:11 UTC ya make is running... (failed tests rerun, try 3)
:yellow_circle: 2025-06-06 17:29:04 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet
Test history | Ya make output | Test bloat | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 1438 (only retried tests) | 1292 | 0 | 55 | 72 | 19 |
:green_circle: 2025-06-06 17:29:20 UTC Build successful.
:yellow_circle: 2025-06-06 17:29:54 UTC ydbd size 3.9 GiB changed* by +148.8 KiB, which is >= 100.0 KiB vs main: Warning
| ydbd size dash | main: 52a38518afbc6fb846975de1688f55339e8838c0 | merge: 72e7083782e9e53dff66d482fd88554ad46dbb68 | diff | diff % |
|---|---|---|---|---|
| ydbd size | 4 168 557 864 Bytes | 4 168 710 192 Bytes | +148.8 KiB | +0.004% |
| ydbd stripped size | 1 446 006 584 Bytes | 1 446 064 728 Bytes | +56.8 KiB | +0.004% |
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
:white_circle: 2025-06-20 13:04:22 UTC Pre-commit check linux-x86_64-release-asan for da8b1a1d4d6635dd1ab5bbef7f0917cb06fefb72 has started.
:white_circle: 2025-06-20 13:04:33 UTC Artifacts will be uploaded here
:white_circle: 2025-06-20 13:08:20 UTC ya make is running...
:yellow_circle: 2025-06-20 15:23:28 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...
Test history | Ya make output | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 16298 | 15988 | 0 | 99 | 185 | 26 |
:white_circle: 2025-06-20 15:25:05 UTC ya make is running... (failed tests rerun, try 2)
:yellow_circle: 2025-06-20 16:00:10 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...
Test history | Ya make output | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 1690 (only retried tests) | 1440 | 0 | 51 | 173 | 26 |
:white_circle: 2025-06-20 16:00:30 UTC ya make is running... (failed tests rerun, try 3)
:yellow_circle: 2025-06-20 16:31:15 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet
Test history | Ya make output | Test bloat | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 1555 (only retried tests) | 1308 | 0 | 53 | 169 | 25 |
:green_circle: 2025-06-20 16:31:33 UTC Build successful.
:red_circle: 2025-06-20 16:32:08 UTC ydbd size 3.9 GiB changed* by +2.5 MiB, which is >= 2.0 MiB vs main: Alert
| ydbd size dash | main: 40c48d44bbf274a4367dfe2520d0ac23fdae10ab | merge: da8b1a1d4d6635dd1ab5bbef7f0917cb06fefb72 | diff | diff % |
|---|---|---|---|---|
| ydbd size | 4 180 699 536 Bytes | 4 183 312 304 Bytes | +2.5 MiB | +0.062% |
| ydbd stripped size | 1 449 321 432 Bytes | 1 450 233 048 Bytes | +890.2 KiB | +0.063% |
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
:white_circle: 2025-06-20 13:04:22 UTC Pre-commit check linux-x86_64-relwithdebinfo for da8b1a1d4d6635dd1ab5bbef7f0917cb06fefb72 has started.
:white_circle: 2025-06-20 13:04:34 UTC Artifacts will be uploaded here
:white_circle: 2025-06-20 13:08:37 UTC ya make is running...
:yellow_circle: 2025-06-20 14:57:39 UTC Some tests failed, follow the links below. Going to retry failed tests...
Test history | Ya make output | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 38696 | 35962 | 0 | 3 | 2676 | 55 |
:white_circle: 2025-06-20 15:01:27 UTC ya make is running... (failed tests rerun, try 2)
:green_circle: 2025-06-20 15:13:20 UTC Tests successful.
Test history | Ya make output | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 598 (only retried tests) | 565 | 0 | 0 | 0 | 33 |
:green_circle: 2025-06-20 15:13:32 UTC Build successful.
:yellow_circle: 2025-06-20 15:13:53 UTC ydbd size 2.2 GiB changed* by +1.4 MiB, which is >= 100.0 KiB vs main: Warning
| ydbd size dash | main: 40c48d44bbf274a4367dfe2520d0ac23fdae10ab | merge: da8b1a1d4d6635dd1ab5bbef7f0917cb06fefb72 | diff | diff % |
|---|---|---|---|---|
| ydbd size | 2 376 655 024 Bytes | 2 378 137 864 Bytes | +1.4 MiB | +0.062% |
| ydbd stripped size | 498 045 256 Bytes | 498 309 160 Bytes | +257.7 KiB | +0.053% |
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
:white_circle: 2025-06-22 15:25:37 UTC Pre-commit check linux-x86_64-relwithdebinfo for 2844cef75634ebacfceb1183bba505a82f4b839c has started.
:white_circle: 2025-06-22 15:25:49 UTC Artifacts will be uploaded here
:white_circle: 2025-06-22 15:29:42 UTC ya make is running...
:yellow_circle: 2025-06-22 17:21:14 UTC Some tests failed, follow the links below. Going to retry failed tests...
Test history | Ya make output | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 38706 | 36001 | 0 | 3 | 2665 | 37 |
:white_circle: 2025-06-22 17:24:33 UTC ya make is running... (failed tests rerun, try 2)
:green_circle: 2025-06-22 17:43:17 UTC Tests successful.
Test history | Ya make output | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 480 (only retried tests) | 448 | 0 | 0 | 0 | 32 |
:green_circle: 2025-06-22 17:43:25 UTC Build successful.
:green_circle: 2025-06-22 17:43:45 UTC ydbd size 2.2 GiB changed* by +90.7 KiB, which is < 100.0 KiB vs main: OK
| ydbd size dash | main: 4b5dfbac9c85d94343d9b5a69763a625f3263fff | merge: 2844cef75634ebacfceb1183bba505a82f4b839c | diff | diff % |
|---|---|---|---|---|
| ydbd size | 2 378 943 848 Bytes | 2 379 036 688 Bytes | +90.7 KiB | +0.004% |
| ydbd stripped size | 498 353 128 Bytes | 498 376 264 Bytes | +22.6 KiB | +0.005% |
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
:white_circle: 2025-06-22 15:26:01 UTC Pre-commit check linux-x86_64-release-asan for 2844cef75634ebacfceb1183bba505a82f4b839c has started.
:white_circle: 2025-06-22 15:26:12 UTC Artifacts will be uploaded here
:white_circle: 2025-06-22 15:30:03 UTC ya make is running...
:yellow_circle: 2025-06-22 17:59:44 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...
Test history | Ya make output | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 16308 | 15889 | 0 | 123 | 272 | 24 |
:white_circle: 2025-06-22 18:01:09 UTC ya make is running... (failed tests rerun, try 2)
:yellow_circle: 2025-06-22 18:39:39 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...
Test history | Ya make output | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 2201 (only retried tests) | 1946 | 0 | 54 | 177 | 24 |
:white_circle: 2025-06-22 18:39:59 UTC ya make is running... (failed tests rerun, try 3)
:yellow_circle: 2025-06-22 19:13:35 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet
Test history | Ya make output | Test bloat | Test bloat | Test bloat
| TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED? |
|---|---|---|---|---|---|
| 1557 (only retried tests) | 1310 | 0 | 50 | 177 | 20 |
:green_circle: 2025-06-22 19:13:51 UTC Build successful.
:yellow_circle: 2025-06-22 19:14:25 UTC ydbd size 3.9 GiB changed* by +153.8 KiB, which is >= 100.0 KiB vs main: Warning
| ydbd size dash | main: 4b5dfbac9c85d94343d9b5a69763a625f3263fff | merge: 2844cef75634ebacfceb1183bba505a82f4b839c | diff | diff % |
|---|---|---|---|---|
| ydbd size | 4 185 149 944 Bytes | 4 185 307 432 Bytes | +153.8 KiB | +0.004% |
| ydbd stripped size | 1 450 983 192 Bytes | 1 451 041 080 Bytes | +56.5 KiB | +0.004% |
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation