Implement external blob precharge in read iterator

[SammyVimes]

Changelog category

• Improvement

[github-actions[bot]]

:white_circle: 2024-06-19 23:00:53 UTC Pre-commit check for 1abad0ca8662996c3c96b9345fa2012fd415544c has started. :white_circle: 2024-06-19 23:03:44 UTC Build linux-x86_64-release-asan is running... :red_circle: 2024-06-19 23:27:48 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-19 23:00:59 UTC Pre-commit check for 1abad0ca8662996c3c96b9345fa2012fd415544c has started. :white_circle: 2024-06-19 23:03:48 UTC Build linux-x86_64-release-clang14 is running... :red_circle: 2024-06-19 23:33:40 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-19 23:01:02 UTC Pre-commit check for 1abad0ca8662996c3c96b9345fa2012fd415544c has started. :white_circle: 2024-06-19 23:03:54 UTC Build linux-x86_64-relwithdebinfo is running... :red_circle: 2024-06-19 23:27:04 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 10:42:07 UTC Pre-commit check for bd1178ef4718effcd3d39d0411ead89c94512225 has started. :white_circle: 2024-06-20 10:44:43 UTC Build linux-x86_64-relwithdebinfo is running... :red_circle: 2024-06-20 10:56:18 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 10:56:42 UTC Pre-commit check for bd1178ef4718effcd3d39d0411ead89c94512225 has started. :white_circle: 2024-06-20 10:59:16 UTC Build linux-x86_64-release-clang14 is running... :red_circle: 2024-06-20 11:14:57 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 11:01:53 UTC Pre-commit check for bd1178ef4718effcd3d39d0411ead89c94512225 has started. :white_circle: 2024-06-20 11:05:06 UTC Build linux-x86_64-release-asan is running... :red_circle: 2024-06-20 11:18:50 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 16:44:12 UTC Pre-commit check for 0c6dfa7080bbcc7b3cc26b4c4b82022497615fe6 has started. :white_circle: 2024-06-20 16:46:51 UTC Build linux-x86_64-release-asan is running... :red_circle: 2024-06-20 17:08:26 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 16:56:30 UTC Pre-commit check for 0c6dfa7080bbcc7b3cc26b4c4b82022497615fe6 has started. :white_circle: 2024-06-20 16:59:02 UTC Build linux-x86_64-relwithdebinfo is running... :red_circle: 2024-06-20 17:21:00 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 16:57:14 UTC Pre-commit check for 0c6dfa7080bbcc7b3cc26b4c4b82022497615fe6 has started. :white_circle: 2024-06-20 16:59:56 UTC Build linux-x86_64-release-clang14 is running... :red_circle: 2024-06-20 17:29:24 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 18:19:13 UTC Pre-commit check for c2e74fc991ebf33c1aa31a5a444dfebe51dc1d44 has started. :white_circle: 2024-06-20 18:21:46 UTC Build linux-x86_64-release-asan is running... :red_circle: 2024-06-20 18:40:45 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 18:45:25 UTC Pre-commit check for c2e74fc991ebf33c1aa31a5a444dfebe51dc1d44 has started. :white_circle: 2024-06-20 18:48:01 UTC Build linux-x86_64-relwithdebinfo is running... :red_circle: 2024-06-20 19:07:22 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-20 18:47:36 UTC Pre-commit check for c2e74fc991ebf33c1aa31a5a444dfebe51dc1d44 has started. :white_circle: 2024-06-20 18:50:08 UTC Build linux-x86_64-release-clang14 is running... :red_circle: 2024-06-20 19:12:46 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-24 14:09:45 UTC Pre-commit check for eccba6c187aa88eae8afac60469a06e13cdfca34 has started. :white_circle: 2024-06-24 14:12:32 UTC Build linux-x86_64-release-clang14 is running... :red_circle: 2024-06-24 14:41:30 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-24 14:10:00 UTC Pre-commit check for eccba6c187aa88eae8afac60469a06e13cdfca34 has started. :white_circle: 2024-06-24 14:12:43 UTC Build linux-x86_64-release-asan is running... :red_circle: 2024-06-24 14:35:10 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-24 14:10:42 UTC Pre-commit check for eccba6c187aa88eae8afac60469a06e13cdfca34 has started. :white_circle: 2024-06-24 14:13:21 UTC Build linux-x86_64-relwithdebinfo is running... :red_circle: 2024-06-24 14:36:26 UTC Build failed. see the build logs.

[github-actions[bot]]

:white_circle: 2024-06-25 10:33:35 UTC Pre-commit check for b368271aa6e3268d13cf983f49920f39d021d547 has started. :white_circle: 2024-06-25 10:36:22 UTC Build linux-x86_64-release-clang14 is running... :green_circle: 2024-06-25 11:02:37 UTC Build successful.

[github-actions[bot]]

:white_circle: 2024-06-25 10:33:38 UTC Pre-commit check for b368271aa6e3268d13cf983f49920f39d021d547 has started. :white_circle: 2024-06-25 10:36:26 UTC Build linux-x86_64-relwithdebinfo is running... :green_circle: 2024-06-25 10:56:15 UTC Build successful. :white_circle: 2024-06-25 10:56:29 UTC Tests are running... :red_circle: 2024-06-25 13:26:19 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
72481	59073	0	3	13395	10

:yellow_circle: 2024-06-25 13:27:06 UTC ydbd size 8.4 GiB changed* by +127.3 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: 43fb2368f5279a2c76f9c6b941c6f93e7ca3251f	merge: b368271aa6e3268d13cf983f49920f39d021d547	diff	diff %
ydbd size	8 970 290 048 Bytes	8 970 420 408 Bytes	+127.3 KiB	+0.001%
ydbd stripped size	488 720 808 Bytes	488 722 472 Bytes	+1.6 KiB	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-06-25 10:33:40 UTC Pre-commit check for b368271aa6e3268d13cf983f49920f39d021d547 has started. :white_circle: 2024-06-25 10:36:32 UTC Build linux-x86_64-release-asan is running... :green_circle: 2024-06-25 10:57:47 UTC Build successful. :white_circle: 2024-06-25 10:58:01 UTC Tests are running... :red_circle: 2024-06-25 13:07:40 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11615	10997	0	100	349	169

:green_circle: 2024-06-25 13:08:37 UTC ydbd size 5.5 GiB changed* by +58.7 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash	main: 43fb2368f5279a2c76f9c6b941c6f93e7ca3251f	merge: b368271aa6e3268d13cf983f49920f39d021d547	diff	diff %
ydbd size	5 860 956 664 Bytes	5 861 016 752 Bytes	+58.7 KiB	+0.001%
ydbd stripped size	1 256 493 416 Bytes	1 256 498 344 Bytes	+4.8 KiB	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[SammyVimes]

Tracing of identical blob reads (10 blobs 1MiB each) gives these results:

Without this patch, 70ms on average

With this patch, 30ms on average

[github-actions[bot]]

:white_circle: 2024-07-02 11:08:48 UTC Pre-commit check for 4670c203cfc6e5bcddeb2da3024615d3c76e5e79 has started. :white_circle: 2024-07-02 11:11:59 UTC Build linux-x86_64-release-clang14 is running... :green_circle: 2024-07-02 11:44:27 UTC Build successful.

[github-actions[bot]]

:white_circle: 2024-07-02 11:34:22 UTC Pre-commit check for 4670c203cfc6e5bcddeb2da3024615d3c76e5e79 has started. :white_circle: 2024-07-02 11:37:13 UTC Build linux-x86_64-release-asan is running... :green_circle: 2024-07-02 12:20:24 UTC Build successful. :white_circle: 2024-07-02 12:20:36 UTC Tests are running... :red_circle: 2024-07-02 14:24:48 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11119	10498	0	107	341	173

:yellow_circle: 2024-07-02 14:25:34 UTC ydbd size 5.4 GiB changed* by +161.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: 8bf9bede4981408507098dbc2d095ce3ac731643	merge: 4670c203cfc6e5bcddeb2da3024615d3c76e5e79	diff	diff %
ydbd size	5 829 829 424 Bytes	5 829 994 728 Bytes	+161.4 KiB	+0.003%
ydbd stripped size	1 251 537 384 Bytes	1 251 563 784 Bytes	+25.8 KiB	+0.002%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-07-02 11:54:04 UTC Pre-commit check for 4670c203cfc6e5bcddeb2da3024615d3c76e5e79 has started. :white_circle: 2024-07-02 11:57:15 UTC Build linux-x86_64-relwithdebinfo is running... :green_circle: 2024-07-02 12:54:37 UTC Build successful. :white_circle: 2024-07-02 12:54:53 UTC Tests are running... :red_circle: 2024-07-02 14:47:24 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
39586	34373	0	5	5195	13

:yellow_circle: 2024-07-02 14:47:54 UTC ydbd size 8.3 GiB changed* by +228.9 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: 8bf9bede4981408507098dbc2d095ce3ac731643	merge: 4670c203cfc6e5bcddeb2da3024615d3c76e5e79	diff	diff %
ydbd size	8 946 683 664 Bytes	8 946 918 024 Bytes	+228.9 KiB	+0.003%
ydbd stripped size	487 864 872 Bytes	487 872 744 Bytes	+7.7 KiB	+0.002%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-07-02 17:38:37 UTC Pre-commit check for de44261f1ebd1aa0ce129e21757c4eb012d2897b has started. :white_circle: 2024-07-02 17:41:54 UTC Build linux-x86_64-relwithdebinfo is running... :green_circle: 2024-07-02 18:38:48 UTC Build successful. :white_circle: 2024-07-02 18:39:02 UTC Tests are running... :red_circle: 2024-07-02 20:41:20 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
39594	34389	0	5	5185	15

:green_circle: 2024-07-02 20:41:56 UTC ydbd size 8.3 GiB changed* by -20.0 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: bc07740ae6d8d18b372108cd2f5851164f035bfe	merge: de44261f1ebd1aa0ce129e21757c4eb012d2897b	diff	diff %
ydbd size	8 946 692 728 Bytes	8 925 726 080 Bytes	-20.0 MiB	-0.234%
ydbd stripped size	487 865 640 Bytes	486 779 432 Bytes	-1.0 MiB	-0.223%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-07-02 17:44:11 UTC Pre-commit check for de44261f1ebd1aa0ce129e21757c4eb012d2897b has started. :white_circle: 2024-07-02 17:47:16 UTC Build linux-x86_64-release-clang14 is running... :green_circle: 2024-07-02 18:19:01 UTC Build successful.

[github-actions[bot]]

:white_circle: 2024-07-02 17:50:55 UTC Pre-commit check for de44261f1ebd1aa0ce129e21757c4eb012d2897b has started. :white_circle: 2024-07-02 17:54:14 UTC Build linux-x86_64-release-asan is running... :green_circle: 2024-07-02 18:36:42 UTC Build successful. :white_circle: 2024-07-02 18:36:56 UTC Tests are running... :red_circle: 2024-07-02 20:34:05 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11128	10541	0	91	323	173

:green_circle: 2024-07-02 20:34:47 UTC ydbd size 5.4 GiB changed* by -14.9 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: 29e3cb438ab5f6df73768785433c2506ee5263ec	merge: de44261f1ebd1aa0ce129e21757c4eb012d2897b	diff	diff %
ydbd size	5 829 838 496 Bytes	5 814 174 192 Bytes	-14.9 MiB	-0.269%
ydbd stripped size	1 251 538 728 Bytes	1 247 816 008 Bytes	-3.6 MiB	-0.297%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-07-02 21:14:36 UTC Pre-commit check for a8df58e5907ed878edf7f87c23b4e8474c640b80 has started. :white_circle: 2024-07-02 21:17:35 UTC Build linux-x86_64-release-clang14 is running... :green_circle: 2024-07-02 21:22:46 UTC Build successful.

[github-actions[bot]]

:white_circle: 2024-07-02 21:17:38 UTC Pre-commit check for a8df58e5907ed878edf7f87c23b4e8474c640b80 has started. :white_circle: 2024-07-02 21:20:21 UTC Build linux-x86_64-relwithdebinfo is running... :green_circle: 2024-07-02 21:58:08 UTC Build successful. :white_circle: 2024-07-02 21:58:33 UTC Tests are running... :red_circle: 2024-07-02 23:54:14 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
39592	34392	0	1	5185	14

:green_circle: 2024-07-02 23:54:57 UTC ydbd size 8.3 GiB changed* by -20.0 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: b286ca162f348d897fe141d87aacf262715f3492	merge: a8df58e5907ed878edf7f87c23b4e8474c640b80	diff	diff %
ydbd size	8 946 651 768 Bytes	8 925 727 088 Bytes	-20.0 MiB	-0.234%
ydbd stripped size	487 914 408 Bytes	486 779 432 Bytes	-1.1 MiB	-0.233%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-07-02 21:18:01 UTC Pre-commit check for a8df58e5907ed878edf7f87c23b4e8474c640b80 has started. :white_circle: 2024-07-02 21:20:52 UTC Build linux-x86_64-release-asan is running... :green_circle: 2024-07-02 21:45:16 UTC Build successful. :white_circle: 2024-07-02 21:45:33 UTC Tests are running... :red_circle: 2024-07-02 23:50:04 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11126	10531	0	86	335	174

:green_circle: 2024-07-02 23:51:10 UTC ydbd size 5.4 GiB changed* by -15.2 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: b286ca162f348d897fe141d87aacf262715f3492	merge: a8df58e5907ed878edf7f87c23b4e8474c640b80	diff	diff %
ydbd size	5 830 111 408 Bytes	5 814 174 144 Bytes	-15.2 MiB	-0.273%
ydbd stripped size	1 251 671 464 Bytes	1 247 815 752 Bytes	-3.7 MiB	-0.308%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-07-03 11:18:02 UTC Pre-commit check for b8f80fa29bdb68c1ec3e39e77f14729219d36630 has started. :white_circle: 2024-07-03 11:21:34 UTC Build linux-x86_64-release-asan is running... :green_circle: 2024-07-03 12:07:30 UTC Build successful. :white_circle: 2024-07-03 12:07:40 UTC Tests are running... :red_circle: 2024-07-03 14:09:43 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11127	10543	0	88	322	174

:green_circle: 2024-07-03 14:10:31 UTC ydbd size 5.4 GiB changed* by +31.5 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash	main: bd87563b37b0229e33a66cb64e909ccddaf1b172	merge: b8f80fa29bdb68c1ec3e39e77f14729219d36630	diff	diff %
ydbd size	5 814 908 560 Bytes	5 814 940 816 Bytes	+31.5 KiB	+0.001%
ydbd stripped size	1 247 931 016 Bytes	1 247 936 552 Bytes	+5.4 KiB	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-07-03 11:21:01 UTC Pre-commit check for b8f80fa29bdb68c1ec3e39e77f14729219d36630 has started. :white_circle: 2024-07-03 11:24:15 UTC Build linux-x86_64-relwithdebinfo is running... :green_circle: 2024-07-03 12:22:10 UTC Build successful. :white_circle: 2024-07-03 12:22:21 UTC Tests are running... :red_circle: 2024-07-03 14:27:28 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
39593	34382	0	5	5189	17

:green_circle: 2024-07-03 14:28:11 UTC ydbd size 8.3 GiB changed* by +31.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash	main: bd87563b37b0229e33a66cb64e909ccddaf1b172	merge: b8f80fa29bdb68c1ec3e39e77f14729219d36630	diff	diff %
ydbd size	8 926 807 928 Bytes	8 926 839 888 Bytes	+31.2 KiB	+0.000%
ydbd stripped size	486 814 568 Bytes	486 816 424 Bytes	+1.8 KiB	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}