ydb icon indicating copy to clipboard operation
ydb copied to clipboard

Merge secrets usage improvements to stable-25-3-2-streaming

Open yurikiselev opened this issue 1 month ago • 4 comments

Changelog category

  • Not for changelog (changelog entry is not required)

Description for reviewers

(This PR is a logical copy of https://github.com/ydb-platform/ydb/pull/30541)

  • Добавлены новые настройки для секретов (*_PATH) в командах, использующих секреты
  • Сделана поддержка этих настроек в асинхронных репликациях, трансферах и внешних источниках данных
  • Поддержан дамп и рестор этих настроек в локальную файловую систему
  • Добавлены ретраи ошибок схемного кеша, которые можно ретраить
  • Багфикс кейса, когда в запросе приходят два одинаковых секрета
  • Добавлены функциональные тесты, проверяющие в том числе миграцию на новые секреты

Фича отключена, на продовое поведение влиять не должно.

yurikiselev avatar Dec 12 '25 09:12 yurikiselev

Run Extra Tests

Run additional tests for this PR. You can customize:

  • Test Size: small, medium, large (default: all)
  • Test Targets: any directory path (default: ydb/)
  • Sanitizers: ASAN, MSAN, TSAN
  • Coredumps: enable for debugging (default: off)
  • Additional args: custom ya make arguments

▶  Run tests

ydbot avatar Dec 12 '25 09:12 ydbot

:white_circle: 2025-12-12 09:12:02 UTC Pre-commit check linux-x86_64-relwithdebinfo for dd57b333743adddb7532920b6d2b983d2716cf3f has started. :white_circle: 2025-12-12 09:12:27 UTC Artifacts will be uploaded here :white_circle: 2025-12-12 09:16:41 UTC ya make is running... :yellow_circle: 2025-12-12 11:05:20 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
41269 38562 0 7 2674 26

:white_circle: 2025-12-12 11:05:33 UTC ya make is running... (failed tests rerun, try 2) :green_circle: 2025-12-12 11:24:38 UTC Tests successful.

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
999 (only retried tests) 980 0 0 0 19

:green_circle: 2025-12-12 11:24:40 UTC Build successful. :green_circle: 2025-12-12 11:25:00 UTC ydbd size 2.3 GiB changed* by -23.2 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 017c5855578b457fb947631fc169363fc447d4d6 merge: dd57b333743adddb7532920b6d2b983d2716cf3f diff diff %
ydbd size 2 468 728 488 Bytes 2 444 351 088 Bytes -23.2 MiB -0.987%
ydbd stripped size 525 341 088 Bytes 522 539 336 Bytes -2.7 MiB -0.533%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

github-actions[bot] avatar Dec 12 '25 09:12 github-actions[bot]

:green_circle: 2025-12-12 09:20:35 UTC The validation of the Pull Request description is successful.

github-actions[bot] avatar Dec 12 '25 09:12 github-actions[bot]

:white_circle: 2025-12-12 09:13:49 UTC Pre-commit check linux-x86_64-release-asan for dd57b333743adddb7532920b6d2b983d2716cf3f has started. :white_circle: 2025-12-12 09:15:49 UTC Artifacts will be uploaded here :white_circle: 2025-12-12 09:19:29 UTC ya make is running... :yellow_circle: 2025-12-12 11:29:01 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
17997 17460 0 223 292 22

:green_circle: 2025-12-12 11:29:08 UTC Build successful. :green_circle: 2025-12-12 11:29:37 UTC ydbd size 3.8 GiB changed* by -61.4 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 017c5855578b457fb947631fc169363fc447d4d6 merge: dd57b333743adddb7532920b6d2b983d2716cf3f diff diff %
ydbd size 4 134 132 184 Bytes 4 069 710 808 Bytes -61.4 MiB -1.558%
ydbd stripped size 1 534 512 760 Bytes 1 515 419 776 Bytes -18.2 MiB -1.244%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

github-actions[bot] avatar Dec 12 '25 09:12 github-actions[bot]