temporal icon indicating copy to clipboard operation
temporal copied to clipboard

Creates additional S3 directory structures for optimized historical data retrieval.

Open PADRESH opened this issue 6 months ago • 1 comments

In archival process temporal creates two paths in S3 visibility storage for start and close time attributes.

What changed?

In archival configuration added withSearchAttributes (boolean) to enable/disable extended search functionality. VisibilityArchiver creates additional hierarchical paths in S3 based on SearchAttributes from the archive request. The query parser now accepts filters for these SearchAttributes in combination with workflowTypeName.

Why?

Searching workflows by other attributes becomes inefficient, as these queries require full scans instead of leveraging optimized S3 paths.

How did you test it?

  • [v ] built
  • [v ] run locally and tested manually
  • [v ] covered by existing tests
  • [ ] added new unit test(s)
  • [ ] added new functional test(s)

Potential risks

More disk space is required to store data in S3.

PADRESH avatar Jun 01 '25 11:06 PADRESH

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Jun 01 '25 11:06 CLAassistant

This PR was marked as stale. Please update or close it.

github-actions[bot] avatar Sep 30 '25 00:09 github-actions[bot]