[META] Point In Time Search Issue List

[dhruv16dhr]

Is your feature request related to a problem? Please describe. This is a meta issue for all work/tasks related to Point-In-Time Search

Describe the solution you'd like To provide Point-In-Time Search capability to OpenSearch users

• [ ] OpenSearch Feature Proposal
• [ ] OpenSearch Design Proposal
• [ ] OpenSearch Dashboards Feature Proposal
• [ ] OpenSearch Dashboards(UX) Design Proposal

Tasks and Release Timelines This is a WIP and below are a list of current tasks identified related to support for Point-In-Time Search feature in both OpenSearch and OpenSearch Dashboards. We will continue to add/update tasks and timelines.

• [ ] Point-In-Time Search OpenSearch Changes (To be released in 2.4.0)
  • [x] Point-In-Time POC
  • [x] Create Point-In-Time
    • [x] Feature Branch Changes
    • [x] Merge to mainline
      • [x] Create Point-In-Time Service Layer Changes
      • [x] Create Point-In-Time API Changes
  • [x] Delete Point-In-Time
    • [x] Feature Branch Changes
    • [x] Merge to mainline
      • [x] Delete Point-In-Time Service Layer Changes
      • [x] Delete Point-In-Time API Changes
  • [ ] List all Point-In-Time
    • [ ] Merge to mainline
      • [x] List all Point-In-Time Service Layer Changes
      • [ ] List all Point-In-Time API Changes
  • [ ] Segments/Reader Context Changes
    • [ ] Merge to mainline
      • [x] Segments Service Layer Changes
      • [ ] Segments API Changes
  • [x] Node Stats Changes
    • [x] Merge to mainline
      • [x] Node Stats Service Layer Changes
      • [x] Node Stats API Changes
  • [ ] Point-In-Time Security
    • [x] Security Plugin Changes
    • [ ] Review and Appsec testing (ETA : 08/30/2022)
  • [x] Point-In-Time Performance Testing
    • [x] Add PIT related changes in OpenSearch Benchmark
    • [x] Performance testing using OpenSearch Benchmark
  • [ ] Point-In-Time Search Documentation Changes for OpenSearch
• [ ] Point-In-Time Search OpenSearch Dashboards Changes
  • [ ] Stack Management Changes
    • [ ] Stack Management POC
    • [ ] Stack Management Changes Phase 1 (To be released in 2.4.0)
    • [ ] Stack Management Changes Phase 2
  • [ ] Discover Changes (To be released in 2.4.0)
  • [ ] Visualize Changes
  • [ ] Dashboard Changes
  • [ ] Point-In-Time Search Documentation Changes for OpenSearch Dashboards

[dhruv16dhr]

@elfisher Please check whether the list is fine or not. We will keep on adding/updating the tasks and timelines. @bharath-techie @ajaymovva Please check and update the tasks as an when completed and add more granular tasks after its identified.

[dhruv16dhr]

Point-In-Time flaky tests : https://github.com/opensearch-project/OpenSearch/pull/4632

[dhruv16dhr]

@bharath-techie Lets close the previous Point In Time Security Changes open PRs and only keep the new changes with the simplified model. Did we update the security model with the simplified model that is concluded upon? If yes, lets close this alongwith pit backend design proposal

[peternied]

@bharath-techie @dhruv16dhr I'm pretty sure that you need the following pull request to be backported to 2.4. I am going to start the backport process, but wait for your confirmation/approval before merging

• https://github.com/opensearch-project/security/pull/2094
• https://github.com/opensearch-project/security/pull/2223
• https://github.com/opensearch-project/security/pull/2224

[bharath-techie]

@peternied yes that's right , we'll need this PR for 2.4 release

[dhruv16dhr]

@peternied yes that's right , we'll need this PR for 2.4 release

@bharath-techie Please close the PRs

[peternied]

Thanks, the 2.4 backport has been merged. 2.x backport is waiting on a retried CI workflow, I'll continue to shepherd those changes

[dhruv16dhr]

@bharath-techie @peternied I see that all the security (including backport PRs) are merged and closed There is nothing pending i believe, we are good for 2.4 release for "Point-In-Time Search OpenSearch Changes". Hence marked all tasks related to PIT backend as closed in this META issue.