spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

Release Checklist 24.02

Open caryr35 opened this issue 2 years ago • 2 comments

Release Checklist for v24.02:

Status Task Start End Owner
Pre-release
  • - [X]
Notification to team of last feature sprint in milestone 2024-01-08 2024-01-26 @mattahrens
  • - [X]
Burndown (no new features for current release) 2024-01-29 2024-02-09 Team
  • - [X]
Update docs for current release in spark-rapids without updating release links 2024-02-05 2024-02-09 Team
  • - [X]
Create a PR to update release links 2024-02-09 2024-02-09 @nvliyuan
  • - [X]
Get RAPIDS 24.04 cudf java build working. 2024-01-22 2024-01-26 @NvTimLiu
  • - [X]
Create 24.04 branch including spark-rapids-{jni,private} and spark-rapids 2024-01-25 2024-01-26 @NvTimLiu
  • - [X]
Automerge from 24.02 to 24.04 2024-01-25 2024-01-26 @NvTimLiu
  • - [X]
Enable Jenkins builds (premerge, nightly, integration, performance) for 24.04 2024-01-25 2024-01-30 @NvTimLiu
  • - [ ]
Virtual review 2024-02-05 2024-02-16 @mattf
  • - [X]
[spark-rapids-private 24.02] Java release to sonatype 2024-02-06 2024-02-06 @NvTimLiu
  • - [X]
[spark-rapids-jni 24.02] Java release to sonatype 2024-02-06 2024-02-06 @NvTimLiu
  • - [X]
[cudf 24.02] Java release to sonatype 2024-02-05 2024-02-05 @NvTimLiu
  • - [X]
Notify RAPIDS team of javadocs for 24.02 2024-02-08 2024-02-08 @GaryShen2008
Staging release
  • - [X]
Make 24.04 the default branch 2024-02-05 2024-02-05 @jlowe
  • - [X]
Merge all remaining branch-24.02 PRs 2024-02-05 2024-02-05 Team
  • - [X]
Update spark-rapids-jni dependency version 2024-02-06 2024-02-06 @NvTimLiu
  • - [X]
Create CHANGELOG.md 2024-02-05 2024-02-05 @NvTimLiu
  • - [X]
Deliver Snapshot packages to QA 2024-02-05 2024-02-05 @NvTimLiu
  • - [X]
Create a PR (not squashed) to merge from branch-24.02 to main. Needs review from repository owner 2024-02-06 2024-02-06 @NvTimLiu
  • - [X]
Trigger the release spark-rapids Jenkins job on the main branch and deploy the jar to sonatype staging (including spark-rapids-tools/core) 2024-02-08 2024-02-08 @NvTimLiu
  • - [X]
Deliver final packages to QA 2024-02-08 2024-02-08 @NvTimLiu
  • - [X]
Run integration tests on staging jars with AQE on, UCX on, Databricks Azure, Databricks AWS, Dataproc 2024-02-06 2024-02-08 @NvTimLiu
  • - [X]
Run LHA tests on staging jars 2024-02-06 2024-02-08 @NvTimLiu
  • - [X]
CDH testing 2024-02-06 2024-02-08 @NvTimLiu
  • - [X]
QA testing with Snapshot on YARN, NGC with Volta and Ampere 2024-02-06 2023-02-08 @yuange98
  • - [X]
Run pre-processing workflow for DLRM sample use case 2024-02-06 2024-02-08 @johnzhong
  • - [X]
QA testing with final packages on YARN, NGC with Volta and Ampere 2024-02-06 2024-02-08 @yuange98
Release
  • - [X]
Tag the release and deploy the staging artifacts to maven central repository 2024-02-21 2024-02-21 @NvTimLiu
  • - [X]
Update gh-pages 2024-02-19 2024-02-21 @nvliyuan
  • - [X]
Test spark-rapids-examples repo with Spark-Rapids 24.02 2024-02-19 2024-02-21 @nvliyuan
  • - [X]
Update docs for current release in spark-rapids-examples 2024-02-19 2024-02-21 @nvliyuan
  • - [X]
Update spark-rapids.sh in https://github.com/GoogleCloudDataproc/initialization-actions/tree/master/spark-rapids for the plugin, https://github.com/GoogleCloudDataproc/initialization-actions/pull/1140 2024-02-19 2024-02-21 @nvliyuan

caryr35 avatar Nov 29 '23 17:11 caryr35

rapidsai plan to release on Thursday 2024/02/08, so we need to reschedule for cuDF-jni/rapids-jni/rapids-private release at least to 2024/02/09

NvTimLiu avatar Feb 06 '24 04:02 NvTimLiu

@SurajAralihalli has https://github.com/GoogleCloudDataproc/initialization-actions/pull/1140 ready for review to update the init script for dataproc.

viadea avatar Mar 13 '24 20:03 viadea