cassandra icon indicating copy to clipboard operation
cassandra copied to clipboard

CASSANDRA-18753: Provide cassandra_latest.yaml with suitable defaults for new users

Open blambov opened this issue 2 years ago • 11 comments

The first commit renames cassandra.yaml to cassandra_latest.yaml to make it easier to see the differences, the next commit restores the main yaml, and the third one configures testing.

blambov avatar Nov 14 '23 16:11 blambov

Given test-latest will test tries+oa we could remove all oa test specific jobs to spare CI cycles as they're redundant now? Also shouldn't this ticket also enable all dtests, both python and jvm, with latest?

bereng avatar Nov 15 '23 06:11 bereng

Given test-latest will test tries+oa we could remove all oa test specific jobs to spare CI cycles as they're redundant now?

Actually, it will not test the the big-oa format but the bti-da one.

As for dtests, I'm still working on making the relevant changes.

blambov avatar Nov 15 '23 09:11 blambov

Your 'latest' does already run with SCM NONE which is the same as running with oa feature-wise. Do we see value in testing oa by itself?

What I am trying to explain is that latest will already exercise the same code paths as oa...

bereng avatar Nov 15 '23 09:11 bereng

big-oa is a separate sstable format, and it needs to be tested. Doing only base junit tests with it is likely sufficient; we can skip dtests (python or in-jvm) on it.

blambov avatar Nov 15 '23 10:11 blambov

As latest will dtest oa current features that sounds like a good compromise to me, agreed.

bereng avatar Nov 15 '23 10:11 bereng

are we (and how) dtesting this config too ? (java and python dtests), separate ticket ?

michaelsembwever avatar Nov 18 '23 04:11 michaelsembwever

^ https://github.com/apache/cassandra/pull/2896#issuecomment-1812084239

As for dtests, I'm still working on making the relevant changes.

bereng avatar Nov 20 '23 06:11 bereng

@blambov I have gone through it and you see we have only minors. I would suggest a rebase + CI runs where I will check the new circle setup. Doing that trying to follow the config.yaml changes, which I did but only cursory, would be eye watering...

bereng avatar Jan 15 '24 08:01 bereng

If this is it's CI it doesn't look pretty :-(

bereng avatar Jan 16 '24 06:01 bereng

Well, the failures appear to be as expected.

We do have a few outstanding problems that we never tested for before.

blambov avatar Jan 16 '24 08:01 blambov

CI workflows LGTM +1 on the overall approach and the PR. Disclaimer I have no deep knowledge of all the options that have been enabled but overall SGTM. Commenting in case you'd like sbdy with deep expertise in some area to doublecheck things.

I suggest sending an email to the ML to find out what you mentioned to me offline: Are we ok merging this and surfacing a number of failures?

bereng avatar Jan 18 '24 09:01 bereng