scylladb [x86_64, dev] topology_custom/test_topology_failure_recovery failed with ConfigurationException

https://jenkins.scylladb.com/job/scylla-master/job/next/8286/ failed with the following error:


=================================== FAILURES ===================================
_______________ test_tablet_drain_failure_during_decommission.5 ________________

manager = <test.pylib.manager_client.ManagerClient object at 0x7f88be3a2840>

    @pytest.mark.asyncio
    @skip_mode('release', 'error injections are not supported in release mode')
    async def test_tablet_drain_failure_during_decommission(manager: ManagerClient):
        cfg = {'enable_user_defined_functions': False, 'enable_tablets': True}
        servers = [await manager.server_add(config=cfg) for _ in range(3)]
    
        logs = [await manager.server_open_log(srv.server_id) for srv in servers]
        marks = [await log.mark() for log in logs]
    
        cql = manager.get_cql()
        await cql.run_async("CREATE KEYSPACE test WITH replication = {'class': 'NetworkTopologyStrategy', 'replication_factor': 1} AND tablets = {'initial': 32};")
        await cql.run_async("CREATE TABLE test.test (pk int PRIMARY KEY, c int);")
    
        logger.info("Populating table")
    
        keys = range(256)
        await asyncio.gather(*[cql.run_async(f"INSERT INTO test.test (pk, c) VALUES ({k}, {k});") for k in keys])
    
        await inject_error_on(manager, "stream_tablet_fail_on_drain", servers)
    
        await manager.decommission_node(servers[2].server_id, expected_error="Decommission failed. See earlier errors")
    
        matches = [await log.grep("raft_topology - rollback.*after decommissioning failure, moving transition state to rollback to normal",
                   from_mark=mark) for log, mark in zip(logs, marks)]
        assert sum(len(x) for x in matches) == 1
    
>       await cql.run_async("DROP KEYSPACE test;")
E       cassandra.protocol.ConfigurationException: <Error from server: code=2300 [Query invalid because of configuration issue] message="Cannot drop non existing keyspace 'test'.">

test/topology_custom/test_topology_failure_recovery.py:46: ConfigurationException
------------------------------ Captured log setup ------------------------------

Oct 03 '24 10:10 scylladb-promoter

Could be dup of https://github.com/scylladb/scylladb/issues/20060 ?

Oct 06 '24 10:10 mykaul

Seen again in https://jenkins.scylladb.com/job/scylla-master/job/next/8293/

Oct 06 '24 13:10 scylladb-promoter

Seen again in https://jenkins.scylladb.com/job/scylla-master/job/next/8300/

Oct 07 '24 17:10 scylladb-promoter

Seen again in https://jenkins.scylladb.com/job/scylla-6.2/job/next/29/

Oct 08 '24 09:10 scylladb-promoter

Seen in https://jenkins.scylladb.com/job/scylla-6.1/job/scylla-ci/105/testReport/junit/(root)/test_topology_failure_recovery/Tests___Unit_Tests___test_tablet_drain_failure_during_decommission_dev_4/

Oct 09 '24 08:10 ptrsmrn

Duplicate of https://github.com/scylladb/scylladb/issues/20060. I won't close it because the bot will just open a new issue.

Oct 15 '24 06:10 denesb

Seen again in https://jenkins.scylladb.com/job/scylla-master/job/next/8342/

Oct 17 '24 14:10 scylladb-promoter

Seen again in https://jenkins.scylladb.com/job/scylla-6.0/job/next/284/

Oct 22 '24 13:10 scylladb-promoter

Seen again in https://jenkins.scylladb.com/job/scylla-master/job/next/8394/

Oct 28 '24 00:10 scylladb-promoter

Seen again in https://jenkins.scylladb.com/job/scylla-master/job/next/8399/

Oct 28 '24 17:10 scylladb-promoter

https://github.com/scylladb/scylladb/issues/20060 ?

Oct 29 '24 08:10 mykaul