(TBN) Beatmap processor did not finish processing

[stevefan1999-personal]

Just want to be sure we don't have an existing issue, but the symptom looks like this:

I migrated a lot of maps from my old drive into the new one. There are about 1000 songs to be imported at once. Seems like the beatmap processor caught a stroke and did not finish processing. Far as I can tell, all the files and songs data (including BGA, music and hit sounds) are intact and readable. I think it maybe related to Data/bt?

Reproduction: I replicated the old Songs folder into a clone, emptied the old one and cut some cloned beatmap into the new empty Songs folder. This problem can be consistently triggered even with 200 maps to load at once.

Also I can click update to latest version and then get the map back partially. But only to that specific diff however, so far in my testing (so you can "recover" Extra but not the rest like Insane or Hard).

Repairing osu does not help, and I believe we might need to throttle the degree of parallelism for beatmap processor to prevent a potential race condition (alas, at the cost of performance) which I believe is the case that corrupted the index database. If this problem truly is never seen before, I would (or any dev, much appreciated) like to escalate this into an issue.

Originally posted by @stevefan1999-personal in https://github.com/ppy/osu/discussions/23270

[peppy]

I have no idea what to say here.

Please provide a zipped copy of your corrupt database and a video showing the process of what you're doing, and hopefully log files from the client after entering the bad state.

I highly doubt this will result in any change. We've never seen this happen to anyone else, so it's very likely to be something specific to your hardware/software configuration. We've already made massive changes under the hood in lazer to ensure issues like this no longer occur.

[stevefan1999-personal]

collection.zip Here's the DB first, for video evidence I need to setup OBS first...(I need to do this again because I wiped my gaming setup and turned my PC to be a workstation instead after starting to work)

[stevefan1999-personal]

https://github.com/ppy/osu-stable-issues/assets/29133953/7ce4b6ea-5dfc-4bfc-a465-2dbcec683886

can't believe that still took me half an hour...with HandBrake postprocessing of course

[peppy]

I think you should delete and recreate your database.

[stevefan1999-personal]

@peppy I did it before and it doesn't work either