radiobrowser-api-rust icon indicating copy to clipboard operation
radiobrowser-api-rust copied to clipboard

Several hundred duplicates in database, and how to deal with them.

Open JazzfanRS opened this issue 3 years ago • 2 comments

Finding several hundred duplicate listings (based on exact copy of individual lines.) Why aren't they culled before creating the daily .zip?

Separate issue related to duplicate listing: Allow for multiple formats instead of just one per submission. Dozens of stations have Mp3 and AAC. Allow those to be placed in one listing (submission).

JazzfanRS avatar Aug 06 '22 16:08 JazzfanRS

I've just submitted a station which has already been added I have just searched wrong. Perhaps when adding stream url which is already in the database, it should refuse to add it again.

pvagner avatar Aug 12 '22 20:08 pvagner

To my understanding there was script in place to remove duplicates, but it's been awhile since I looked that closely at the SQL. I just decided to remove them from the download with my own script along with other problems in their database. What format do you use the database in. I have it set up to download daily, delete everything but Name, Country, Language, and Genre, and source URL and format in a tab separated format (plaintext) for use by RadioSure PC app.

JazzfanRS avatar Aug 12 '22 22:08 JazzfanRS