Clementine icon indicating copy to clipboard operation
Clementine copied to clipboard

Clementine creates duplicates in library

Open Clementine-Issue-Importer opened this issue 10 years ago • 76 comments

From apgrant2 on April 19, 2011 03:33:37

What steps will reproduce the problem? 1.Using Clementine over time 2.Updating Music library automatically 3.Perhaps it is a copying songs to device issue? What is the expected output? What do you see instead? It is expected to have only one song appear in Clementine when there is only one such song on my hard disk however Clementine seems to be creating multiple copies of songs. I haven't been able to narrow down the issue to any one event. It just seems that over time a duplicate is added. This goes for every album in my library. Some have 5 dupes. Others have 10 dupes. Though none have more than 10. What version of the product are you using? On what operating system? I'm using Clementine 0.7 r3146 and QT 4.70. This being used on Ubuntu 10.10. Please provide any additional information below. The dupes began at two and have grown larger over time until they've reached 10 dupes per song on some albums. When I use another music player such as Banshee or Rhythmbox there are no dupes. Also, when I check my Music folder for dupes there are no dupes. I've been searching the forums and such for any leads but haven't found any. Also, I've checked this site for someone reporting the same kind of issue and have also come up empty. If I makes duplicatesam mistaken in any way please advise. I want nothing more than to continue to use Clementine.

Attachment: Selection_005.png

Original issue: http://code.google.com/p/clementine-player/issues/detail?id=1785

From keirangtp on April 19, 2011 05:17:13

As a workaround try using "Tools / Rescan whole library" - this will probably remove the duplicates but the process may take some time especially if you have a huge library.

Restarting Clementine doesn't help - the duplicates are still there?

Summary: Clementine creates duplicates in library

From apgrant2 on April 19, 2011 10:46:08

I've tried that in the past and it hasn't worked but I'm hoping it does this time and unfortunately restarting it doesn't help either.

From keirangtp on April 20, 2011 00:58:40

When did you try it? 0.7 has a whole library rescan feature, 0.6 had only "refresh changed folders" feature and that one wouldn't fix it. http://code.google.com/p/clementine-player/wiki/LibraryScanning

From apgrant2 on April 20, 2011 09:39:56

I tried it recently with version 0.7's library rescan feature and no joy. I've also restarted Clementine a bunch and have been regularly updating the version from my update manager as they arise but alas I still have dupes all over the place. It's very strange.

From chuck.smith08 on April 20, 2011 13:00:48

Just saw this issue.....

I reported as issue 1790 and am having the same issue, Re-scan does not work....

Probably should merge these issues....

From davidsansome on April 20, 2011 13:17:02

Issue 1790 has been merged into this issue.

From chuck.smith08 on April 20, 2011 17:50:06

I tracked down a problem that I believe is where the duplicates are coming from. My music folder is:

/media/storage/Music

Inside that folder there is a link to /media/storage/Music, etc. The resulting directory structure is:

/media/storage/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music/Music

I can only assume clementine created but I do not know how or when..

From apgrant2 on April 22, 2011 02:50:09

Hmm.. that does sound plausible considering that when I choose the option to delete the dupes from disc in Clementine it drops an error regarding being able to delete the songs. I assume it's because the songs aren't actually there but are rather somehow linked to the original song. Also however, how or when or why I have no idea.

From apgrant2 on April 22, 2011 03:02:26

A rather inelegant solution depending on how large your collection is to choose the "Organize Files" option in Clementine with "Overwrite existing files" clicked and "Delete the original Files" selected in the "After Copying" section located at the top of the menu. Take note however that I have not tested for unforeseen after effects. So, use at your own risk.

From schizosfera on June 03, 2011 07:26:26

i had a similar problem when duplicates appeared in my library. usually one of the duplicate entries would have an invalid path. that was because of some reason, clementine stored escaped file url's in the database (spaces were escaped as %20). doing library rescans didn't remove any of the invalid entries (which displayed as duplicates). manually deleting the entries from the db fixed my problem.

From schizosfera on June 04, 2011 03:24:26

i just noticed that (mp3, cue) pairs create duplicates in my library (probably when rescanning the library). i'm not sure if it's actually the same issue, but it definitely looks like the same symptom.

Attachment: mp3 with cue duplicates.png

From adam.chrzascik on June 06, 2011 05:36:45

To reproduce the bug(?) on Win7 x64:

Install r3341 version over (not clean install) existing stable 0.7.1 release with library in place. Now rescan the library. For every song you will have two entries in library view, with paths in properties shown differently :

D:\Music\U2\How To Dismantle An Atomic Bomb\01 - Vertigo.mp3 \d\Music\U2\How To Dismantle An Atomic Bomb\01 - Vertigo.mp3

Restart computer. Now paths look like this:

file:\D:\Music\U2\How%20To%20Dismantle%20An%20Atomic%20Bomb\01%20-%20Vertigo.mp3 file:\D:\Music\U2\How To Dismantle An Atomic Bomb\01 - Vertigo.mp3

Now run stable installer again, rescan the library, and you will get third entry with correct path:

D:\Music\U2\How To Dismantle An Atomic Bomb\01 - Vertigo.mp3 file:\D:\Music\U2\How%20To%20Dismantle%20An%20Atomic%20Bomb\01%20-%20Vertigo.mp3 file:\D:\Music\U2\How To Dismantle An Atomic Bomb\01 - Vertigo.mp3

Cheers,

From schizosfera on June 06, 2011 05:51:08

it seems like the escaped file URIs (those containing the %20's )are the new standard entries. a migrate for the other "old" DB is not available yet, but is planned (so i heard) - probably with the next release.

@adam.chrzascik: the entries starting with file:/// are probably the working/correct ones. strange thing that on windows they use backslashes instead of slashes in URIs...

From keirangtp on June 11, 2011 12:39:13

Labels: Milestone-1.0

From ColdAssassin008 on June 15, 2011 00:44:13

Im also having this problem. It seems that somehow it is getting the wrong directory path.

C:\Users\ColdAssassin\Music\Jap\M-Flo\m-flo - inside-WORKS BESTII-\disk1\04 I Know.mp3 This is my real path C:\Users\ColdAssassin\Music\Jap\m-flo\m-flo - inside-WORKS BESTII-\disk1\04 I Know.mp3 and this is the duplicate path name. Oh I figured out what the problem was. somehow the dash was causing the duplicates so i just remove "M-Flo" and made it "MFlo" and the duplicates were removed.

From nalle.karhulitos on August 03, 2011 10:56:17

I got rid of my duplicates by $ cd .config/Clementine $ cp clementine.db clementine.db.bk $ sqlite3 clementine.db sqlite> delete from songs where filename like 'file:///%'; sqlite> .quit

From [email protected] on August 04, 2011 13:14:11

I had an issue earlier that I think belongs to this ticket: I used the organise files function to "move" an album (after fixing the artist tag) from "Vnv Nation" to "VNV Nation". And while my OS is case-sensitive (OSX), I guess sqlite might not be and so I had duplicate records for each track in the album (both the old and new artist name).

A full library scan would probably have fixed it but instead I "cheated" and renamed the artist folder to something else (not using clementine), waited for auto-update to remove the songs and then changed it back so after the second auto-update it only found the one copy of each track.

From keirangtp on August 18, 2011 11:20:22

Issue 2086 has been merged into this issue.

From davidsansome on September 24, 2011 04:24:06

Issue 2248 has been merged into this issue.

From davidsansome on November 12, 2011 18:01:53

Labels: -Milestone-1.0

From john.maguire on January 05, 2012 03:24:34

Issue 2566 has been merged into this issue.

From spackmat on February 06, 2012 03:42:27

Having the same trouble on all my 3 installations: Seems as if neraly every startup of Clementine rescans the library and adds another duplicate entry for every track. In all cases the music is stored on a network share and the library base is given as a UNC-path (\homeserver\music), the computers are running Win7 x86 and x64. The rescan takes much time just like a complete new scan.

I rebuilt the whole library several times, but after promising restarts with a quick (a few seconds) library scan without creating duplicates it always fell back into the behaviour described above rendering the library-feature completely useless.

From jen.mclean8 on March 14, 2012 04:00:47

Exactly the same issue. Library on network drive, duplicates on restart. Remove and re-add library, fine until next restart.

From ajgallego on March 24, 2012 09:50:23

For me the solution was the one at the comment #16

From ibefraggle on May 08, 2012 10:30:33

Confirming #22/23. Win7 x64, some music on network share, some on local hard drive. Anytime the library updates (folder contents change, manually from Tools menu, on startup), new duplicate library entries of every song in the network share are created. These library entries have no apparent way of being removed, short of removing the network share from the library folder list in Preferences. Deleting the files does not help.

Wondering if this is a seperate issue to 1785.

From sebastiangoncalves on July 13, 2012 10:42:31

Got the same issue after upgrading from 10.10 to 11.04 (yesterday).

I solved in a simple way: Tools -> Preferences -> Music Library, then select folder with mouse, press and finally <Add new folder> selecting the original folder

From ayatzid on December 11, 2012 10:34:28

and my saved playlists...gone with the wind...

From ivan.gojkovic on December 13, 2012 13:42:14

Sorry, people. This issue is too long with no reply. My clementine is going to trash for good. RhitmBox seams to be best for linux, and Aimp for Win. Ciao...

From spackmat on December 13, 2012 14:28:29

Same here, I love the featureset of Clementine, but with music on a windows network share it is really unstable, not just with the persisting problem of the many duplicate entries in the library. It starts relly slow and hangs constantly for several seconds with no response. Sad, but I have to look after a new player again.

From dtverder on January 02, 2013 23:50:55

I have started using Clementine 1.1 on Windows 7 (previously I mainly used it on Fedora) and I am also starting to get lots of duplicates on large playlists, e.g. 'all tracks' or 'all unplayed'. The tracks it happens to seem to be the ones not properly tagged and with basic file names such 'Track01.mp3'. The duplicates seem to occur in multiples of five, usually it duplicates the track ten times but sometimes it is five or fifteen.