full library scan does not find all tracks

[Clementine-Issue-Importer]

From [email protected] on February 24, 2012 18:13:10

What steps will reproduce the problem? 1.Do a full library rescan 2. 3. What is the expected output? What do you see instead? expected output: all tracks get added to my library(should be ca 20000) instead:only some get added (ca. 12000) What version of the product are you using? On what operating system? Version 1.0.1 Archlinux 3.2.6-2 Please provide any additional information below. complicated folder structure (e.g. B/Billy Talent/Billy Talent III/) works fine with other music players

Original issue: http://code.google.com/p/clementine-player/issues/detail?id=2746

[Clementine-Issue-Importer]

From [email protected] on February 24, 2012 09:54:09

is issue 2621

[Clementine-Issue-Importer]

From davidsansome on February 27, 2012 06:17:30

Issue 2761 has been merged into this issue.

[Clementine-Issue-Importer]

From [email protected] on June 17, 2012 10:30:16

This could be the same as issue 1509 .

[Clementine-Issue-Importer]

From [email protected] on June 17, 2012 19:49:47

I captured the stdout output of clementine while it was doing a full library rescan and diff'd that (after some regexing to extract filenames) with a list of all the music files it should have found.

Oddly, almost all of the missing folders begin with A, though there are a handful of other ones (one F, one T, etc).

[Clementine-Issue-Importer]

From [email protected] on September 04, 2012 01:18:06

Found a workaround:

as soon as clementine recognizes, that a certain song is unavailable in the file system, it adds an "unavailable" flag to the corrosponding entry in the database. this flag prevents the corrosponding file to be returned by any search queries.

the workaround is as follows: locate the clementine database file. open it with the "sqlite3" program demark all unavailable songs with the query "update songs set unavailable=0;"

on my system the following command worked:

shell# killall clementine shell# sqlite3 .config/Clementine/clementine.db 'update songs set unavailable=0' shell# clementine

[Clementine-Issue-Importer]

From [email protected] on February 24, 2013 11:29:44

I have the same problem after doing a full library rescan. When I search for Beatles in the Library search bar, I get songs from artists not in any way related to the Beatles. Also files that were deleted appear in my library. Below is a stack trace:

19:26:25.262 DEBUG WorkerPool<HandlerType>:281 Starting worker 0x7f16b2610440 "/usr/bin/clementine-tagreader" "/tmp/clementine_522537841" 19:26:25.268 INFO main:46 TagReader worker connecting to "/tmp/clementine_522537841" 19:26:25.269 DEBUG WorkerPool<HandlerType>:301 Worker 0x7f16ac00c450 connected to "/tmp/clementine_522537841" 19:26:25.319 INFO Player:550 Registered URL handler for "di" 19:26:25.319 DEBUG InternetModel:98 Adding internet service: "DigitallyImported" 19:26:25.369 DEBUG InternetModel:98 Adding internet service: "Icecast" 19:26:25.392 DEBUG InternetModel:98 Adding internet service: "Jamendo" 19:26:25.403 INFO Player:550 Registered URL handler for "lastfm" 19:26:25.403 DEBUG CoverProviders:34 Registered cover provider "last.fm" 19:26:25.404 DEBUG InternetModel:98 Adding internet service: "Last.fm" 19:26:25.406 INFO Player:550 Registered URL handler for "grooveshark" 19:26:25.407 DEBUG InternetModel:98 Adding internet service: "Grooveshark" 19:26:25.409 INFO Player:550 Registered URL handler for "jazzradio" 19:26:25.410 DEBUG InternetModel:98 Adding internet service: "JazzRadio" 19:26:25.411 INFO Player:550 Registered URL handler for "magnatune" 19:26:25.411 DEBUG InternetModel:98 Adding internet service: "Magnatune" 19:26:25.411 DEBUG InternetModel:98 Adding internet service: "Podcasts" 19:26:25.422 DEBUG InternetModel:98 Adding internet service: "SavedRadio" 19:26:25.423 INFO Player:550 Registered URL handler for "sky" 19:26:25.423 DEBUG InternetModel:98 Adding internet service: "SKY.fm" 19:26:25.424 INFO Player:550 Registered URL handler for "somafm" 19:26:25.425 DEBUG InternetModel:98 Adding internet service: "SomaFM" 19:26:25.426 DEBUG InternetModel:98 Adding internet service: "SoundCloud" 19:26:25.427 DEBUG SpotifyService:77 Spotify system blob path: "/usr/bin/clementine-spotifyblob" 19:26:25.427 DEBUG SpotifyService:78 Spotify local blob path: "/home/tommy/.config/Clementine/spotifyblob/version14-64bit/blob" 19:26:25.427 DEBUG InternetModel:98 Adding internet service: "Spotify" 19:26:25.430 DEBUG NetworkProxyFactory:30 Detected system proxy URLs: ("", "", "", "") 19:26:25.431 DEBUG CoverProviders:34 Registered cover provider "Amazon" 19:26:25.431 DEBUG CoverProviders:34 Registered cover provider "Discogs" 19:26:25.460 WARN IconLoader:54 Couldn't load icon "clementine-panel" 19:26:25.477 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.477 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.477 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.479 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.480 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.480 WARN IconLoader:54 Couldn't load icon "clementine-panel-grey" 19:26:25.496 DEBUG GnomeGlobalShortcutBackend:50 registering 19:26:25.499 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.500 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.502 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.503 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.503 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.503 WARN unknown QPixmap: It is not safe to use pixmaps outside the GUI thread 19:26:25.638 DEBUG MainWindow:194 Starting 19:26:25.904 DEBUG MainWindow:245 Initialising player 19:26:25.935 DEBUG MainWindow:251 Creating models 19:26:26.036 DEBUG MainWindow:269 Creating UI 19:26:26.102 DEBUG MainWindow:626 Creating equalizer 19:26:26.105 DEBUG MainWindow:648 Creating now playing widget 19:26:26.261 DEBUG MainWindow:689 Loading settings 19:26:26.268 WARN unknown "sni-qt/4857" WARN 19:26:26.268 void StatusNotifierItemFactory::connectToSnw() Invalid interface to SNW_SERVICE
19:26:26.300 DEBUG MainWindow:744 Started 19:26:26.301 INFO DeviceManager:426 Device added: "DeviceKit/57584D314335323631353037/WD/My Passport 0748/1000169537536" 19:26:26.306 DEBUG Geolocator:115 Gelocated to: (52205337,121817) 19:26:26.399 DEBUG _MessageReplyBase:28 Waiting on ID 0 19:26:26.399 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Rihanna/Unapologetic (Deluxe Edition) [Explicit] [+digital booklet]/02 - Diamonds (Album Version)(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Rihanna/Unapologetic (Deluxe Edition) [Explicit] [+digital booklet]/02 - Diamonds (Album Version)(1).mp3 19:26:26.400 INFO TagReaderWorker...

[Clementine-Issue-Importer]

From [email protected] on February 24, 2013 11:29:44

...:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Rihanna/Unapologetic (Deluxe Edition) [Explicit] [+digital booklet]/02 - Diamonds (Album Version)(1).mp3" file 19:26:26.400 DEBUG MessageReply<MessageType>:93 Releasing ID 0 (finished) 19:26:26.400 DEBUG _MessageReplyBase:30 Acquired ID 0 19:26:26.400 DEBUG _MessageReplyBase:28 Waiting on ID 1 19:26:26.400 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Jojo/JoJo/08 - Leave (Get Out)(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Jojo/JoJo/08 - Leave (Get Out)(1).mp3 19:26:26.401 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Jojo/JoJo/08 - Leave (Get Out)(1).mp3" file 19:26:26.401 DEBUG MessageReply<MessageType>:93 Releasing ID 1 (finished) 19:26:26.401 DEBUG _MessageReplyBase:30 Acquired ID 1 19:26:26.402 DEBUG _MessageReplyBase:28 Waiting on ID 2 19:26:26.402 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Jamelia/Thank You/04 - See It In A Boy's Eyes(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Jamelia/Thank You/04 - See It In A Boy's Eyes(1).mp3 19:26:26.402 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Jamelia/Thank You/04 - See It In A Boy's Eyes(1).mp3" file 19:26:26.403 DEBUG MessageReply<MessageType>:93 Releasing ID 2 (finished) 19:26:26.403 DEBUG _MessageReplyBase:30 Acquired ID 2 19:26:26.403 DEBUG _MessageReplyBase:28 Waiting on ID 3 19:26:26.403 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Yeah Yeah Yeahs/Is Is EP/04 - Isis(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Yeah Yeah Yeahs/Is Is EP/04 - Isis(1).mp3 19:26:26.404 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Yeah Yeah Yeahs/Is Is EP/04 - Isis(1).mp3" file 19:26:26.404 DEBUG MessageReply<MessageType>:93 Releasing ID 3 (finished) 19:26:26.404 DEBUG _MessageReplyBase:30 Acquired ID 3 19:26:26.404 DEBUG _MessageReplyBase:28 Waiting on ID 4 19:26:26.404 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Yeah Yeah Yeahs/Is Is EP/03 - Kiss, Kiss(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Yeah Yeah Yeahs/Is Is EP/03 - Kiss, Kiss(1).mp3 19:26:26.405 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Yeah Yeah Yeahs/Is Is EP/03 - Kiss, Kiss(1).mp3" file 19:26:26.405 DEBUG MessageReply<MessageType>:93 Releasing ID 4 (finished) 19:26:26.405 DEBUG _MessageReplyBase:30 Acquired ID 4 19:26:26.405 DEBUG _MessageReplyBase:28 Waiting on ID 5 19:26:26.405 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Major Lazer/Get Free/01 - Get Free(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Major Lazer/Get Free/01 - Get Free(1).mp3 19:26:26.406 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Major Lazer/Get Free/01 - Get Free(1).mp3" file 19:26:26.406 DEBUG MessageReply<MessageType>:93 Releasing ID 5 (finished) 19:26:26.406 DEBUG _MessageReplyBase:30 Acquired ID 5 19:26:26.406 DEBUG _MessageReplyBase:28 Waiting on ID 6 19:26:26.406 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Of Monsters And Men/My Head Is An Animal [+Digital Booklet]/03 - Mountain Sound(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Of Monsters And Men/My Head Is An Animal [+Digital Booklet]/03 - Mountain Sound(1).mp3 19:26:26.407 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Of Monsters And Men/My Head Is An Animal [+Digital Booklet]/03 - Mountain Sound(1).mp3" file 19:26:26.407 DEBUG MessageReply<MessageType>:93 Releasing ID 6 (finished) 19:26:26.407 DEBUG _MessageReplyBase:30 Acquired ID 6 19:26:26.407 DEBUG _MessageReplyBase:28 Waiting on ID 7 19:26:26.407 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Underworld/A Collection/09 - Born Slippy Nuxx (Radio edit)(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Underworld/A Collection/09 - Born Slippy Nuxx (Radio edit)(1).mp3 19:26:26.408 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Underworld/A Collection/09 - Born Slippy Nuxx (Radio edit)(1).mp3" file 19:26:26.408 DEBUG MessageReply<MessageType>:93 Releasing ID 7 (finished) 19:26:26.408 DEBUG _MessageReplyBase:30 Acquired ID 7 19:26:26.408 DEBUG _MessageReplyBase:28 Waiting on ID 8 19:26:26.408 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Suede/Suede (Remastered)/02 - Animal Nitrate (Remastered)(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Suede/Suede (Remastered)/02 - Animal Nitrate (Remastered)(1).mp3 19:26:26.408 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Suede/Suede (Remastered)/02 - Animal Nitrate (Remastered)(1).mp3" file 19:26:26.408 DEBUG MessageReply<MessageType>:93 Releasing ID 8 (finished) 19:26:26.408 DEBUG _MessageReplyBase:30 Acquired ID 8 19:26:26.408 DEBUG _MessageReplyBase:28 Waiting on ID 9 19:26:26.409 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/The Rakes/Capture _ Release/04 - Open Book(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/The Rakes/Capture _ Release/04 - Open Book(1).mp3 19:26:26.409 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/The Rakes/Capture _ Release/04 - Open Book(1).mp3" file 19:26:26.409 DEBUG MessageReply<MessageType>:93 Releasing ID 9 (finished) 19:26:26.409 DEBUG _MessageReplyBase:30 Acquired ID 9 19:26:26.409 DEBUG _MessageReplyBase:28 Waiting on ID ...

[Clementine-Issue-Importer]

From [email protected] on February 24, 2013 11:29:44

...10 19:26:26.409 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Ciara/Goodies/05 - Oh(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Ciara/Goodies/05 - Oh(1).mp3 19:26:26.410 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Ciara/Goodies/05 - Oh(1).mp3" file 19:26:26.410 DEBUG MessageReply<MessageType>:93 Releasing ID 10 (finished) 19:26:26.410 DEBUG _MessageReplyBase:30 Acquired ID 10 19:26:26.410 DEBUG _MessageReplyBase:28 Waiting on ID 11 19:26:26.410 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Sash!/Life Goes On/02 - Mysterious Times(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Sash!/Life Goes On/02 - Mysterious Times(1).mp3 19:26:26.410 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Sash!/Life Goes On/02 - Mysterious Times(1).mp3" file 19:26:26.410 DEBUG MessageReply<MessageType>:93 Releasing ID 11 (finished) 19:26:26.410 DEBUG _MessageReplyBase:30 Acquired ID 11 19:26:26.411 DEBUG _MessageReplyBase:28 Waiting on ID 12 19:26:26.411 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Final Fantasy/Spectrum, 14th Century/03 - The Butcher(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Final Fantasy/Spectrum, 14th Century/03 - The Butcher(1).mp3 19:26:26.411 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Final Fantasy/Spectrum, 14th Century/03 - The Butcher(1).mp3" file 19:26:26.411 DEBUG MessageReply<MessageType>:93 Releasing ID 12 (finished) 19:26:26.411 DEBUG _MessageReplyBase:30 Acquired ID 12 19:26:26.411 DEBUG _MessageReplyBase:28 Waiting on ID 13 19:26:26.411 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Flux Pavilion/Lines in Wax/04 - Haunt You(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Flux Pavilion/Lines in Wax/04 - Haunt You(1).mp3 19:26:26.412 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Flux Pavilion/Lines in Wax/04 - Haunt You(1).mp3" file 19:26:26.412 DEBUG MessageReply<MessageType>:93 Releasing ID 13 (finished) 19:26:26.412 DEBUG _MessageReplyBase:30 Acquired ID 13 19:26:26.412 DEBUG _MessageReplyBase:28 Waiting on ID 14 19:26:26.412 DEBUG TagReaderWorker:157 Reading tags from "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Mylène Farmer/Cendres De Lune/01 - Libertine(1).mp3" TagLib: Could not open file /media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Mylène Farmer/Cendres De Lune/01 - Libertine(1).mp3 19:26:26.412 INFO TagReaderWorker:167 TagLib hasn't been able to read "/media/WDPassPort1TB/WDMyBook1TB/Music/Amazon MP3/Mylène Farmer/Cendres De Lune/01 - Libertine(1).mp3" file 19:26:26.412 DEBUG MessageReply<MessageType>:93 Releasing ID 14 (finished) 19:26:26.413 DEBUG _MessageReplyBase:30 Acquired ID 14

[floxo]

Just found this issue on my system when I noticed lots of tracks missing from my library. The workaround mentioned above from 2013 still fixed the issue:

killall clementine
sqlite3 .config/Clementine/clementine.db 'update songs set unavailable=0'
clementine

Ab subsequent complete library scan seems to have added all the missing entries.

[nitro322]

I'm still having this issue with 1.4rc1. @floxo - thanks for the tip. That worked for me as well.

Happy to provide any additional details if it would help, but it doesn't look like this issue is getting too much attention at this time.

Edit: I just noticed that there are multiple builds named 1.4rc1 now. I'm using the 1.4.0_rc1 package provided by Gentoo, and I don't see a way to get a more specific revision than that. Just wanted to be clear that I may be using an older version than what's currently being published.

[MichelAUTEM]

For my part I continue to get this issue and the "songs unavailable" trip does not work for Me, but the problem seems to occur (systematically) only with OGG tracks extracted form CDs with Clementine's embedded extractor. When I use an external tool to extract the tracks, like Sound Juicer, there is absolutely no problem : the tracks appear in the library as soon as they are copied in the library directory, or after performing a "library re-analysis". There is something wrong in Clementine's CD extractor.