streamrip
streamrip copied to clipboard
nathom
[BUG] Connection broken: IncompleteRead
Describe the bug
Incomplete Read, failed tracks saved in database but there is no fix command
Command Used
rip url https://open.qobuz.com/artist/519010
Debug Traceback
[09:54:03] ERROR Track 95669760 not available for stream on qobuz: Error fetching metadata. Message: "No result matching given argument" track.py:135
[09:57:39] ERROR Track 95675005 not available for stream on qobuz: Error fetching metadata. Message: "No result matching given argument" track.py:135
───────────────────────────────────────────────────────────────── Downloading Yumeno Kiroku, Kitekiga Kikoeru Machi ─────────────────────────────────────────────────────────────────
(base) [kudy@7i ~]$ rip url https://open.qobuz.com/artist/519010
[10:42:31] ERROR Error downloading track 'SAND BEIGE -sabaku e- (2009 Remastered Version)', retrying: ('Connection broken: IncompleteRead(2099024 bytes read, 32932096 track.py:52
more expected)', IncompleteRead(2099024 bytes read, 32932096 more expected))
[10:42:48] ERROR Persistent error downloading track 'SAND BEIGE -sabaku e- (2009 Remastered Version)', skipping: ('Connection broken: IncompleteRead(8337328 bytes track.py:68
read, 26693792 more expected)', IncompleteRead(8337328 bytes read, 26693792 more expected))
[10:43:23] ERROR Error downloading track 'Shoujo A', retrying: ('Connection broken: IncompleteRead(71717262 bytes read, 10602586 more expected)', track.py:52
IncompleteRead(71717262 bytes read, 10602586 more expected))
[10:50:03] ERROR Error downloading track 'HOUSE OF LOVE', retrying: ('Connection broken: IncompleteRead(1 bytes read, 103387668 more expected)', IncompleteRead(1 track.py:52
bytes read, 103387668 more expected))
[11:08:52] ERROR Error downloading track 'Southern Wind (2023 Lacquer Master Sound)', retrying: ('Connection broken: IncompleteRead(1 bytes read, 86908008 more track.py:52
expected)', IncompleteRead(1 bytes read, 86908008 more expected))
[11:09:06] ERROR Error downloading track 'Gypsy Queen', retrying: ('Connection broken: IncompleteRead(4709990 bytes read, 24248664 more expected)', track.py:52
IncompleteRead(4709990 bytes read, 24248664 more expected))
[11:09:12] ERROR Persistent error downloading track 'Gypsy Queen', skipping: ('Connection broken: IncompleteRead(4709990 bytes read, 24248664 more expected)', track.py:68
IncompleteRead(4709990 bytes read, 24248664 more expected))
[11:13:59] ERROR Error downloading track 'Fate -My Destiny-', retrying: ('Connection broken: IncompleteRead(1 bytes read, 77392898 more expected)', IncompleteRead(1 track.py:52
bytes read, 77392898 more expected))
[11:14:00] ERROR Persistent error downloading track 'Fate -My Destiny-', skipping: ('Connection broken: IncompleteRead(1 bytes read, 77392898 more expected)', track.py:68
IncompleteRead(1 bytes read, 77392898 more expected))
ERROR Error downloading track: file said 4 bytes, read 0 bytes album.py:41
[11:20:42] ERROR Error downloading track 'LIAR (2024 Lacquer Master Sound)', retrying: ('Connection broken: IncompleteRead(1 bytes read, 104441774 more expected)', track.py:52
IncompleteRead(1 bytes read, 104441774 more expected))
[11:20:43] ERROR Persistent error downloading track 'LIAR (2024 Lacquer Master Sound)', skipping: ('Connection broken: IncompleteRead(1 bytes read, 104441774 more track.py:68
expected)', IncompleteRead(1 bytes read, 104441774 more expected))
ERROR Error downloading track: file said 4 bytes, read 0 bytes album.py:41
[11:29:13] ERROR Error downloading track 'Moonlight Letter (Original Karaoke; 2023 Remaster)', retrying: ('Connection broken: IncompleteRead(2100153 bytes read, track.py:52
26925896 more expected)', IncompleteRead(2100153 bytes read, 26925896 more expected))
[11:29:20] ERROR Persistent error downloading track 'Moonlight Letter (Original Karaoke; 2023 Remaster)', skipping: ('Connection broken: IncompleteRead(2100153 bytes track.py:68
read, 26925896 more expected)', IncompleteRead(2100153 bytes read, 26925896 more expected))
[11:34:20] ERROR Error downloading track 'MILONGUITA (2023 Lacquer Master Sound)', retrying: ('Connection broken: IncompleteRead(2100685 bytes read, 102140541 more track.py:52
expected)', IncompleteRead(2100685 bytes read, 102140541 more expected))
[11:34:28] ERROR Persistent error downloading track 'MILONGUITA (2023 Lacquer Master Sound)', skipping: ('Connection broken: IncompleteRead(2625973 bytes read, track.py:68
101615253 more expected)', IncompleteRead(2625973 bytes read, 101615253 more expected))
[11:45:17] ERROR Error downloading track 'Moroi Gogo', retrying: ('Connection broken: IncompleteRead(2628115 bytes read, 30401631 more expected)', track.py:52
IncompleteRead(2628115 bytes read, 30401631 more expected))
[11:46:30] ERROR Error downloading track 'Joken Hansha (2012 Remastered)', retrying: ('Connection broken: IncompleteRead(3137453 bytes read, 27489880 more expected)', track.py:52
IncompleteRead(3137453 bytes read, 27489880 more expected))
[11:46:47] ERROR Persistent error downloading track 'Joken Hansha (2012 Remastered)', skipping: ('Connection broken: IncompleteRead(29214445 bytes read, 1412888 more track.py:68
expected)', IncompleteRead(29214445 bytes read, 1412888 more expected))
[11:58:41] ERROR Error downloading track 'Kazari Ja Nai Noyo Namida Wa (Single Version; 2023 Lacquer Master Sound)', retrying: ('Connection broken: track.py:52
IncompleteRead(2112805 bytes read, 97348676 more expected)', IncompleteRead(2112805 bytes read, 97348676 more expected))
[11:58:47] ERROR Persistent error downloading track 'Kazari Ja Nai Noyo Namida Wa (Single Version; 2023 Lacquer Master Sound)', skipping: ('Connection broken: track.py:68
IncompleteRead(5231957 bytes read, 94229524 more expected)', IncompleteRead(5231957 bytes read, 94229524 more expected))
[12:17:02] ERROR Error downloading track 'POLITICAL MOVES (2023 Lacquer Master Sound)', retrying: ('Connection broken: IncompleteRead(1 bytes read, 101019983 more track.py:52
expected)', IncompleteRead(1 bytes read, 101019983 more expected))
[12:17:40] ERROR Error downloading track 'Cross My Palm (Movie “Cross My Palm” Version; 2023 Lacquer Master Sound)', retrying: ('Connection broken: IncompleteRead(1 track.py:52
bytes read, 75386524 more expected)', IncompleteRead(1 bytes read, 75386524 more expected))
[12:26:37] ERROR Error downloading track 'Yokohama A-KU-MA', retrying: ('Connection broken: IncompleteRead(2112806 bytes read, 82439383 more expected)', track.py:52
IncompleteRead(2112806 bytes read, 82439383 more expected))
[12:26:42] ERROR Persistent error downloading track 'Yokohama A-KU-MA', skipping: ('Connection broken: IncompleteRead(2621710 bytes read, 81930479 more expected)', track.py:68
IncompleteRead(2621710 bytes read, 81930479 more expected))
[12:30:00] ERROR Error downloading track 'Ranbi (2024 Lacquer Master Sound)', retrying: ('Connection broken: IncompleteRead(4702560 bytes read, 94574465 more track.py:52
expected)', IncompleteRead(4702560 bytes read, 94574465 more expected))
[12:30:06] ERROR Persistent error downloading track 'Ranbi (2024 Lacquer Master Sound)', skipping: ('Connection broken: IncompleteRead(4702560 bytes read, 94574465 track.py:68
more expected)', IncompleteRead(4702560 bytes read, 94574465 more expected))
[12:42:26] ERROR Error downloading track 'SOLITUDE (Live at Shinjuku Koseinenkin Kaikan, 1985; 2014 Remaster)', retrying: ('Connection broken: IncompleteRead(2104061 track.py:52
bytes read, 30377120 more expected)', IncompleteRead(2104061 bytes read, 30377120 more expected))
[12:42:31] ERROR Persistent error downloading track 'SOLITUDE (Live at Shinjuku Koseinenkin Kaikan, 1985; 2014 Remaster)', skipping: ('Connection broken: track.py:68
IncompleteRead(2621397 bytes read, 29859784 more expected)', IncompleteRead(2621397 bytes read, 29859784 more expected))
[12:45:31] ERROR Error downloading track 'I MISSED "THE SHOCK" (2014 Remaster)', retrying: ('Connection broken: IncompleteRead(4705057 bytes read, 27300616 more track.py:52
expected)', IncompleteRead(4705057 bytes read, 27300616 more expected))
[12:45:35] ERROR Persistent error downloading track 'I MISSED "THE SHOCK" (2014 Remaster)', skipping: ('Connection broken: IncompleteRead(2099073 bytes read, 29906600 track.py:68
more expected)', IncompleteRead(2099073 bytes read, 29906600 more expected))
[13:01:31] ERROR Error downloading track 'Fushigi (2023 Lacquer Master Sound)', retrying: ('Connection broken: IncompleteRead(75378081 bytes read, 22104569 more track.py:52
expected)', IncompleteRead(75378081 bytes read, 22104569 more expected))
[13:03:19] ERROR Error downloading track 'URAGIRI (2012 Remastered)', retrying: ('Connection broken: IncompleteRead(14082526 bytes read, 20659088 more expected)', track.py:52
IncompleteRead(14082526 bytes read, 20659088 more expected))
Config File
[downloads]
# Folder where tracks are downloaded to
folder = "/home/xxx/Downloads/StreamRip/"
# Put Qobuz albums in a 'Qobuz' folder, Tidal albums in 'Tidal' etc.
source_subdirectories = false
# Put tracks in an album with 2 or more discs into a subfolder named `Disc N`
disc_subdirectories = true
# Download (and convert) tracks all at once, instead of sequentially.
# If you are converting the tracks, or have fast internet, this will
# substantially improve processing speed.
concurrency = true
# The maximum number of tracks to download at once
# If you have very fast internet, you will benefit from a higher value,
# A value that is too high for your bandwidth may cause slowdowns
# Set to -1 for no limit
max_connections = 6
# Max number of API requests per source to handle per minute
# Set to -1 for no limit
requests_per_minute = 60
# Verify SSL certificates for API connections
# Set to false if you encounter SSL certificate verification errors (not recommended)
verify_ssl = true
[qobuz]
# 1: 320kbps MP3, 2: 16/44.1, 3: 24/<=96, 4: 24/>=96
quality = 4
# This will download booklet pdfs that are included with some albums
download_booklets = true
# Authenticate to Qobuz using auth token? Value can be true/false only
use_auth_token = true
# Enter your userid if the above use_auth_token is set to true, else enter your email
email_or_userid = ""
# Enter your auth token if the above use_auth_token is set to true, else enter the md5 hash of your plaintext password
password_or_token = ""
# Do not change
app_id = ""
# Do not change
secrets = [""]
[tidal]
# 0: 256kbps AAC, 1: 320kbps AAC, 2: 16/44.1 "HiFi" FLAC, 3: 24/44.1 "MQA" FLAC
quality = 3
# This will download videos included in Video Albums.
download_videos = true
# Do not change any of the fields below
user_id = ""
country_code = ""
access_token = ""
refresh_token = ""
# Tokens last 1 week after refresh. This is the Unix timestamp of the expiration
# time. If you haven't used streamrip in more than a week, you may have to log
# in again using `rip config --tidal`
token_expiry = ""
[deezer]
# 0, 1, or 2
# This only applies to paid Deezer subscriptions. Those using deezloader
# are automatically limited to quality = 1
quality = 2
# An authentication cookie that allows streamrip to use your Deezer account
# See https://github.com/nathom/streamrip/wiki/Finding-Your-Deezer-ARL-Cookie
# for instructions on how to find this
arl = ""
# This allows for free 320kbps MP3 downloads from Deezer
# If an arl is provided, deezloader is never used
use_deezloader = true
# This warns you when the paid deezer account is not logged in and rip falls
# back to deezloader, which is unreliable
deezloader_warnings = true
[soundcloud]
# Only 0 is available for now
quality = 0
# This changes periodically, so it needs to be updated
client_id = ""
app_version = ""
[youtube]
# Only 0 is available for now
quality = 0
# Download the video along with the audio
download_videos = false
# The path to download the videos to
video_downloads_folder = "/home/kudy/StreamripDownloads/YouTubeVideos"
[database]
# Create a database that contains all the track IDs downloaded so far
# Any time a track logged in the database is requested, it is skipped
# This can be disabled temporarily with the --no-db flag
downloads_enabled = true
# Path to the downloads database
downloads_path = "/home/kudy/.config/streamrip/downloads.db"
# If a download fails, the item ID is stored here. Then, `rip repair` can be
# called to retry the downloads
failed_downloads_enabled = true
failed_downloads_path = "/home/kudy/.config/streamrip/failed_downloads.db"
# Convert tracks to a codec after downloading them.
[conversion]
enabled = false
# FLAC, ALAC, OPUS, MP3, VORBIS, or AAC
codec = "ALAC"
# In Hz. Tracks are downsampled if their sampling rate is greater than this.
# Value of 48000 is recommended to maximize quality and minimize space
sampling_rate = 48000
# Only 16 and 24 are available. It is only applied when the bit depth is higher
# than this value.
bit_depth = 24
# Only applicable for lossy codecs
lossy_bitrate = 320
# Filter a Qobuz artist's discography. Set to 'true' to turn on a filter.
# This will also be applied to other sources, but is not guaranteed to work correctly
[qobuz_filters]
# Remove Collectors Editions, live recordings, etc.
extras = false
# Picks the highest quality out of albums with identical titles.
repeats = false
# Remove EPs and Singles
non_albums = false
# Remove albums whose artist is not the one requested
features = true
# Skip non studio albums
non_studio_albums = false
# Only download remastered albums
non_remaster = false
[artwork]
# Write the image to the audio file
embed = true
# The size of the artwork to embed. Options: thumbnail, small, large, original.
# "original" images can be up to 30MB, and may fail embedding.
# Using "large" is recommended.
embed_size = "large"
# If this is set to a value > 0, max(width, height) of the embedded art will be set to this value in pixels
# Proportions of the image will remain the same
embed_max_width = -1
# Save the cover image at the highest quality as a seperate jpg file
save_artwork = true
# If this is set to a value > 0, max(width, height) of the saved art will be set to this value in pixels
# Proportions of the image will remain the same
saved_max_width = -1
[metadata]
# Sets the value of the 'ALBUM' field in the metadata to the playlist's name.
# This is useful if your music library software organizes tracks based on album name.
set_playlist_to_album = true
# If part of a playlist, sets the `tracknumber` field in the metadata to the track's
# position in the playlist instead of its position in its album
renumber_playlist_tracks = true
# The following metadata tags won't be applied
# See https://github.com/nathom/streamrip/wiki/Metadata-Tag-Names for more info
exclude = []
# Changes the folder and file names generated by streamrip.
[filepaths]
# Create folders for single tracks within the downloads directory using the folder_format
# template
add_singles_to_folder = false
# Available keys: "albumartist", "title", "year", "bit_depth", "sampling_rate",
# "id", and "albumcomposer"
folder_format = "{albumartist}/[{year}] {albumartist} - {title} [{container}] [{bit_depth}B-{sampling_rate}kHz]"
# Available keys: "tracknumber", "artist", "albumartist", "composer", "title",
# and "albumcomposer", "explicit"
track_format = "{tracknumber:02}. {artist} - {title}{explicit}"
# Only allow printable ASCII characters in filenames.
restrict_characters = false
# Truncate the filename if it is greater than this number of characters
# Setting this to false may cause downloads to fail on some systems
truncate_to = 120
# Last.fm playlists are downloaded by searching for the titles of the tracks
[lastfm]
# The source on which to search for the tracks.
source = "qobuz"
# If no results were found with the primary source, the item is searched for
# on this one.
fallback_source = ""
[cli]
# Print "Downloading {Album name}" etc. to screen
text_output = true
# Show resolve, download progress bars
progress_bars = true
# The maximum number of search results to show in the interactive menu
max_search_results = 100
[misc]
# Metadata to identify this config file. Do not change.
version = "2.0.6"
# Print a message if a new version of streamrip is available
check_for_updates = true
Operating System
Linux
streamrip version
2.1.0
Screenshots and recordings
No response
Additional context
No response
45059765 exist in both download.db and failed_download.db there is no rip repair.
Manual repair step:
sqlite3 ~/.config/streamrip/failed_downloads.db "SELECT id FROM failed_downloads;" > ~/urls.txt
sed 's/^/https:\/\/open.qobuz.com\/track\//' ~/urls.txt > ~/urls.txt
while IFS= read -r line; do rip -ndb url "$line"; done < ~/urls.txt
for flac in *.flac; do find . -mindepth 2 -maxdepth 3 -type f -name "$flac" -exec echo "$PWD/$flac -> {}" \; ; done
#for flac in *.flac; do find . -mindepth 2 -maxdepth 3 -type f -name "$flac" -exec cp "$PWD/$flac" "{}" \; ; done