"Last year" shows incomplete listening history

[lluni]

Describe the bug

The option "Last year" doesn't completely show the last year of listening history but shows February as empty and cuts off somewhere in March even though February and March (and also all the months later) have plays (cf. screenshots).

Expected behavior

The option "Last year" shows the last year of listening history.

Additional context

version: "3"

services:
  server:
    image: yooooomi/your_spotify_server
    restart: always
    networks:
      - your_spotify
      - npm_bridge
    links:
      - mongo
    depends_on:
      - mongo
    environment:
      - API_ENDPOINT=https://sapi.domain.com # This MUST be included as a valid URL in the spotify dashboard
      - CLIENT_ENDPOINT=https://spotify.domain.com
      - SPOTIFY_PUBLIC=[redacted]
      - SPOTIFY_SECRET=[redacted]
      - CORS=all # all if you want to allow every origin
      - MONGO_ENDPOINT=mongodb://mongo:27017/your_spotify
  mongo:
    container_name: mongo
    restart: always
    image: mongo:4.4.8
    volumes:
      - ./your_spotify_db:/data/db
      - "/etc/localtime:/etc/localtime:ro"
    networks:
      - your_spotify

  web:
    image: yooooomi/your_spotify_client
    restart: always
    networks:
      - your_spotify
      - npm_bridge
    environment:
      - API_ENDPOINT=https://sapi.domain.com

networks:
    your_spotify:
        external: false
    npm_bridge:
        external: true

Exported the last 1000 lines of log with Portainer: your_spotify_server_logs.txt

Screenshots "Last year"

"Feb 1, 2022 - Feb 28, 2022"

"Mar 1, 2022 - Mar 31, 2022"

[lluni]

Now that it is July the bug has seemingly fixed itself:

I'm unsure if I should close this issue or if you would like to investigate it further.

[Yooooomi]

Hello, thanks for the details, I'll check this out.

[lluni]

The bug seems to appear again when choosing "Last year":

Maybe it somehow has to do something with choosing that time range when it is the end of the month because my initial report also was at the end of June? I have not paid attention to it the last month ends, but I will to try to report again in a few days when it is December.

[lluni]

Now on the 1st of December it seems to work properly again:

[Yooooomi]

Thanks for the details. This is clearly an issue. I will try to resolve it next time I work on the project.

[jamess60]

Maybe one thing to check - Spotify will only let you request X amount of historical listening data, meaning you will need to do a GDPR request to export your extended listening history as a download (this is automated/online but can take up to 30 days). Once you get this, you can import the db files into YS

I was uploading to mine over a slow connection and one part of the db failed (causing a gap).

Its safe to attempt to upload the DB again, it wont create duplicate entries

[lluni]

@jamess60 I just checked again with the date range set to "Feb 1, 2022 - Feb 28, 2022" like in the original issue, but now the graph seems to work even though the other stats like songs/time listened remained the same:

Funnily enough, when trying to reproduce the "Last year" date range from the original issue by setting "June 29, 2021 - June 29, 2022", the graph works, but the other stats have decreased somehow:

For the record, I haven't manually imported any data since then and I am on the second newest version, because I haven't got any time yet to upgrade the mongo DB. I also opened the original issue after the GDPR import fully ran, so something code-related must have fixed it (or at least made it harder to reproduce).