[BUG] deb-get removed installed packages from list and won't update correctly

[JoeJoeTV]

Reporting a bug 🐛

Expected behavior

deb-get updates normally, doesn't delete installed packages and list packages correctly

Actual behavior

Today I ran deb-get update and saw that it wan't actally checking for updates on installed packages. Then I tried using deb-get clean and various other methods I saw in simillar issues to remove the cache folder, e.g. After nothing worked, I tried reinstalling deb-get and finally, removeing /etc/deb-get/, /var/cache/deb-get/ and completely purging and reinstalling the package. I still get strage errors, such as long wait times during update and it somehow not updating the json files. I tried installing a package like lsd that is already installed and this worked after manually pulling the file 01-main.repo from github. But deb-get list --installed still shows a warning that the json file is empty or missing for every package, except deb-get and lst, as I inmstalled it:

  [*] WARNING! Cached file /var/cache/deb-get/battery-monitor.json is empty or missing.
deb-get
  [*] WARNING! Cached file /var/cache/deb-get/fastfetch.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/fd.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/ferdium.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/figma-linux.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/flameshot.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/franz.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/frostwire.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/gcm.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/gh.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/git-delta.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/github-desktop.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/google-chat-electron.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/grype.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/heroic.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/homeassistant-supervised.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/hugo.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/hyper.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/igdm.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/insomnia.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/ipfs-desktop.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/irccloud-desktop.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/jabref.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/jellyfin-media-player.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/jupyterlab-desktop.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/koreader.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/ksnip.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/limoji.json is empty or missing.
lsd
  [*] WARNING! Cached file /var/cache/deb-get/ludo.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/lutris.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/mailspring.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/mattermost-desktop.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/mergerfs.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/micro.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/min.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/minigalaxy.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/minikube.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/motrix.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/mpdevil.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/ms-office-electron.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/mullvad-vpn.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/notable.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/nuclear.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/obs-cli.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/obsidian.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/onlyoffice-desktopeditors.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/openaudible.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/os-agent.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/p3x-onenote.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/pandoc.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/pdfsam-basic.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/pdfsam-visual.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/peazip.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/plow.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/pomatez.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/powershell.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/protonmail-bridge.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/pulsar.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/pulse-sms.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/quarto.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/quickobs.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/rambox.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/rclone.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/rocketchat.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/rpi-imager.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/rustdesk.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/simplenote.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/sleek.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/sniffnet.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/soundux.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/standard-notes.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/sunshine.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/syft.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/system-monitoring-center.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/tabby-terminal.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/teams-for-linux.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/tidal-hifi.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/tribler.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/trilium.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/trivy.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/weylus.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/whalebird.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/whatsapp-for-linux.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/wraith-master.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/youtube-music.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/zenith.json is empty or missing.
  [*] WARNING! Cached file /var/cache/deb-get/zettlr.json is empty or missing.

Steps to reproduce

I'm not exactly sure how this happend or how to reproduce this, except for the description above.

System information

Run the following a paste the output below:

/etc/os-release

NAME="Linux Mint"
VERSION="21.2 (Victoria)"
ID=linuxmint
ID_LIKE="ubuntu debian"
PRETTY_NAME="Linux Mint 21.2"
VERSION_ID="21.2"
HOME_URL="https://www.linuxmint.com/"
SUPPORT_URL="https://forums.linuxmint.com/"
BUG_REPORT_URL="http://linuxmint-troubleshooting-guide.readthedocs.io/en/latest/"
PRIVACY_POLICY_URL="https://www.linuxmint.com/"
VERSION_CODENAME=victoria
UBUNTU_CODENAME=jammy

/etc/lsb-release

DISTRIB_ID=LinuxMint
DISTRIB_RELEASE=21.2
DISTRIB_CODENAME=victoria
DISTRIB_DESCRIPTION="Linux Mint 21.2 Victoria"

deb-get version

0.3.9

deb-get update

Note: The download step took longer than usual and my language is german.

  [+] Updating /etc/deb-get/01-main
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0
100  109k    0  109k    0     0  18274      0 --:--:--  0:00:06 --:--:-- 1245k
  [+] Updating cache of supported apps in the background
Ign:1 http://linux-mint.froonix.org victoria InRelease
OK:2 http://ftp.uni-mainz.de/ubuntu jammy InRelease
....
Es wurden 23,5 kB in 4 s geholt (5.958 B/s).
Paketlisten werden gelesen…

[brccabral]

I could only update my packages after I setup a GitHub Fine-grained token

• https://github.com/wimpysworld/deb-get/issues/835#issuecomment-1611725729
• https://github.com/wimpysworld/deb-get#github-api-rate-limits

[FallCheetah7373]

I have experienced a similar issue where deb-get list would only show deb-get as being installed.

sudo wget -vvv https://raw.githubusercontent.com/wimpysworld/deb-get/main/01-main/manifest -O /etc/deb-get/01-main.repo --timeout 5 as specified by @seefood fixed the issue deb-get update only to be broken by deb-get update again.

[ezunigaBaires]

Similar problem here, with ubuntu 22.04 and deb-get 0.4.0 File /etc/deb-get/01-main.repo was empty and recovered like posted in https://github.com/wimpysworld/deb-get/issues/863#issuecomment-1848873708 The /etc/deb-get/installed file only have deb-get 1 github. When try to reinstall some previously installed app like bat I get:

$ sudo deb-get reinstall bat
  [*] WARNING! Cached file /var/cache/deb-get/bat.json is empty or missing.
/var/cache/deb-get/: Es un directorio
  [!] ERROR! Failed to download . Deleting /var/cache/deb-get/...

Related info

$ sudo deb-get update
  [+] Updating /etc/deb-get/01-main
 -=O=#     #       #         #                                                                                                                                                               
  [+] Updating cache of supported apps in the background
  [+] Updating /var/cache/deb-get/deb-get.json
  [*] WARNING! Updating /var/cache/deb-get/deb-get.json failed.
Obj:1 https://brave-browser-apt-release.s3.brave.com stable InRelease
Obj:2 https://updates.signal.org/desktop/apt xenial InRelease
Obj:3 https://dl.google.com/linux/chrome/deb stable InRelease
Obj:4 https://download.virtualbox.org/virtualbox/debian jammy InRelease
Obj:5 https://packages.microsoft.com/repos/vscode stable InRelease
Ign:6 http://linux.dropbox.com/ubuntu disco InRelease
Obj:7 http://ar.archive.ubuntu.com/ubuntu jammy InRelease
Obj:8 http://ar.archive.ubuntu.com/ubuntu jammy-updates InRelease
Obj:9 http://ar.archive.ubuntu.com/ubuntu jammy-backports InRelease
Obj:10 http://linux.dropbox.com/ubuntu disco Release
Obj:11 http://ar.archive.ubuntu.com/ubuntu jammy-security InRelease
Des:12 https://zotero.retorque.re/file/apt-package-archive ./ InRelease [2.153 B]
Obj:13 https://ppa.launchpadcontent.net/costales/folder-color/ubuntu jammy InRelease
Obj:14 https://ppa.launchpadcontent.net/costamagnagianfranco/borgbackup/ubuntu jammy InRelease
Obj:16 https://ppa.launchpadcontent.net/flexiondotorg/obs-fully-loaded/ubuntu jammy InRelease
Obj:17 https://ppa.launchpadcontent.net/libreoffice/ppa/ubuntu jammy InRelease
Obj:18 https://ppa.launchpadcontent.net/mozillateam/ppa/ubuntu jammy InRelease
Obj:19 https://ppa.launchpadcontent.net/phoerious/keepassxc/ubuntu jammy InRelease
Descargados 2.153 B en 3s (856 B/s)
Leyendo lista de paquetes...

/var/cache/deb-get$ ll
total 3,4M
-rw-r--r-- 1 root root  14K 2024-04-21 20:27 agena.html
-rw-r--r-- 1 root root 140K 2024-04-21 20:27 atomic.html
-rw-r--r-- 1 root root  36K 2024-04-21 20:27 beersmith3.html
-rw-r--r-- 1 root root  25K 2024-04-21 20:27 bitwig-studio.html
-rw-r--r-- 1 root root  74K 2024-04-21 20:27 bluejeans-v2.html
-rw-r--r-- 1 root root  25K 2024-04-21 20:27 cronopete.html
-rw-r--r-- 1 root root 5,5K 2024-04-21 20:27 crossover.html
-rw-r--r-- 1 root root  19K 2024-04-21 20:27 dbeaver-ce.html
-rw-r--r-- 1 root root 7,9K 2024-04-21 20:27 deadbeef-static.html
-rw-r--r-- 1 root root  16K 2024-04-21 20:27 deltachat-desktop.html
-rw-r--r-- 1 root root 737K 2024-04-21 20:27 docker-desktop.html
-rw-r--r-- 1 root root 167K 2024-04-21 20:27 expressvpn.html
-rw-r--r-- 1 root root 320K 2024-04-21 20:27 gitkraken.html
-rw-r--r-- 1 root root 9,3K 2024-04-21 20:27 gitter.html
-rw-r--r-- 1 root root  13K 2024-04-21 20:27 helio-workstation.html
-rw-r--r-- 1 root root 9,7K 2024-04-21 20:27 iriunwebcam.html
-rw-r--r-- 1 root root  19K 2024-04-21 20:27 master-pdf-editor-5.html
-rw-r--r-- 1 root root  28K 2024-04-21 20:28 mediathekview.html
-rw-r--r-- 1 root root  11K 2024-04-21 20:28 multimc.html
-rw-r--r-- 1 root root  29K 2024-04-21 20:28 nordvpn.html
-rw-r--r-- 1 root root  22K 2024-04-21 20:32 ocenaudio.html
-rw-r--r-- 1 root root  12K 2024-04-21 20:25 openrgb.html
-rw-r--r-- 1 root root 299K 2024-04-21 20:25 rstudio.html
-rw-r--r-- 1 root root 349K 2024-04-21 20:25 rstudio-server.html
-rw-r--r-- 1 root root  92K 2024-04-21 20:25 sejda-desktop.html
-rw-r--r-- 1 root root 5,2K 2024-04-21 20:25 shutter-encoder.html
-rw-r--r-- 1 root root  39K 2024-04-21 20:25 smartgit.html
-rw-r--r-- 1 root root  19K 2024-04-21 20:25 stremio.html
-rw-r--r-- 1 root root 3,2K 2024-04-21 20:43 supported_apps.list
-rw-r--r-- 1 root root 3,2K 2024-04-21 20:43 supported.list
-rw-r--r-- 1 root root  13K 2024-04-21 20:26 tixati.html
-rw-r--r-- 1 root root  50K 2024-04-21 20:26 tonelib-bassdrive.html
-rw-r--r-- 1 root root  50K 2024-04-21 20:26 tonelib-gfx.html
-rw-r--r-- 1 root root  50K 2024-04-21 20:26 tonelib-jam.html
-rw-r--r-- 1 root root  50K 2024-04-21 20:26 tonelib-metal.html
-rw-r--r-- 1 root root  50K 2024-04-21 20:26 tonelib-noisereducer.html
-rw-r--r-- 1 root root  50K 2024-04-21 20:26 tonelib-tubewarmth.html
-rw-r--r-- 1 root root  50K 2024-04-21 20:26 tonelib-zoom.html
-rw-r--r-- 1 root root  36K 2024-04-21 20:26 vuescan.html
-rw-r--r-- 1 root root 399K 2024-04-21 20:26 webex.html