Auto_Bangumi icon indicating copy to clipboard operation
Auto_Bangumi copied to clipboard

Published 20 hours ago • verified publisher icon EstrellaXD

[错误报告]程序重启不会再对rss进行订阅

Open EstrellaXD opened this issue 1 year ago • 9 comments 

          我这里使用docker cli部署版本3.1.11，webui使用vuetorrent
  • 重启容器会报Program failed to start.，切换为默认UI并重启ab可正常运行
  • 容器重启后不会再对rss进行订阅，需要手动移除rss并重新添加，直到下次重启容器之前都可以正常订阅rss

Originally posted by @EYW-015 in https://github.com/EstrellaXD/Auto_Bangumi/issues/536#issuecomment-1859194731

EstrellaXD avatar Dec 18 '23 03:12 EstrellaXD

原comment描述

容器重启之后，即使蜜柑的rss有内容更新，ab日志中也没有订阅反应，qb中也没有添加新种子 在容器正常运行周期中，手动添加的rss会在此次运行中每周持续正常更新订阅 直至容器停止运行，所有订阅不再向qb添加新内容，需要手动重新添加 日志简洁没有任何反应，也不知道ab有没有对订阅更新成功，还是对qb推送失效

部署情况

使用版本为qbittorrent-nox-static-4.5.5-lib1.2，在ubuntu本机直接运行，webui为vuetorrent-2.4.0 autobangumi使用docker cli部署

ab配置如下 
{
    "program": {
        "rss_time": 600,
        "rename_time": 60,
        "webui_port": 7892
    },
    "downloader": {
        "type": "qbittorrent",
        "host": "192.168.60.10:9092",
        "username": "xxx",
        "password": "xxx",
        "path": "/path/to/anime/",
        "ssl": false
    },
    "rss_parser": {
        "enable": true,
        "filter": [
            "720",
            "\\d+-\\d",
            "cht|CHT",
            "BIG5",
            "繁"
        ],
        "language": "zh"
    },
    "bangumi_manage": {
        "enable": true,
        "eps_complete": false,
        "rename_method": "advance",
        "group_tag": false,
        "remove_bad_torrent": false
    },
    "log": {
        "debug_enable": true
    },
    "proxy": {
        "enable": true,
        "type": "http",
        "host": "192.168.60.10",
        "port": 7890,
        "username": "",
        "password": ""
    },
    "notification": {
        "enable": false,
        "type": "telegram",
        "token": "",
        "chat_id": ""
    },
    "experimental_openai": {
        "enable": false,
        "api_key": "",
        "api_base": "https://api.openai.com/v1",
        "api_type": "openai",
        "api_version": "2023-05-15",
        "model": "gpt-3.5-turbo",
        "deployment_id": ""
    }
}

使用流程

  1. qb正常运行，启用ab docker容器
  2. 报Program failed to start.
  3. 恢复qb默认webui
  4. 重启程序(在ab web页面右上角重启程序)，ab正常运行，日志Program running.
  5. qbittorrent设置回vuetorrent
    • 设为默认ui重启程序正常运行后，无论是否设为vue，无论几次重启程序(非重启容器)，都可正常运行
  6. 在ui为vue的情况，手动添加rss订阅，正常获取种子并推送至qb进行下载
  7. 数日后rss番剧更新，qb正常获取到了新发布的种子并进行下载
  8. 重启ab容器，并重复上述1-6流程均可复现
  9. 数日后，上次运行容器所添加的rss均不会再将种子推送至qb进行下载，本次运行所手动添加的种子可正常更新并推送

debug日志

日志时间与操作

  • 141349 启动容器
  • 141438 更改ui并重启ab程序
  • 141457 再次重启ab程序
    • 删除一个rss订阅，保留其他
  • 141545 手动添加rss订阅
ab日志如下 
[2023-12-18 14:13:49] INFO:     Version 3.1.11  Author: EstrellaXD Twitter: https://twitter.com/Estrella_Pan
[2023-12-18 14:13:49] INFO:     GitHub: https://github.com/EstrellaXD/Auto_Bangumi/
[2023-12-18 14:13:49] INFO:     Starting AutoBangumi...
[2023-12-18 14:13:49] INFO:     Config loaded
[2023-12-18 14:13:49] DEBUG:    Starting new HTTP connection (1): 192.168.60.10:9092
[2023-12-18 14:13:49] DEBUG:    http://192.168.60.10:9092 "GET / HTTP/1.1" 200 632
[2023-12-18 14:13:49] WARNING:  Program failed to start.
[2023-12-18 14:13:49] INFO:     Application startup complete.
[2023-12-18 14:13:49] INFO:     Uvicorn running on http://0.0.0.0:7892 (Press CTRL+C to quit)
[2023-12-18 14:13:58] DEBUG:    Calling on_field_start with no data
[2023-12-18 14:13:58] DEBUG:    Calling on_field_name with data[0:8]
[2023-12-18 14:13:58] DEBUG:    Calling on_field_data with data[9:15]
[2023-12-18 14:13:58] DEBUG:    Calling on_field_end with no data
[2023-12-18 14:13:58] DEBUG:    Calling on_field_start with no data
[2023-12-18 14:13:58] DEBUG:    Calling on_field_name with data[16:24]
[2023-12-18 14:13:58] DEBUG:    Calling on_field_data with data[25:33]
[2023-12-18 14:13:58] DEBUG:    Calling on_field_end with no data
[2023-12-18 14:13:58] DEBUG:    Calling on_end with no data
[2023-12-18 14:13:58] DEBUG:    detected 'bcrypt' backend, version '4.0.1'
[2023-12-18 14:13:58] DEBUG:    'bcrypt' backend lacks $2$ support, enabling workaround
[2023-12-18 14:14:38] INFO:     Config loaded
[2023-12-18 14:14:38] DEBUG:    Starting new HTTP connection (1): 192.168.60.10:9092
[2023-12-18 14:14:38] DEBUG:    http://192.168.60.10:9092 "GET / HTTP/1.1" 200 642
[2023-12-18 14:14:38] DEBUG:    Re-initializing context...
[2023-12-18 14:14:38] DEBUG:    [Downloader] Authed.
[2023-12-18 14:14:38] INFO:     Program running.
[2023-12-18 14:14:38] DEBUG:    [Downloader] Authed.
[2023-12-18 14:14:38] DEBUG:    [Engine] Get 3 RSS items
[2023-12-18 14:14:38] DEBUG:    [Downloader] Authed.
[2023-12-18 14:14:38] DEBUG:    [Renamer] Start rename process.
[2023-12-18 14:14:38] DEBUG:    [Renamer] Rename process finished.
[2023-12-18 14:14:39] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3026&subgroupid=19. Status: 200
[2023-12-18 14:14:39] DEBUG:    Insert 0 torrents in database.
[2023-12-18 14:14:40] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3074&subgroupid=370. Status: 200
[2023-12-18 14:14:40] DEBUG:    Insert 0 torrents in database.
[2023-12-18 14:14:42] DEBUG:    [Network] Successfully connected to https://mikanime.tv/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-18 14:14:42] DEBUG:    Insert 0 torrents in database.
[2023-12-18 14:14:57] INFO:     Config loaded
[2023-12-18 14:14:57] INFO:     Program running.
[2023-12-18 14:14:57] DEBUG:    [Downloader] Authed.
[2023-12-18 14:14:57] DEBUG:    [Renamer] Start rename process.
[2023-12-18 14:14:57] DEBUG:    [Downloader] Authed.
[2023-12-18 14:14:57] DEBUG:    [Engine] Get 3 RSS items
[2023-12-18 14:14:57] DEBUG:    [Renamer] Rename process finished.
[2023-12-18 14:14:58] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3026&subgroupid=19. Status: 200
[2023-12-18 14:14:58] DEBUG:    Insert 0 torrents in database.
[2023-12-18 14:14:59] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3074&subgroupid=370. Status: 200
[2023-12-18 14:14:59] DEBUG:    Insert 0 torrents in database.
[2023-12-18 14:15:01] DEBUG:    [Network] Successfully connected to https://mikanime.tv/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-18 14:15:01] DEBUG:    Insert 0 torrents in database.
[2023-12-18 14:15:45] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-18 14:15:45] DEBUG:    RAW:[千夏字幕组][葬送的芙莉莲_Sousou no Frieren][第15话][1080p_AVC][简体][招募新人] >> Sousou no Frieren
[2023-12-18 14:15:46] DEBUG:    [Network] Successfully connected to https://mikanani.me/Home/Episode/fd141df780d3533875e03dc51ded360c161930a3. Status: 200
[2023-12-18 14:15:47] DEBUG:    [Network] Successfully connected to https://mikanani.me/images/Bangumi/202309/5ce9fed1.jpg. Status: 200
[2023-12-18 14:15:52] DEBUG:    [Downloader] Authed.
[2023-12-18 14:15:52] DEBUG:    RSS Item https://mikanani.me/RSS/Bangumi?bangumiId=3141&subgroupid=37 not exists, adding...
[2023-12-18 14:15:54] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-18 14:15:54] DEBUG:    [Downloader] Authed.
[2023-12-18 14:15:55] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231217/fd141df780d3533875e03dc51ded360c161930a3.torrent. Status: 200
[2023-12-18 14:15:55] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231217/24f81fc678fad51fb9d5ad084ca7cfc5875f1fbb.torrent. Status: 200
[2023-12-18 14:15:55] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231205/7e11c21700d6c806cf718caaa1471a383370ee99.torrent. Status: 200
[2023-12-18 14:15:56] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231129/690a62c72875533ed8ce991643b62aa196dd1c6b.torrent. Status: 200
[2023-12-18 14:15:56] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231123/277d649ba4550b38065d9ccfa924d5e3ef94259b.torrent. Status: 200
[2023-12-18 14:15:57] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231120/9512141f60e991df2e32d8ff6b76e985c627c35c.torrent. Status: 200
[2023-12-18 14:15:57] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231105/f9dd725afe3b19266e6e41fe1ed44b8e4167e60b.torrent. Status: 200
[2023-12-18 14:15:57] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231102/9e82473d2b8e917b5e6c491d2fe8ee4183db9ca3.torrent. Status: 200
[2023-12-18 14:15:57] DEBUG:    [Downloader] Authed.
[2023-12-18 14:15:57] DEBUG:    [Renamer] Start rename process.
[2023-12-18 14:15:58] DEBUG:    [Renamer] Rename process finished.
[2023-12-18 14:15:58] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231025/5b90fdca06bde825ab4f3b6b57da53872b3f8b11.torrent. Status: 200
[2023-12-18 14:15:58] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231020/e33d92ae0992417b29f7ee6841e28e21bf70654a.torrent. Status: 200
[2023-12-18 14:15:59] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231016/7f03792f1e803397cfb69c6d4acca204926a2e21.torrent. Status: 200
[2023-12-18 14:16:00] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231009/5b68bd565a6886219a2af0da01b0073a472826a8.torrent. Status: 200
[2023-12-18 14:16:00] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231008/24331fb2dc3a8842ee83956e3427169d1f8e528e.torrent. Status: 200
[2023-12-18 14:16:01] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231006/6b2e93416908508763a1fd5a23c7548b62408450.torrent. Status: 200
[2023-12-18 14:16:01] DEBUG:    [Network] Successfully connected to https://mikanani.me/Download/20231005/5283f37d58fbc99eb5905d51d19525992b4e8f19.torrent. Status: 200
[2023-12-18 14:16:01] DEBUG:    [Downloader] Torrent added before: 葬送的芙莉莲
[2023-12-18 14:16:01] DEBUG:    Insert 15 torrents in database.

EYW-015 avatar Dec 18 '23 06:12 EYW-015

12月22日更新

咒术回战rss信息为上午10点16更新 蜜柑网站显示为凌晨2点10分更新

qb日志中未获取到种子推送相关信息

截取10点14分~10点24分日志，两次订阅，未获取到种子更新

[2023-12-22 10:14:07] DEBUG:    [Downloader] Authed.
[2023-12-22 10:14:07] DEBUG:    [Engine] Get 3 RSS items
[2023-12-22 10:14:08] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3026&subgroupid=19. Status: 200
[2023-12-22 10:14:08] DEBUG:    Insert 0 torrents in database.
[2023-12-22 10:14:09] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3074&subgroupid=370. Status: 200
[2023-12-22 10:14:09] DEBUG:    Insert 0 torrents in database.
[2023-12-22 10:14:09] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-22 10:14:09] DEBUG:    Insert 0 torrents in database.
[2023-12-22 10:14:55] DEBUG:    [Downloader] Authed.
[2023-12-22 10:14:55] DEBUG:    [Renamer] Start rename process.
[2023-12-22 10:14:55] DEBUG:    [Renamer] Rename process finished.
[2023-12-22 10:16:55] DEBUG:    [Downloader] Authed.
[2023-12-22 10:16:55] DEBUG:    [Renamer] Start rename process.
[2023-12-22 10:16:55] DEBUG:    [Renamer] Rename process finished.
[2023-12-22 10:18:55] DEBUG:    [Downloader] Authed.
[2023-12-22 10:18:55] DEBUG:    [Renamer] Start rename process.
[2023-12-22 10:18:56] DEBUG:    [Renamer] Rename process finished.
[2023-12-22 10:20:56] DEBUG:    [Downloader] Authed.
[2023-12-22 10:20:56] DEBUG:    [Renamer] Start rename process.
[2023-12-22 10:20:56] DEBUG:    [Renamer] Rename process finished.
[2023-12-22 10:22:56] DEBUG:    [Downloader] Authed.
[2023-12-22 10:22:56] DEBUG:    [Renamer] Start rename process.
[2023-12-22 10:22:56] DEBUG:    [Renamer] Rename process finished.
[2023-12-22 10:24:09] DEBUG:    [Downloader] Authed.
[2023-12-22 10:24:09] DEBUG:    [Engine] Get 3 RSS items
[2023-12-22 10:24:10] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3026&subgroupid=19. Status: 200
[2023-12-22 10:24:10] DEBUG:    Insert 0 torrents in database.
[2023-12-22 10:24:11] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3074&subgroupid=370. Status: 200
[2023-12-22 10:24:11] DEBUG:    Insert 0 torrents in database.
[2023-12-22 10:24:12] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-22 10:24:12] DEBUG:    Insert 0 torrents in database.
[2023-12-22 10:24:56] DEBUG:    [Downloader] Authed.
[2023-12-22 10:24:56] DEBUG:    [Renamer] Start rename process.

截取凌晨2点13分至2点23分两次订阅日志

[2023-12-22 02:12:59] DEBUG:    [Downloader] Authed.
[2023-12-22 02:12:59] DEBUG:    [Engine] Get 3 RSS items
[2023-12-22 02:13:00] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3026&subgroupid=19. Status: 200
[2023-12-22 02:13:00] DEBUG:    Insert 0 torrents in database.
[2023-12-22 02:13:00] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3074&subgroupid=370. Status: 200
[2023-12-22 02:13:00] DEBUG:    Insert 0 torrents in database.
[2023-12-22 02:13:01] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-22 02:13:01] DEBUG:    Insert 0 torrents in database.


[2023-12-22 02:23:01] DEBUG:    [Downloader] Authed.
[2023-12-22 02:23:01] DEBUG:    [Engine] Get 3 RSS items
[2023-12-22 02:23:01] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3026&subgroupid=19. Status: 200
[2023-12-22 02:23:01] DEBUG:    Insert 0 torrents in database.
[2023-12-22 02:23:01] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3074&subgroupid=370. Status: 200
[2023-12-22 02:23:01] DEBUG:    Insert 0 torrents in database.
[2023-12-22 02:23:02] DEBUG:    [Network] Successfully connected to https://mikanani.me/RSS/Bangumi?bangumiId=3141&subgroupid=37. Status: 200
[2023-12-22 02:23:02] DEBUG:    Insert 0 torrents in database.

EYW-015 avatar Dec 22 '23 09:12 EYW-015

12月22日更新

咒术回战rss信息为上午10点16更新 蜜柑网站显示为凌晨2点10分更新

这个问题是你过滤器问题，请自行排查。

VueTorrent 返回的 Header 目前还没适配，如果不会自行修改 meta 请换回原本的 UI。

从日志上看没有明显的程序错误，请检查你的过滤器

数日后，上次运行容器所添加的rss均不会再将种子推送至qb进行下载，本次运行所手动添加的种子可正常更新并推送

请检查你的 data.db 检查里面 torrent 表中是否添加完成。

EstrellaXD avatar Dec 22 '23 10:12 EstrellaXD

改了设置中的过滤器成功订阅了一次

修改前：单独订阅中不过滤繁，即允许包含繁字 设置项中过滤繁，即不允许包含繁 修改内容：设置页中删除过滤繁

请问设置中的过滤器是否会覆盖单独番剧订阅的过滤器，还是两者同时作用，亦或是单独过滤优先

EYW-015 avatar Dec 22 '23 22:12 EYW-015

改了设置中的过滤器成功订阅了一次

修改前：单独订阅中不过滤繁，即允许包含繁字 设置项中过滤繁，即不允许包含繁 修改内容：设置页中删除过滤繁

请问设置中的过滤器是否会覆盖单独番剧订阅的过滤器，还是两者同时作用，亦或是单独过滤优先

优先以番剧内为准，设置内为全局过滤器

EstrellaXD avatar Dec 23 '23 02:12 EstrellaXD

12月29日更新

rss订阅名称含：[简繁外挂字幕]

  • 全局过滤：720 \d+-\d cht|CHT BIG5 繁 体
  • 番剧单独过滤：720 \d+-\d cht|CHT BIG5

订阅未获取到种子，判断番剧单独过滤不是独立生效，而是全局与单独同时生效

小更：删除全局过滤的 繁 体 之后，重启程序并没有获取到新种子，重启容器之后获取到了新种子

EYW-015 avatar Dec 29 '23 13:12 EYW-015

2024.02.01更新

根据测试，确定全局过滤与单独过滤同时生效 在单独设置番剧单独过滤情况下，无法独立生效，会受到全局过滤影响

EYW-015 avatar Jan 31 '24 16:01 EYW-015

2024.02.02订阅测试

种子包含三种命名：简繁内封，简体，繁体

  1. 手动添加订阅并设置单独番剧过滤器繁，全局过滤为体，首次订阅结果获取为简体 1.1. 首次订阅成功后，重启容器，第二周rss更新后订阅为空 1.2. 首次订阅成功后，不重启容器，第二周rss更新后订阅为简体
  2. 手动添加订阅并过滤繁，全局清空，首次订阅结果为简体 2.1. 首次订阅成功后，无论是否重启容器，第二周rss更新结果都为简体

结论 重启容器，会导致全局过滤器应用到所有番剧，导致过滤改变

EYW-015 avatar Feb 01 '24 21:02 EYW-015

结论 重启容器，会导致全局过滤器应用到所有番剧，导致过滤改变

我也出现了这个问题，看了下代码，发现只有新增订阅时，会传这个 filter image

而之后的 refresh rss 中没有传 filter，所以程序使用了默认的全局 filter image

xxxuuu avatar Jul 24 '24 15:07 xxxuuu