SafeLine icon indicating copy to clipboard operation
SafeLine copied to clipboard

[Bug] Log errors with detect failed to connect on 8001

Open lordraiden opened this issue 10 months ago โ€ข 21 comments

What happened?

I get this errors in the log after running safeline

This configuration was working before

container-logs-2025-07-15T17-35-41.zip

safeline-detector  | '/detector/snserver.yml' -> '/detector/detector.yml'
safeline-detector  | '/detector/libfusion2.so' -> '/detector/config/libfusion2.so'
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - init started, version info: [rskynet version data] commit_id: 059adc2cf2e2cae2f8e3ed6d7d4b40c4bc2e86f8; branch: v1.3.0-ce; tag: v1.3.0-ce; build_time: 2025-07-08T03:58:38.109198557+00:00; rustc_version: rustc 1.85.1 (4eb161250 2025-03-15); build_type: release; engine_type: legacy_skynet; hyperscan_version: 5.2.0 2022-02-15; matrix_version: 1.1.3-ce; arch: x86_64; [end]
safeline-detector  | [2025-07-15T17:27:38.430Z DEBUG rskynet::config::config] - no config file specified (/tmp/.rskynet.yml does not exist), use default config
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - global log level: DEBUG
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::check] - hyperscan version is 5.2.0 2022-02-15, mode: AVX2
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - panic hook is enabled
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - init done
safeline-detector  | 2025-07-15T17:27:38.642828Z  WARN snserver_engine::report: management server address is empty, skipping report
safeline-detector  | 2025-07-15T17:27:39.044672Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:39.444762Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:39.681212Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:39.845108Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:40.244465Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025/07/15 19:27:48 ERROR wait command failed, wait to retry err="signal: killed"
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - init started, version info: [rskynet version data] commit_id: 059adc2cf2e2cae2f8e3ed6d7d4b40c4bc2e86f8; branch: v1.3.0-ce; tag: v1.3.0-ce; build_time: 2025-07-08T03:58:38.109198557+00:00; rustc_version: rustc 1.85.1 (4eb161250 2025-03-15); build_type: release; engine_type: legacy_skynet; hyperscan_version: 5.2.0 2022-02-15; matrix_version: 1.1.3-ce; arch: x86_64; [end]
safeline-detector  | [2025-07-15T17:27:49.822Z DEBUG rskynet::config::config] - no config file specified (/tmp/.rskynet.yml does not exist), use default config
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - global log level: DEBUG
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::check] - hyperscan version is 5.2.0 2022-02-15, mode: AVX2
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - panic hook is enabled
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - init done
safeline-detector  | 2025-07-15T17:27:49.831438Z  WARN snserver_engine::report: management server address is empty, skipping report
safeline-chaos     | 2025/07/15 17:27:38 Config file generated successfully
safeline-chaos     | 2025-07-15 17:27:38,274 CRIT Supervisor is running as root.  Privileges were not dropped because no user is specified in the config file.  If you intend to run as root, you can set user=root in the config file to avoid this message.
safeline-chaos     | 2025-07-15 17:27:38,278 INFO supervisord started with pid 1
safeline-chaos     | 2025-07-15 17:27:39,281 INFO spawned: 'auth' with pid 15
safeline-chaos     | 2025-07-15 17:27:39,283 INFO spawned: 'challenge-server' with pid 16
safeline-chaos     | 2025-07-15 17:27:39,286 INFO spawned: 'chaos' with pid 19
safeline-chaos     | 2025-07-15 17:27:39,288 INFO spawned: 'waiting' with pid 22
safeline-chaos     | 
safeline-chaos     | --- Configuration ---
safeline-chaos     | Debug: false
safeline-chaos     | Server: 0.0.0.0:8080
safeline-tengine   | sed: can't read /etc/nginx//sites-enabled/IF_backend_*: No such file or directory
safeline-tengine   | current region oversea
safeline-luigi     | 2025/07/15 19:27:40 [INFO] cmd/main.go:93 ๐ŸŒ Server ready at :80
safeline-tengine   | 2025/07/15 19:27:38 [INFO] config/config.go:17 nginx conf path: /etc/nginx/sites-enabled
safeline-chaos     | 
safeline-chaos     | Robot:
safeline-pg        | 
safeline-chaos     |   Threshold: 1.000000
safeline-pg        | PostgreSQL Database directory appears to contain a database; Skipping initialization
safeline-tengine   | [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
safeline-tengine   |  - using env:      export GIN_MODE=release
safeline-tengine   |  - using code:     gin.SetMode(gin.ReleaseMode)
safeline-tengine   | 
safeline-tengine   | [GIN-debug] GET    /health                   --> main.main.func2.1 (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/forbidden_page --> tcd/client.ReturnForbiddenResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/acl_page       --> tcd/client.ReturnAclResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/not_found_page --> tcd/client.ReturnNotFoundResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/offline_page   --> tcd/client.ReturnOfflineResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/bad_gateway_page --> tcd/client.ReturnBadGatewayResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/gateway_timeout_page --> tcd/client.ReturnGatewayTimeoutPages (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/not_found_path_page --> tcd/client.ReturnNotFoundPathResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/waiting_room_page --> tcd/client.ReturnWaitRoomResponse (1 handlers)
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Starting fvm manager with config /app/config.yml" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="๐ŸŒ http server started on port 80"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\t*runner.Runner <= git.in.chaitin.net/dev/go/module.v2/runner.NewRunner()" logger=manager
safeline-chaos     |   Debug: false
safeline-chaos     |   Calculators:
safeline-chaos     |     sampling: 1
safeline-chaos     |     smoothness: 1
safeline-chaos     |     range: 1
safeline-tengine   | [GIN-debug] Listening and serving HTTP on listener what's bind with address@/app/sock/tcd_error.sock
safeline-tengine   | [GIN-debug] [WARNING] You trusted all proxies, this is NOT safe. We recommend you to set a value.
safeline-tengine   | Please check https://github.com/gin-gonic/gin/blob/master/docs/doc.md#dont-trust-all-proxies for details.
safeline-tengine   | [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
safeline-tengine   |  - using env:      export GIN_MODE=release
safeline-tengine   |  - using code:     gin.SetMode(gin.ReleaseMode)
safeline-tengine   | 
safeline-tengine   | [GIN-debug] POST   /task                     --> tcd/client.PostTask (1 handlers)
safeline-pg        | 
safeline-pg        | 2025-07-15 19:27:38.197 CEST [1] LOG:  starting PostgreSQL 15.2 (Debian 15.2-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
safeline-pg        | 2025-07-15 19:27:38.197 CEST [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
safeline-pg        | 2025-07-15 19:27:38.197 CEST [1] LOG:  listening on IPv6 address "::", port 5432
safeline-pg        | 2025-07-15 19:27:38.209 CEST [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
safeline-pg        | 2025-07-15 19:27:38.229 CEST [29] LOG:  database system was shut down at 2025-07-15 19:27:13 CEST
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*config.ManagerConfig" logger=manager
safeline-tengine   | [GIN-debug] POST   /task/secret              --> tcd/client.PostTaskSecret (1 handlers)
safeline-tengine   | [GIN-debug] Listening and serving HTTP on unix://app/sock/tcd.sock
safeline-tengine   | [GIN-debug] [WARNING] You trusted all proxies, this is NOT safe. We recommend you to set a value.
safeline-tengine   | Please check https://github.com/gin-gonic/gin/blob/master/docs/doc.md#dont-trust-all-proxies for details.
safeline-pg        | 2025-07-15 19:27:38.252 CEST [1] LOG:  database system is ready to accept connections
safeline-chaos     |     acceleration: 1
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*gorm.DB" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\t*fvm.FVM <= git.in.chaitin.net/patronus/fvm/manager/module/fvm.New()" logger=manager
safeline-chaos     |     dpi: 1
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\trpc.RPCListener <= git.in.chaitin.net/patronus/fvm/manager/module/rpc.NewRPCListener()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*grpc.Server" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\t*manager.FVMServer <= git.in.chaitin.net/patronus/fvm/manager/module/rpc/fvm.NewServer()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*log.Logger" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\tfx.Lifecycle <= go.uber.org/fx.New.func1()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\tfx.Shutdowner <= go.uber.org/fx.(*App).shutdowner-fm()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\tfx.DotGraph <= go.uber.org/fx.(*App).dotGraph-fm()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/dev/go/module.v2/runner.init.func1()" logger=manager
safeline-pg        | 2025-07-15 19:32:38.318 CEST [27] LOG:  checkpoint starting: time
safeline-pg        | 2025-07-15 19:32:46.184 CEST [27] LOG:  checkpoint complete: wrote 81 buffers (0.5%); 1 WAL file(s) added, 0 removed, 0 recycled; write=7.817 s, sync=0.034 s, total=7.867 s; sync files=57, longest=0.010 s, average=0.001 s; distance=350 kB, estimate=350 kB
safeline-chaos     | 
safeline-chaos     | JWT:
safeline-chaos     |   SecretKey: ********
safeline-chaos     |   PublicKey: -----BEGIN PUBLIC KEY-----
safeline-chaos     | MFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEmZJDZ9GoG6g2h7OoJofWAsfouEGD
safeline-chaos     | qpraZvpsRj8zlL8F8Gbdb9/13gpZUWmdFQ2dAx7R0wX/BjPV3BXjgmiY/g==
safeline-chaos     | -----END PUBLIC KEY-----
safeline-chaos     |   Algorithm: ES256
safeline-chaos     |   ExpireSeconds: 30
safeline-chaos     | ---------------------
safeline-chaos     | โ‡จ http server started on [::]:8080
safeline-chaos     | current runtime dir: /app/chaos
safeline-chaos     | current config: Config {
safeline-chaos     |     log: Log {
safeline-chaos     |         writer: Console {
safeline-chaos     |             stdout: false,
safeline-chaos     |         },
safeline-chaos     |         level: Info,
safeline-chaos     |     },
safeline-chaos     |     core: CoreConfig {
safeline-chaos     |         heavy_worker: 10,
safeline-chaos     |         max_cache_size: 3000,
safeline-chaos     |         item_count: 10,
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/patronus/fvm/manager/module/manager.Run()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Auto migrating DB"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Loading update from DB"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Loading complete"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/patronus/fvm/manager/module/rpc/fvm.Register()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/patronus/fvm/manager/module/rpc.Run()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] START\t\tgit.in.chaitin.net/dev/go/module.v2/runner.NewRunner()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Module] START\tgit.in.chaitin.net/patronus/fvm/manager/module/rpc.Run()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Starting rpc server"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] RUNNING" logger=manager
safeline-fvm       | time="2025-07-15T19:27:44+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:27:44+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: using the "epoll" event method
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: nginx/1.28.0
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: built by gcc 14.2.0 (Alpine 14.2.0) 
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: OS: Linux 6.12.24-Unraid
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: getrlimit(RLIMIT_NOFILE): 40960:40960
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker processes
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 10
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:27:46+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:27:46+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 11
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 12
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 13
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 14
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 15
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 16
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 17
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 18
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 19
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 20
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 21
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 22
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 23
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 24
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 25
safeline-mgt       | 2025/07/15 19:27:38 [error] 10#10: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://[::1]:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 10#10: *1 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://[::1]:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [error] 10#10: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 10#10: *1 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [error] 11#11: *4 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 11#11: *4 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-chaos     |         item_ttl: 3600,
safeline-chaos     |     },
safeline-chaos     |     http: HttpConfig {
safeline-chaos     |         listen: "0.0.0.0:9000",
safeline-chaos     |         process_timeout: 300ms,
safeline-chaos     |     },
safeline-chaos     |     stpp: StppConfig {
safeline-chaos     |         listen: "unix:///app/chaos/stpp.sock",
safeline-chaos     |         max_package_limit: 10485760,
safeline-chaos     |         process_timeout: 1.5s,
safeline-chaos     |     },
safeline-chaos     | }
safeline-chaos     | listen and serve on unix:///app/sock/waiting.sock
safeline-chaos     | start tcp server on unix:///app/sock/waiting_tcp.sock
safeline-chaos     | 2025-07-15T17:27:40.048687Z  INFO chaos_serve::route: listening on 0.0.0.0:9000
safeline-chaos     | 2025-07-15T17:27:40.048815Z  INFO chaos_serve::stpp: listening on "/app/chaos/stpp.sock" (pathname)
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: auth entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: challenge-server entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-mgt       | 2025/07/15 19:27:38 [error] 11#11: *4 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 11#11: *4 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:39 [error] 13#13: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:39 [warn] 13#13: *7 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:39 [error] 13#13: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:39 [warn] 13#13: *7 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:41 [error] 14#14: *10 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:41 [warn] 14#14: *10 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:41 [error] 14#14: *10 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:41 [warn] 14#14: *10 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:44 [error] 12#12: *13 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [warn] 12#12: *13 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [error] 12#12: *13 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [warn] 12#12: *13 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:44 [ERROR] fvm fvm/generator.go:118 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:44 [ERROR] server/serve.go:105 genrate fsl failed: rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:27:44 ๐Ÿš€ MGT server ready
safeline-mgt       | 2025/07/15 19:27:44 [INFO] server/serve.go:175 Bridge server ready at: unix /app/run/safeline.sock
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm cron/threat_info.go:147 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] cron cron/threat_info.go:427 rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] cron cron/cron.go:70 rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm cron/threat_info.go:409 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:46 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:46 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:46 [ERROR] cron cron/cron.go:71 update crawler info failed: rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:28:45 [ERROR] api.auth [email protected]/context.go:185 decrypt password failed: invalid padding
safeline-mgt       | 2025/07/15 19:29:58 [ERROR] cfg runtime/asm_amd64.s:1700 Post "https://rivers-telemetry.chaitin.cn:10086/telemetry": dial tcp 121.43.103.178:10086: connect: connection timed out
safeline-mgt       | 2025/07/15 19:29:59 [ERROR] user [email protected]/context.go:185 user password updated
safeline-mgt       | 2025/07/15 19:29:59 [ERROR] middleware [email protected]/context.go:185 check jwt failed: jwt version not match, expect 1, got 0
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: chaos entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: waiting entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-chaos     | {"time":"2025-07-15T17:27:44.292929472Z","id":"","remote_ip":"10.10.31.4","host":"safeline-chaos:8080","method":"GET","uri":"/challenge/v2/api/auth/keys","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":7270,"latency_human":"7.27ยตs","bytes_in":0,"bytes_out":177}
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm cron/threat_info.go:147 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] cron api/intelligence.go:101 rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] api [email protected]/context.go:185 rules compile error, please check your params
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm cron/threat_info.go:409 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] cron api/ipgroup.go:554 update crawler info failed: rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"

How we reproduce?

Compose file

###############################################################
# Safeline CE
###############################################################

# Common settings #############################################

x-default: &config
  restart: unless-stopped
# cpuset: 10,22,11,23,8,20,9,21
  cpus: 12.0
  security_opt:
    - no-new-privileges:true
x-dns: &dns
  dns: 
    - ${dnsDMZ}
x-labels: &labels
  com.centurylinklabs.watchtower.enable: "true"
  net.unraid.docker.managed: "composeman"
  net.unraid.docker.shell: "sh"

## https://waf.chaitin.com/release/latest/compose.yaml   docker exec safeline-mgt resetadmin #  CExLoyB7

# Services ####################################################

services:

  mgt:
    container_name: ${safeline_mgt_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-mgt${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG:?image tag required}
    <<: [*config, *dns]
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ${SAFELINE_DIR}/resources/mgt:/app/data
      - ${SAFELINE_DIR}/logs/nginx:/app/log/nginx:z
      - ${SAFELINE_DIR}/resources/sock:/app/sock
      - /var/run:/app/run
    ports:
      - ${MGT_PORT:-9443}:1443
    healthcheck:
      test: curl -k -f https://localhost:1443/api/open/health
    environment:
      - MGT_PG=postgres://safeline-ce:${POSTGRES_PASSWORD}@${safeline_postgres_name}/safeline-ce?sslmode=disable
    depends_on:
      - postgres
      - fvm
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "5"
    networks:
      eth4.31:
        ipv4_address: ${mgt_ip} #4 mgt
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
      net.unraid.docker.webui: "https://${safeline_mgt_name}.${mydomain}/dashboard/#/"
      traefik.enable: true
      traefik.docker.network: eth4.31
      traefik.http.routers.mgt.entrypoints: https443
      traefik.http.routers.mgt.service: mgt
      traefik.http.routers.mgt.rule: "Host(`${safeline_mgt_name}.${mydomain}`)"
      traefik.http.routers.mgt.tls: true
      traefik.http.routers.mgt.middlewares: local-ipwhitelist@file, rate-limit@file, securityHeaders@file
      traefik.http.services.mgt.loadbalancer.server.port: 1443
      homepage.group: Proxy
      homepage.name: ${safeline_mgt_name}
      homepage.icon: safeline.png # https://github.com/walkxcode/dashboard-icons/tree/main/png https://gethomepage.dev/configs/services/#icons
      homepage.href: https://${safeline_mgt_name}.${mydomain}
      homepage.weight: 4
      homepage.showStats: false
  
  detect:
    container_name: ${safeline_detect_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-detector${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    volumes:
      - ${SAFELINE_DIR}/resources/detector:/resources/detector
      - ${SAFELINE_DIR}/logs/detector:/logs/detector
      - /etc/localtime:/etc/localtime:ro
    environment:
      - LOG_DIR=/logs/detector
    ports:
      - 8000:8000
    networks:
      eth4.31:
        ipv4_address: ${detect_ip} #5 detect
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
  
  tengine: #host
    container_name: ${safeline_tengine_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-tengine${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /etc/resolv.conf:/etc/resolv.conf:ro
      - ${SAFELINE_DIR}/resources/nginx:/etc/nginx
      - ${SAFELINE_DIR}/resources/detector:/resources/detector
      - ${SAFELINE_DIR}/resources/chaos:/resources/chaos
      - ${SAFELINE_DIR}/logs/nginx:/var/log/nginx:z
      - ${SAFELINE_DIR}/resources/cache:/usr/local/nginx/cache
      - ${SAFELINE_DIR}/resources/sock:/app/sock
    environment:
      - TCD_MGT_API=https://${mgt_ip}:1443/api/open/publish/server #mgt 4
      - TCD_SNSERVER=${detect_ip}:8000 #detect 5
      # deprecated
      - SNSERVER_ADDR=${detect_ip}:8000 #detect 5
      - CHAOS_ADDR=${chaos_ip} #chaos 10
    ulimits:
      nofile: 131072
    #network_mode: host  ##!!!!!!
    networks:
      eth4.31:
        ipv4_address: ${tengine_ip} # tengine
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
  
  luigi: #7
    container_name: ${safeline_luigi_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-luigi${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    environment:
      - MGT_IP=${mgt_ip} #mgt 4
      - LUIGI_PG=postgres://safeline-ce:${POSTGRES_PASSWORD}@${safeline_postgres_name}/safeline-ce?sslmode=disable
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ${SAFELINE_DIR}/resources/luigi:/app/data
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "5"
    depends_on:
      - detect
      - mgt
    networks:
      eth4.31:
        ipv4_address: ${luigi_ip} #7 luigi
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
  
  fvm:
    container_name: ${safeline_fvm_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-fvm${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    volumes:
      - /etc/localtime:/etc/localtime:ro
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "5"
    networks:
      eth4.31:
        ipv4_address: ${fvm_ip} #8 fvm
  
  chaos:
    container_name: ${safeline_chaos_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-chaos${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "10"
    environment:
      - DB_ADDR=postgres://safeline-ce:${POSTGRES_PASSWORD}@${safeline_postgres_name}/safeline-ce?sslmode=disable
    volumes:
      - ${SAFELINE_DIR}/resources/sock:/app/sock
      - ${SAFELINE_DIR}/resources/chaos:/app/chaos
    networks:
      eth4.31:
        ipv4_address: ${chaos_ip} #10 chaos
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"

  postgres:
    container_name: ${safeline_postgres_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-postgres${ARCH_SUFFIX}:15.2
    <<: [*config, *dns]
    volumes:
      - ${SAFELINE_DIR}/resources/postgres/data:/var/lib/postgresql/data
      - /etc/localtime:/etc/localtime:ro
    environment:
      - POSTGRES_USER=safeline-ce
      - POSTGRES_PASSWORD=${POSTGRES_PASSWORD:?postgres password required}
    networks:
      eth4.31:
        ipv4_address: ${postgres_ip} #2 postgres
    command: [postgres, -c, max_connections=600]
    healthcheck:
      test: pg_isready -U safeline-ce -d safeline-ce
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/postgres.png"

# Networks ####################################################

networks:
  eth4.31:
    name: eth4.31
    external: true
  net-safeline:
    internal: true

Env file


###############################################################
# Safeline
###############################################################

# General
TZ=Europe/Madrid
PUID=99
PGID=100
dockerdir=/mnt/services/docker/WebProxyDMZ
dnsDMZ=10.10.30.2
mydomain=asdasdasd.com.es

# Safeline

SAFELINE_DIR=/mnt/services/docker/WebProxyDMZ/Safeline
IMAGE_TAG=latest
MGT_PORT=9443
POSTGRES_PASSWORD=asdasdasd
SUBNET_PREFIX=10.10.31
IMAGE_PREFIX=chaitin
ARCH_SUFFIX=
RELEASE=
REGION=-g

# Container names
safeline_mgt_name=safeline-mgt
safeline_detect_name=safeline-detector
safeline_tengine_name=safeline-tengine
safeline_luigi_name=safeline-luigi
safeline_fvm_name=safeline-fvm
safeline_chaos_name=safeline-chaos
safeline_postgres_name=safeline-pg

# IP	
mgt_ip=10.10.31.4
postgres_ip=10.10.31.5
detect_ip=10.10.31.6 # Esta IP se configura en el plugin de Traefik con puerto 8000
luigi_ip=10.10.31.7
fvm_ip=10.10.31.8
chaos_ip=10.10.31.9
tengine_ip=10.10.31.10

Traeffik fileconfi.yml

  ## MIDDLEWARES ##
  middlewares:

    safeline:
      plugin:
        safeline:
          addr: 10.10.31.6:8000

Expected behavior

No response

Error log

No response

lordraiden avatar Jul 15 '25 17:07 lordraiden

Could this be part of the problem? I have change the 8001 to 8000 and still get the same errors in the log

Image Image Image Image

lordraiden avatar Jul 16 '25 14:07 lordraiden

Image

check listen_port in detector.yaml

xbingW avatar Jul 28 '25 08:07 xbingW

Image

check listen_port in detector.yaml

already checked you have it in the second post in the screenshot, I have it configured for traefik is was working before and not now, I have tried with 8000 and 8001 and nothing works

https://github.com/chaitin/traefik-safeline/issues/5

lordraiden avatar Jul 29 '25 09:07 lordraiden

The root cause of this error is the detector configuration error, which caused the detector to fail to start properly. It is recommended to reinstall waf to start the detector first, and then try to modify the configuration. This time, only change detector.yaml

xbingW avatar Jul 31 '25 03:07 xbingW

Try to execute docker exec safeline-detector cat /detector/snserver.yml to see the configuration

xbingW avatar Jul 31 '25 03:07 xbingW

@xbingW thanks for your help.

So this is the first run of a clean install with default detector.yml Logs : first run clean install.zip

Then I shutdown the compose, modify the detector yml like this and compose up again. Following this instructions: https://github.com/chaitin/traefik-safeline Image

Logs: second run detector.yml modified.zip

And this is the output of the command

root@Unraid:~# docker exec safeline-detector cat /detector/snserver.yml
fusion_sofile: /detector/config/libfusion2.so
ip_location_db: /detector/GeoLite2-City.mmdb
bind_addr: unix:///resources/detector/snserver.sock
# bind_addr: 0.0.0.0
# listen_port: 8000
health_check_addr: 0.0.0.0
health_check_port: 8001
mgt_server_addr: ""
# log: file:///logs/detector/snserver.log
log: stdout
log_level: warning
daemon: false
heartbeat_interval: 5000
max_queue_size: 16384
rlimit_nofile: 65536
web_log_interval: 400
web_log: http://safeline-luigi/api/log/envelop
ip_threat_db: /detector/safeline_ja4.db

lordraiden avatar Aug 03 '25 09:08 lordraiden

docker exec safeline-detector cat /detector/detector.yml What result is output?

xbingW avatar Aug 08 '25 06:08 xbingW

docker exec safeline-detector cat /detector/detector.yml

root@Unraid:~# docker exec safeline-detector cat /detector/detector.yml
bind_addr: 0.0.0.0
daemon: false
fusion_sofile: /detector/config/libfusion2.so
health_check_addr: 0.0.0.0
health_check_port: 8001
heartbeat_interval: 5000
ip_location_db: /detector/GeoLite2-City.mmdb
log: stdout
log_level: warning
max_queue_size: 16384
mgt_server_addr: ""
rlimit_nofile: 65536
web_log: http://safeline-luigi/api/log/envelop
web_log_interval: 400
worker: 1

lordraiden avatar Aug 09 '25 07:08 lordraiden

docker exec safeline-detector cat /detector/detector.yml

root@Unraid:~# docker exec safeline-detector cat /detector/detector.yml
bind_addr: 0.0.0.0
daemon: false
fusion_sofile: /detector/config/libfusion2.so
health_check_addr: 0.0.0.0
health_check_port: 8001
heartbeat_interval: 5000
ip_location_db: /detector/GeoLite2-City.mmdb
log: stdout
log_level: warning
max_queue_size: 16384
mgt_server_addr: ""
rlimit_nofile: 65536
web_log: http://safeline-luigi/api/log/envelop
web_log_interval: 400
worker: 1

It seems that the listen_port parameter is missing, which is why it does not start. You can try to see why detector entrypoint.sh is not written

xbingW avatar Aug 12 '25 02:08 xbingW

docker exec safeline-detector cat /detector/detector.yml

root@Unraid:~# docker exec safeline-detector cat /detector/detector.yml
bind_addr: 0.0.0.0
daemon: false
fusion_sofile: /detector/config/libfusion2.so
health_check_addr: 0.0.0.0
health_check_port: 8001
heartbeat_interval: 5000
ip_location_db: /detector/GeoLite2-City.mmdb
log: stdout
log_level: warning
max_queue_size: 16384
mgt_server_addr: ""
rlimit_nofile: 65536
web_log: http://safeline-luigi/api/log/envelop
web_log_interval: 400
worker: 1

It seems that the listen_port parameter is missing, which is why it does not start. You can try to see why detector entrypoint.sh is not written

It's a bug? It's a config thing? How do I fix it?

lordraiden avatar Aug 12 '25 08:08 lordraiden

@xbingW can you help me? My installation was working and after an upgrade it started to give problems, so must be a bug or something

lordraiden avatar Aug 16 '25 22:08 lordraiden

I have received your feedback, and I will focus on checking the error logs. May I ask if the logs are from the newly deployed WAF or are they error reports during the upgrade process?

Image

2481563546 avatar Aug 27 '25 03:08 2481563546

ave received your feedback, and I will focus on checking the error logs. May I ask if the logs are from the newly deployed WAF or are they error reports during the upgrade process?

Not sure but those could be after a new deployment since I did several clean installs to try to fix it. The same configuration was working before but broke after and update, not sure which one.

I can test whatever you want I send you the logs back. I am using the docker version with traefik

lordraiden avatar Aug 27 '25 15:08 lordraiden

ave received your feedback, and I will focus on checking the error logs. May I ask if the logs are from the newly deployed WAF or are they error reports during the upgrade process?

Not sure but those could be after a new deployment since I did several clean installs to try to fix it. The same configuration was working before but broke after and update, not sure which one.

I can test whatever you want I send you the logs back. I am using the docker version with traefik

Based on the latest error message error: load config: Invalid config: invalid listen_port: 0, it is likely that this issue is caused by the failure to successfully map the detector.yml file. If the detector.yml file of the host machine can be successfully mapped, you can check if the file mapping is successful using docker exec safeline-detector cat /resources/detector/detector.yml. You can first comment out the listening address and port in the detector.yml file on the host machine, then try restarting the detector container to see if it succeeds.Then execute docker exec safeline-detector cat /detector/detector.yml to check if the output content is consistent with the following. The standardized file is as shown below:

Image

2481563546 avatar Aug 27 '25 15:08 2481563546

I have delete everything clean install detector.yml empty this is the ouput of the command


root@Unraid:~# docker exec safeline-detector cat /detector/detector.yml
bind_addr: unix:///resources/detector/snserver.sock
daemon: false
fusion_sofile: /detector/config/libfusion2.so
health_check_addr: 0.0.0.0
health_check_port: 8001
heartbeat_interval: 5000
ip_location_db: /detector/GeoLite2-City.mmdb
log: stdout
log_level: warning
max_queue_size: 16384
mgt_server_addr: ""
rlimit_nofile: 65536
web_log: http://safeline-luigi/api/log/envelop
web_log_interval: 400
worker: 1

Anyway If I enable safeline middleware for a router in traefik it doesn't work probably because safeline traefik middleware cant connect to the detector without changing the configuration of detector yml.

This are the logs container-logs-2025-08-27T16-14-28.zip

Now I stop the compose edit the detector yml like this and start again the compose

Image

These are the logs detector container has a lot of errors container-logs-2025-08-27T16-18-35.zip

And this is the output of the command, still 8001

root@Unraid:~# docker exec safeline-detector cat /detector/detector.yml
bind_addr: 0.0.0.0
daemon: false
fusion_sofile: /detector/config/libfusion2.so
health_check_addr: 0.0.0.0
health_check_port: 8001
heartbeat_interval: 5000
ip_location_db: /detector/GeoLite2-City.mmdb
log: stdout
log_level: warning
max_queue_size: 16384
mgt_server_addr: ""
rlimit_nofile: 65536
web_log: http://safeline-luigi/api/log/envelop
web_log_interval: 400
worker: 1

And finally just to try something different I changed the ports in the docker compose for detect , in traefik middleware, and in the detector.yml to 8001 and still get the same errors

Image

lordraiden avatar Aug 27 '25 16:08 lordraiden

I have delete everything clean install detector.yml empty this is the ouput of the command


root@Unraid:~# docker exec safeline-detector cat /detector/detector.yml
bind_addr: unix:///resources/detector/snserver.sock
daemon: false
fusion_sofile: /detector/config/libfusion2.so
health_check_addr: 0.0.0.0
health_check_port: 8001
heartbeat_interval: 5000
ip_location_db: /detector/GeoLite2-City.mmdb
log: stdout
log_level: warning
max_queue_size: 16384
mgt_server_addr: ""
rlimit_nofile: 65536
web_log: http://safeline-luigi/api/log/envelop
web_log_interval: 400
worker: 1

Anyway If I enable safeline middleware for a router in traefik it doesn't work probably because safeline traefik middleware cant connect to the detector without changing the configuration of detector yml.

This are the logs container-logs-2025-08-27T16-14-28.zip

Now I stop the compose edit the detector yml like this and start again the compose

Image These are the logs detector container has a lot of errors [container-logs-2025-08-27T16-18-35.zip](https://github.com/user-attachments/files/22010241/container-logs-2025-08-27T16-18-35.zip)

And this is the output of the command, still 8001

root@Unraid:~# docker exec safeline-detector cat /detector/detector.yml
bind_addr: 0.0.0.0
daemon: false
fusion_sofile: /detector/config/libfusion2.so
health_check_addr: 0.0.0.0
health_check_port: 8001
heartbeat_interval: 5000
ip_location_db: /detector/GeoLite2-City.mmdb
log: stdout
log_level: warning
max_queue_size: 16384
mgt_server_addr: ""
rlimit_nofile: 65536
web_log: http://safeline-luigi/api/log/envelop
web_log_interval: 400
worker: 1

And finally just to try something different I changed the ports in the docker compose for detect , in traefik middleware, and in the detector.yml to 8001 and still get the same errors

Image

Okay, we'll first set up the environment internally to see if we can reproduce it.

2481563546 avatar Aug 28 '25 09:08 2481563546

If possible, you can try not using the safeline traefik middleware first and check if port 8000 can be correctly configured inside the container. Currently, it seems that in your environment, the listen_port: 8000 in detector.yml is not set properly. There are two guesses:

  1. The host machine did not pass listen_port: 8000 into the container. This can be confirmed using the command docker exec safeline-detector cat /resources/detector/detector.yml.
  2. If the command can be found using docker exec safeline-detector cat /resources/detector/detector.yml, please contact me again. It may be that the internal call of the container failed to pass the parameters to `/detector/d

2481563546 avatar Aug 29 '25 02:08 2481563546

If possible, you can try not using the safeline traefik middleware first and check if port 8000 can be correctly configured inside the container. Currently, it seems that in your environment, the listen_port: 8000 in detector.yml is not set properly. There are two guesses:

1. The host machine did not pass `listen_port: 8000` into the container. This can be confirmed using the command `docker exec safeline-detector cat /resources/detector/detector.yml`.

2. If the command can be found using `docker exec safeline-detector cat /resources/detector/detector.yml`, please contact me again. It may be that the internal call of the container failed to pass the parameters to `/detector/d

@2481563546

With

#bind_addr: 0.0.0.0
#listen_port: 8000
root@Unraid:~# docker exec safeline-detector cat /resources/detector/detector.yml
#bind_addr: 0.0.0.0
#listen_port: 8000root@Unraid:~# 

With

bind_addr: 0.0.0.0
listen_port: 8000
root@Unraid:~# docker exec safeline-detector cat /resources/detector/detector.yml
bind_addr: 0.0.0.0
listen_port: 8000root@Unraid:~# 

lordraiden avatar Sep 04 '25 15:09 lordraiden

If possible, you can try not using the safeline traefik middleware first and check if port 8000 can be correctly configured inside the container. Currently, it seems that in your environment, the listen_port: 8000 in detector.yml is not set properly. There are two guesses:

1. The host machine did not pass `listen_port: 8000` into the container. This can be confirmed using the command `docker exec safeline-detector cat /resources/detector/detector.yml`.

2. If the command can be found using `docker exec safeline-detector cat /resources/detector/detector.yml`, please contact me again. It may be that the internal call of the container failed to pass the parameters to `/detector/d

@2481563546

With

#bind_addr: 0.0.0.0
#listen_port: 8000
root@Unraid:~# docker exec safeline-detector cat /resources/detector/detector.yml
#bind_addr: 0.0.0.0
#listen_port: 8000root@Unraid:~# 

With

bind_addr: 0.0.0.0
listen_port: 8000
root@Unraid:~# docker exec safeline-detector cat /resources/detector/detector.yml
bind_addr: 0.0.0.0
listen_port: 8000root@Unraid:~# 

Have you tried running WAF alone without using traefik? Currently, it seems that port 8000 is not being monitored properly due to an environment issue.

2481563546 avatar Sep 08 '25 10:09 2481563546

I can't do that in my current architecture, anyway the error happens even before than introduce the change in detector.yml required for traeffik, so traeffik is not the issue, there is something wrong probably with the docker release of Safeline, as said it has been working fine for months, before it started to fail

lordraiden avatar Sep 11 '25 14:09 lordraiden

@2481563546 any news about this?

lordraiden avatar Sep 18 '25 18:09 lordraiden