SafeLine icon indicating copy to clipboard operation
SafeLine copied to clipboard

[Bug] Log errors with detect failed to connect on 8001

Open lordraiden opened this issue 4 months ago โ€ข 21 comments
trafficstars

What happened?

I get this errors in the log after running safeline

This configuration was working before

container-logs-2025-07-15T17-35-41.zip

safeline-detector  | '/detector/snserver.yml' -> '/detector/detector.yml'
safeline-detector  | '/detector/libfusion2.so' -> '/detector/config/libfusion2.so'
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - init started, version info: [rskynet version data] commit_id: 059adc2cf2e2cae2f8e3ed6d7d4b40c4bc2e86f8; branch: v1.3.0-ce; tag: v1.3.0-ce; build_time: 2025-07-08T03:58:38.109198557+00:00; rustc_version: rustc 1.85.1 (4eb161250 2025-03-15); build_type: release; engine_type: legacy_skynet; hyperscan_version: 5.2.0 2022-02-15; matrix_version: 1.1.3-ce; arch: x86_64; [end]
safeline-detector  | [2025-07-15T17:27:38.430Z DEBUG rskynet::config::config] - no config file specified (/tmp/.rskynet.yml does not exist), use default config
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - global log level: DEBUG
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::check] - hyperscan version is 5.2.0 2022-02-15, mode: AVX2
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - panic hook is enabled
safeline-detector  | [2025-07-15T17:27:38.430Z INFO rskynet::init::init] - init done
safeline-detector  | 2025-07-15T17:27:38.642828Z  WARN snserver_engine::report: management server address is empty, skipping report
safeline-detector  | 2025-07-15T17:27:39.044672Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:39.444762Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:39.681212Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:39.845108Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025-07-15T17:27:40.244465Z  WARN snserver_engine::web_log: failed to send web log: client error (Connect)
safeline-detector  | 2025/07/15 19:27:48 ERROR wait command failed, wait to retry err="signal: killed"
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - init started, version info: [rskynet version data] commit_id: 059adc2cf2e2cae2f8e3ed6d7d4b40c4bc2e86f8; branch: v1.3.0-ce; tag: v1.3.0-ce; build_time: 2025-07-08T03:58:38.109198557+00:00; rustc_version: rustc 1.85.1 (4eb161250 2025-03-15); build_type: release; engine_type: legacy_skynet; hyperscan_version: 5.2.0 2022-02-15; matrix_version: 1.1.3-ce; arch: x86_64; [end]
safeline-detector  | [2025-07-15T17:27:49.822Z DEBUG rskynet::config::config] - no config file specified (/tmp/.rskynet.yml does not exist), use default config
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - global log level: DEBUG
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::check] - hyperscan version is 5.2.0 2022-02-15, mode: AVX2
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - panic hook is enabled
safeline-detector  | [2025-07-15T17:27:49.822Z INFO rskynet::init::init] - init done
safeline-detector  | 2025-07-15T17:27:49.831438Z  WARN snserver_engine::report: management server address is empty, skipping report
safeline-chaos     | 2025/07/15 17:27:38 Config file generated successfully
safeline-chaos     | 2025-07-15 17:27:38,274 CRIT Supervisor is running as root.  Privileges were not dropped because no user is specified in the config file.  If you intend to run as root, you can set user=root in the config file to avoid this message.
safeline-chaos     | 2025-07-15 17:27:38,278 INFO supervisord started with pid 1
safeline-chaos     | 2025-07-15 17:27:39,281 INFO spawned: 'auth' with pid 15
safeline-chaos     | 2025-07-15 17:27:39,283 INFO spawned: 'challenge-server' with pid 16
safeline-chaos     | 2025-07-15 17:27:39,286 INFO spawned: 'chaos' with pid 19
safeline-chaos     | 2025-07-15 17:27:39,288 INFO spawned: 'waiting' with pid 22
safeline-chaos     | 
safeline-chaos     | --- Configuration ---
safeline-chaos     | Debug: false
safeline-chaos     | Server: 0.0.0.0:8080
safeline-tengine   | sed: can't read /etc/nginx//sites-enabled/IF_backend_*: No such file or directory
safeline-tengine   | current region oversea
safeline-luigi     | 2025/07/15 19:27:40 [INFO] cmd/main.go:93 ๐ŸŒ Server ready at :80
safeline-tengine   | 2025/07/15 19:27:38 [INFO] config/config.go:17 nginx conf path: /etc/nginx/sites-enabled
safeline-chaos     | 
safeline-chaos     | Robot:
safeline-pg        | 
safeline-chaos     |   Threshold: 1.000000
safeline-pg        | PostgreSQL Database directory appears to contain a database; Skipping initialization
safeline-tengine   | [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
safeline-tengine   |  - using env:      export GIN_MODE=release
safeline-tengine   |  - using code:     gin.SetMode(gin.ReleaseMode)
safeline-tengine   | 
safeline-tengine   | [GIN-debug] GET    /health                   --> main.main.func2.1 (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/forbidden_page --> tcd/client.ReturnForbiddenResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/acl_page       --> tcd/client.ReturnAclResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/not_found_page --> tcd/client.ReturnNotFoundResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/offline_page   --> tcd/client.ReturnOfflineResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/bad_gateway_page --> tcd/client.ReturnBadGatewayResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/gateway_timeout_page --> tcd/client.ReturnGatewayTimeoutPages (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/not_found_path_page --> tcd/client.ReturnNotFoundPathResponse (1 handlers)
safeline-tengine   | [GIN-debug] GET    /.safeline/waiting_room_page --> tcd/client.ReturnWaitRoomResponse (1 handlers)
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Starting fvm manager with config /app/config.yml" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="๐ŸŒ http server started on port 80"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\t*runner.Runner <= git.in.chaitin.net/dev/go/module.v2/runner.NewRunner()" logger=manager
safeline-chaos     |   Debug: false
safeline-chaos     |   Calculators:
safeline-chaos     |     sampling: 1
safeline-chaos     |     smoothness: 1
safeline-chaos     |     range: 1
safeline-tengine   | [GIN-debug] Listening and serving HTTP on listener what's bind with address@/app/sock/tcd_error.sock
safeline-tengine   | [GIN-debug] [WARNING] You trusted all proxies, this is NOT safe. We recommend you to set a value.
safeline-tengine   | Please check https://github.com/gin-gonic/gin/blob/master/docs/doc.md#dont-trust-all-proxies for details.
safeline-tengine   | [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
safeline-tengine   |  - using env:      export GIN_MODE=release
safeline-tengine   |  - using code:     gin.SetMode(gin.ReleaseMode)
safeline-tengine   | 
safeline-tengine   | [GIN-debug] POST   /task                     --> tcd/client.PostTask (1 handlers)
safeline-pg        | 
safeline-pg        | 2025-07-15 19:27:38.197 CEST [1] LOG:  starting PostgreSQL 15.2 (Debian 15.2-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
safeline-pg        | 2025-07-15 19:27:38.197 CEST [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
safeline-pg        | 2025-07-15 19:27:38.197 CEST [1] LOG:  listening on IPv6 address "::", port 5432
safeline-pg        | 2025-07-15 19:27:38.209 CEST [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
safeline-pg        | 2025-07-15 19:27:38.229 CEST [29] LOG:  database system was shut down at 2025-07-15 19:27:13 CEST
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*config.ManagerConfig" logger=manager
safeline-tengine   | [GIN-debug] POST   /task/secret              --> tcd/client.PostTaskSecret (1 handlers)
safeline-tengine   | [GIN-debug] Listening and serving HTTP on unix://app/sock/tcd.sock
safeline-tengine   | [GIN-debug] [WARNING] You trusted all proxies, this is NOT safe. We recommend you to set a value.
safeline-tengine   | Please check https://github.com/gin-gonic/gin/blob/master/docs/doc.md#dont-trust-all-proxies for details.
safeline-pg        | 2025-07-15 19:27:38.252 CEST [1] LOG:  database system is ready to accept connections
safeline-chaos     |     acceleration: 1
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*gorm.DB" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\t*fvm.FVM <= git.in.chaitin.net/patronus/fvm/manager/module/fvm.New()" logger=manager
safeline-chaos     |     dpi: 1
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\trpc.RPCListener <= git.in.chaitin.net/patronus/fvm/manager/module/rpc.NewRPCListener()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*grpc.Server" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\t*manager.FVMServer <= git.in.chaitin.net/patronus/fvm/manager/module/rpc/fvm.NewServer()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] SUPPLY\t*log.Logger" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\tfx.Lifecycle <= go.uber.org/fx.New.func1()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\tfx.Shutdowner <= go.uber.org/fx.(*App).shutdowner-fm()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] PROVIDE\tfx.DotGraph <= go.uber.org/fx.(*App).dotGraph-fm()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/dev/go/module.v2/runner.init.func1()" logger=manager
safeline-pg        | 2025-07-15 19:32:38.318 CEST [27] LOG:  checkpoint starting: time
safeline-pg        | 2025-07-15 19:32:46.184 CEST [27] LOG:  checkpoint complete: wrote 81 buffers (0.5%); 1 WAL file(s) added, 0 removed, 0 recycled; write=7.817 s, sync=0.034 s, total=7.867 s; sync files=57, longest=0.010 s, average=0.001 s; distance=350 kB, estimate=350 kB
safeline-chaos     | 
safeline-chaos     | JWT:
safeline-chaos     |   SecretKey: ********
safeline-chaos     |   PublicKey: -----BEGIN PUBLIC KEY-----
safeline-chaos     | MFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEmZJDZ9GoG6g2h7OoJofWAsfouEGD
safeline-chaos     | qpraZvpsRj8zlL8F8Gbdb9/13gpZUWmdFQ2dAx7R0wX/BjPV3BXjgmiY/g==
safeline-chaos     | -----END PUBLIC KEY-----
safeline-chaos     |   Algorithm: ES256
safeline-chaos     |   ExpireSeconds: 30
safeline-chaos     | ---------------------
safeline-chaos     | โ‡จ http server started on [::]:8080
safeline-chaos     | current runtime dir: /app/chaos
safeline-chaos     | current config: Config {
safeline-chaos     |     log: Log {
safeline-chaos     |         writer: Console {
safeline-chaos     |             stdout: false,
safeline-chaos     |         },
safeline-chaos     |         level: Info,
safeline-chaos     |     },
safeline-chaos     |     core: CoreConfig {
safeline-chaos     |         heavy_worker: 10,
safeline-chaos     |         max_cache_size: 3000,
safeline-chaos     |         item_count: 10,
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/patronus/fvm/manager/module/manager.Run()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Auto migrating DB"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Loading update from DB"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Loading complete"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/patronus/fvm/manager/module/rpc/fvm.Register()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] INVOKE\t\tgit.in.chaitin.net/patronus/fvm/manager/module/rpc.Run()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] START\t\tgit.in.chaitin.net/dev/go/module.v2/runner.NewRunner()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Module] START\tgit.in.chaitin.net/patronus/fvm/manager/module/rpc.Run()" logger=manager
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="Starting rpc server"
safeline-fvm       | time="2025-07-15T19:27:38+02:00" level=info msg="[Fx] RUNNING" logger=manager
safeline-fvm       | time="2025-07-15T19:27:44+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:27:44+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: using the "epoll" event method
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: nginx/1.28.0
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: built by gcc 14.2.0 (Alpine 14.2.0) 
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: OS: Linux 6.12.24-Unraid
safeline-mgt       | 2025/07/15 19:27:38 [notice] 7#7: getrlimit(RLIMIT_NOFILE): 40960:40960
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker processes
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 10
safeline-fvm       | time="2025-07-15T19:27:45+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:27:46+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:27:46+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:25+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:28+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 11
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 12
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 13
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 14
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 15
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 16
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 17
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 18
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 19
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 20
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 21
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 22
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 23
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 24
safeline-mgt       | 2025/07/15 19:27:38 [notice] 8#8: start worker process 25
safeline-mgt       | 2025/07/15 19:27:38 [error] 10#10: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://[::1]:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 10#10: *1 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://[::1]:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [error] 10#10: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 10#10: *1 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.6, server: , request: "GET /inner/detector HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/detector", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:38 [error] 11#11: *4 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 11#11: *4 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-chaos     |         item_ttl: 3600,
safeline-chaos     |     },
safeline-chaos     |     http: HttpConfig {
safeline-chaos     |         listen: "0.0.0.0:9000",
safeline-chaos     |         process_timeout: 300ms,
safeline-chaos     |     },
safeline-chaos     |     stpp: StppConfig {
safeline-chaos     |         listen: "unix:///app/chaos/stpp.sock",
safeline-chaos     |         max_package_limit: 10485760,
safeline-chaos     |         process_timeout: 1.5s,
safeline-chaos     |     },
safeline-chaos     | }
safeline-chaos     | listen and serve on unix:///app/sock/waiting.sock
safeline-chaos     | start tcp server on unix:///app/sock/waiting_tcp.sock
safeline-chaos     | 2025-07-15T17:27:40.048687Z  INFO chaos_serve::route: listening on 0.0.0.0:9000
safeline-chaos     | 2025-07-15T17:27:40.048815Z  INFO chaos_serve::stpp: listening on "/app/chaos/stpp.sock" (pathname)
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: auth entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: challenge-server entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-mgt       | 2025/07/15 19:27:38 [error] 11#11: *4 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:38 [warn] 11#11: *4 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:39 [error] 13#13: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:39 [warn] 13#13: *7 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:39 [error] 13#13: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:39 [warn] 13#13: *7 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:41 [error] 14#14: *10 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:41 [warn] 14#14: *10 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://[::1]:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:41 [error] 14#14: *10 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:41 [warn] 14#14: *10 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.7, server: , request: "GET /inner/slave_mode HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/slave_mode", host: "10.10.31.4"
safeline-mgt       | 2025/07/15 19:27:44 [error] 12#12: *13 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [warn] 12#12: *13 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://[::1]:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [error] 12#12: *13 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [warn] 12#12: *13 upstream server temporarily disabled while connecting to upstream, client: 10.10.31.9, server: , request: "POST /inner/waiting/collect HTTP/1.1", upstream: "http://127.0.0.1:8000/inner/waiting/collect", host: "safeline-mgt"
safeline-mgt       | 2025/07/15 19:27:44 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:44 [ERROR] fvm fvm/generator.go:118 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:44 [ERROR] server/serve.go:105 genrate fsl failed: rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:27:44 ๐Ÿš€ MGT server ready
safeline-mgt       | 2025/07/15 19:27:44 [INFO] server/serve.go:175 Bridge server ready at: unix /app/run/safeline.sock
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm cron/threat_info.go:147 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] cron cron/threat_info.go:427 rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] cron cron/cron.go:70 rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:45 [ERROR] fvm cron/threat_info.go:409 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:27:46 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:46 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:27:46 [ERROR] cron cron/cron.go:71 update crawler info failed: rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:28:45 [ERROR] api.auth [email protected]/context.go:185 decrypt password failed: invalid padding
safeline-mgt       | 2025/07/15 19:29:58 [ERROR] cfg runtime/asm_amd64.s:1700 Post "https://rivers-telemetry.chaitin.cn:10086/telemetry": dial tcp 121.43.103.178:10086: connect: connection timed out
safeline-mgt       | 2025/07/15 19:29:59 [ERROR] user [email protected]/context.go:185 user password updated
safeline-mgt       | 2025/07/15 19:29:59 [ERROR] middleware [email protected]/context.go:185 check jwt failed: jwt version not match, expect 1, got 0
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:25 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: chaos entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-chaos     | 2025-07-15 17:27:41,049 INFO success: waiting entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
safeline-chaos     | {"time":"2025-07-15T17:27:44.292929472Z","id":"","remote_ip":"10.10.31.4","host":"safeline-chaos:8080","method":"GET","uri":"/challenge/v2/api/auth/keys","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":7270,"latency_human":"7.27ยตs","bytes_in":0,"bytes_out":177}
safeline-fvm       | time="2025-07-15T19:31:31+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:32+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:35+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:37+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:38+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:31:39+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:28+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:42+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:28 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:31 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:32 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:35 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:37 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:38 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:31:39 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:28 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:42 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:32:45 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm cron/threat_info.go:147 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] cron api/intelligence.go:101 rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] api [email protected]/context.go:185 rules compile error, please check your params
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:32:45+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm cron/threat_info.go:409 ip group diff compile and push failed: rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] fvm fvm/ipgroup.go:30 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:48 [ERROR] cron api/ipgroup.go:554 update crawler info failed: rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:34:59 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = update failed: update framework failed
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] fvm fvm/skynet.go:28 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:00 [ERROR] response/response.go:19 update global semantics failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-mgt       | 2025/07/15 19:35:23 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] fvm fvm/grpc_helper.go:76 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] fvm fvm/grpc_helper.go:80 FVM AppendFSL Close Error rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] fvm fvm/challenge.go:34 compile and push fsl error: rpc error: code = Unknown desc = compiling failed: compiling FSL failed
safeline-mgt       | 2025/07/15 19:36:06 [ERROR] api.policy [email protected]/context.go:185 switch policy failed rules compile error, please check your params
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table ip_group does not exist
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:34:48+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:34:59+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_update(): table website_detect does not exist
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=error msg="AppendFSL: update failed: update framework failed"
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:35:00+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:35:23+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=info msg="Force the first update to be NOT incremental"
safeline-fvm       | fvm_compile(): Function fusion_api_algorithm.aes128_decrypt_b64 couldn't be found in table
safeline-fvm       | time="2025-07-15T19:36:06+02:00" level=error msg="AppendFSL: compiling failed: compiling FSL failed"

How we reproduce?

Compose file

###############################################################
# Safeline CE
###############################################################

# Common settings #############################################

x-default: &config
  restart: unless-stopped
# cpuset: 10,22,11,23,8,20,9,21
  cpus: 12.0
  security_opt:
    - no-new-privileges:true
x-dns: &dns
  dns: 
    - ${dnsDMZ}
x-labels: &labels
  com.centurylinklabs.watchtower.enable: "true"
  net.unraid.docker.managed: "composeman"
  net.unraid.docker.shell: "sh"

## https://waf.chaitin.com/release/latest/compose.yaml   docker exec safeline-mgt resetadmin #  CExLoyB7

# Services ####################################################

services:

  mgt:
    container_name: ${safeline_mgt_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-mgt${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG:?image tag required}
    <<: [*config, *dns]
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ${SAFELINE_DIR}/resources/mgt:/app/data
      - ${SAFELINE_DIR}/logs/nginx:/app/log/nginx:z
      - ${SAFELINE_DIR}/resources/sock:/app/sock
      - /var/run:/app/run
    ports:
      - ${MGT_PORT:-9443}:1443
    healthcheck:
      test: curl -k -f https://localhost:1443/api/open/health
    environment:
      - MGT_PG=postgres://safeline-ce:${POSTGRES_PASSWORD}@${safeline_postgres_name}/safeline-ce?sslmode=disable
    depends_on:
      - postgres
      - fvm
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "5"
    networks:
      eth4.31:
        ipv4_address: ${mgt_ip} #4 mgt
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
      net.unraid.docker.webui: "https://${safeline_mgt_name}.${mydomain}/dashboard/#/"
      traefik.enable: true
      traefik.docker.network: eth4.31
      traefik.http.routers.mgt.entrypoints: https443
      traefik.http.routers.mgt.service: mgt
      traefik.http.routers.mgt.rule: "Host(`${safeline_mgt_name}.${mydomain}`)"
      traefik.http.routers.mgt.tls: true
      traefik.http.routers.mgt.middlewares: local-ipwhitelist@file, rate-limit@file, securityHeaders@file
      traefik.http.services.mgt.loadbalancer.server.port: 1443
      homepage.group: Proxy
      homepage.name: ${safeline_mgt_name}
      homepage.icon: safeline.png # https://github.com/walkxcode/dashboard-icons/tree/main/png https://gethomepage.dev/configs/services/#icons
      homepage.href: https://${safeline_mgt_name}.${mydomain}
      homepage.weight: 4
      homepage.showStats: false
  
  detect:
    container_name: ${safeline_detect_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-detector${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    volumes:
      - ${SAFELINE_DIR}/resources/detector:/resources/detector
      - ${SAFELINE_DIR}/logs/detector:/logs/detector
      - /etc/localtime:/etc/localtime:ro
    environment:
      - LOG_DIR=/logs/detector
    ports:
      - 8000:8000
    networks:
      eth4.31:
        ipv4_address: ${detect_ip} #5 detect
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
  
  tengine: #host
    container_name: ${safeline_tengine_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-tengine${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /etc/resolv.conf:/etc/resolv.conf:ro
      - ${SAFELINE_DIR}/resources/nginx:/etc/nginx
      - ${SAFELINE_DIR}/resources/detector:/resources/detector
      - ${SAFELINE_DIR}/resources/chaos:/resources/chaos
      - ${SAFELINE_DIR}/logs/nginx:/var/log/nginx:z
      - ${SAFELINE_DIR}/resources/cache:/usr/local/nginx/cache
      - ${SAFELINE_DIR}/resources/sock:/app/sock
    environment:
      - TCD_MGT_API=https://${mgt_ip}:1443/api/open/publish/server #mgt 4
      - TCD_SNSERVER=${detect_ip}:8000 #detect 5
      # deprecated
      - SNSERVER_ADDR=${detect_ip}:8000 #detect 5
      - CHAOS_ADDR=${chaos_ip} #chaos 10
    ulimits:
      nofile: 131072
    #network_mode: host  ##!!!!!!
    networks:
      eth4.31:
        ipv4_address: ${tengine_ip} # tengine
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
  
  luigi: #7
    container_name: ${safeline_luigi_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-luigi${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    environment:
      - MGT_IP=${mgt_ip} #mgt 4
      - LUIGI_PG=postgres://safeline-ce:${POSTGRES_PASSWORD}@${safeline_postgres_name}/safeline-ce?sslmode=disable
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ${SAFELINE_DIR}/resources/luigi:/app/data
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "5"
    depends_on:
      - detect
      - mgt
    networks:
      eth4.31:
        ipv4_address: ${luigi_ip} #7 luigi
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"
  
  fvm:
    container_name: ${safeline_fvm_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-fvm${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    volumes:
      - /etc/localtime:/etc/localtime:ro
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "5"
    networks:
      eth4.31:
        ipv4_address: ${fvm_ip} #8 fvm
  
  chaos:
    container_name: ${safeline_chaos_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-chaos${REGION}${ARCH_SUFFIX}${RELEASE}:${IMAGE_TAG}
    <<: [*config, *dns]
    logging:
      driver: "json-file"
      options:
        max-size: "100m"
        max-file: "10"
    environment:
      - DB_ADDR=postgres://safeline-ce:${POSTGRES_PASSWORD}@${safeline_postgres_name}/safeline-ce?sslmode=disable
    volumes:
      - ${SAFELINE_DIR}/resources/sock:/app/sock
      - ${SAFELINE_DIR}/resources/chaos:/app/chaos
    networks:
      eth4.31:
        ipv4_address: ${chaos_ip} #10 chaos
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/safeline.png"

  postgres:
    container_name: ${safeline_postgres_name}
    restart: always
    image: ${IMAGE_PREFIX}/safeline-postgres${ARCH_SUFFIX}:15.2
    <<: [*config, *dns]
    volumes:
      - ${SAFELINE_DIR}/resources/postgres/data:/var/lib/postgresql/data
      - /etc/localtime:/etc/localtime:ro
    environment:
      - POSTGRES_USER=safeline-ce
      - POSTGRES_PASSWORD=${POSTGRES_PASSWORD:?postgres password required}
    networks:
      eth4.31:
        ipv4_address: ${postgres_ip} #2 postgres
    command: [postgres, -c, max_connections=600]
    healthcheck:
      test: pg_isready -U safeline-ce -d safeline-ce
    labels:
      <<: *labels
      net.unraid.docker.icon: "https://raw.githubusercontent.com/homarr-labs/dashboard-icons/92e341c1c681d3fcdbdebcf14fad670dba5e52d6/png/postgres.png"

# Networks ####################################################

networks:
  eth4.31:
    name: eth4.31
    external: true
  net-safeline:
    internal: true

Env file


###############################################################
# Safeline
###############################################################

# General
TZ=Europe/Madrid
PUID=99
PGID=100
dockerdir=/mnt/services/docker/WebProxyDMZ
dnsDMZ=10.10.30.2
mydomain=asdasdasd.com.es

# Safeline

SAFELINE_DIR=/mnt/services/docker/WebProxyDMZ/Safeline
IMAGE_TAG=latest
MGT_PORT=9443
POSTGRES_PASSWORD=asdasdasd
SUBNET_PREFIX=10.10.31
IMAGE_PREFIX=chaitin
ARCH_SUFFIX=
RELEASE=
REGION=-g

# Container names
safeline_mgt_name=safeline-mgt
safeline_detect_name=safeline-detector
safeline_tengine_name=safeline-tengine
safeline_luigi_name=safeline-luigi
safeline_fvm_name=safeline-fvm
safeline_chaos_name=safeline-chaos
safeline_postgres_name=safeline-pg

# IP	
mgt_ip=10.10.31.4
postgres_ip=10.10.31.5
detect_ip=10.10.31.6 # Esta IP se configura en el plugin de Traefik con puerto 8000
luigi_ip=10.10.31.7
fvm_ip=10.10.31.8
chaos_ip=10.10.31.9
tengine_ip=10.10.31.10

Traeffik fileconfi.yml

  ## MIDDLEWARES ##
  middlewares:

    safeline:
      plugin:
        safeline:
          addr: 10.10.31.6:8000

Expected behavior

No response

Error log

No response

lordraiden avatar Jul 15 '25 17:07 lordraiden