harbor icon indicating copy to clipboard operation
harbor copied to clipboard

Published 20 hours ago • verified publisher icon goharbor

as system admin, cannot edit schedule or run retention policy on web GUI

Open asule90 opened this issue 1 year ago • 5 comments

Expected behavior and actual behavior: expected: updated schedule or run retention policy actual: got error unauthorized, and redirected got internal server error when run retention

Steps to reproduce the problem: login as system admin select project, go to policy tab

edit schedule and save got error unauthorized and redirected to project list

click "DRY RUN" or "RUN", got error internal server error

{
    "errors": [
        {
            "code": "UNKNOWN",
            "message": "internal server error"
        }
    ]
}

Versions: Please specify the versions of following systems.

  • harbor version: 2.9.1
  • docker engine version: 24.0.6
  • docker-compose version: 2.21.0

Additional context:

  • Harbor config files: You can get them by packaging harbor.yml and files in the same directory, including subdirectory.
  • Log files: You can get them by package the /var/log/harbor/ .
jobservice log 

  Dec 15 04:00:00 abndev jobservice[1295]: 2023-12-14T21:00:00Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 04:00:00 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702587600, status=Running, revision=1702587514, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=1.884549749s
  Dec 15 04:00:02 abndev jobservice[1295]: 2023-12-14T21:00:02Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702587600, status=Running, revision=1702587514, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 04:18:45 abndev jobservice[1295]: 2023-12-14T21:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 04:18:45 abndev jobservice[1295]: 2023-12-14T21:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 05:00:00 abndev jobservice[1295]: 2023-12-14T22:00:00Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702591200,"args":null}
  Dec 15 05:00:00 abndev jobservice[1295]: 2023-12-14T22:00:00Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702591200
  Dec 15 05:00:00 abndev jobservice[1295]: 2023-12-14T22:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 05:00:00 abndev jobservice[1295]: 2023-12-14T22:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 05:00:00 abndev jobservice[1295]: 2023-12-14T22:00:00Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 05:00:00 abndev jobservice[1295]: 2023-12-14T22:00:00Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 05:00:00 abndev jobservice[1295]: 2023-12-14T22:00:00Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 05:00:00 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702591200, status=Running, revision=1702591138, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=1.515113302s
  Dec 15 05:00:02 abndev jobservice[1295]: 2023-12-14T22:00:02Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702591200, status=Running, revision=1702591138, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 05:18:45 abndev jobservice[1295]: 2023-12-14T22:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 05:18:45 abndev jobservice[1295]: 2023-12-14T22:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 06:00:00 abndev jobservice[1295]: 2023-12-14T23:00:00Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702594800,"args":null}
  Dec 15 06:00:00 abndev jobservice[1295]: 2023-12-14T23:00:00Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702594800
  Dec 15 06:00:00 abndev jobservice[1295]: 2023-12-14T23:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 06:00:00 abndev jobservice[1295]: 2023-12-14T23:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 06:00:00 abndev jobservice[1295]: 2023-12-14T23:00:00Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 06:00:00 abndev jobservice[1295]: 2023-12-14T23:00:00Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 06:00:00 abndev jobservice[1295]: 2023-12-14T23:00:00Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 06:00:00 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702594800, status=Running, revision=1702594765, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=2.95609265s
  Dec 15 06:00:03 abndev jobservice[1295]: 2023-12-14T23:00:03Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702594800, status=Running, revision=1702594765, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 06:18:45 abndev jobservice[1295]: 2023-12-14T23:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 06:18:45 abndev jobservice[1295]: 2023-12-14T23:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"4ce3195b18f1b23996fe3c00","t":1702598400,"args":null}
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 4ce3195b18f1b23996fe3c00@1702598400
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:4ce3195b18f1b23996fe3c00' exit with success
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702598400,"args":null}
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702598400
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 07:00:00 abndev jobservice[1295]: 2023-12-15T00:00:00Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 07:00:00 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702598400, status=Running, revision=1702598381, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=2.050816091s
  Dec 15 07:00:02 abndev jobservice[1295]: 2023-12-15T00:00:02Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702598400, status=Running, revision=1702598381, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 07:18:45 abndev jobservice[1295]: 2023-12-15T00:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 07:18:45 abndev jobservice[1295]: 2023-12-15T00:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 08:00:01 abndev jobservice[1295]: 2023-12-15T01:00:01Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702602000,"args":null}
  Dec 15 08:00:01 abndev jobservice[1295]: 2023-12-15T01:00:01Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702602000
  Dec 15 08:00:01 abndev jobservice[1295]: 2023-12-15T01:00:01Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 08:00:01 abndev jobservice[1295]: 2023-12-15T01:00:01Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 08:00:01 abndev jobservice[1295]: 2023-12-15T01:00:01Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 08:00:01 abndev jobservice[1295]: 2023-12-15T01:00:01Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 08:00:01 abndev jobservice[1295]: 2023-12-15T01:00:01Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 08:00:01 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702602000, status=Running, revision=1702601889, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=2.522383925s
  Dec 15 08:00:03 abndev jobservice[1295]: 2023-12-15T01:00:03Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702602000, status=Running, revision=1702601889, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 08:18:45 abndev jobservice[1295]: 2023-12-15T01:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 08:18:45 abndev jobservice[1295]: 2023-12-15T01:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 09:00:01 abndev jobservice[1295]: 2023-12-15T02:00:01Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702605600,"args":null}
  Dec 15 09:00:01 abndev jobservice[1295]: 2023-12-15T02:00:01Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702605600
  Dec 15 09:00:01 abndev jobservice[1295]: 2023-12-15T02:00:01Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 09:00:01 abndev jobservice[1295]: 2023-12-15T02:00:01Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 09:00:01 abndev jobservice[1295]: 2023-12-15T02:00:01Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 09:00:01 abndev jobservice[1295]: 2023-12-15T02:00:01Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 09:00:01 abndev jobservice[1295]: 2023-12-15T02:00:01Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 09:00:01 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702605600, status=Running, revision=1702605517, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=2.110042782s
  Dec 15 09:00:03 abndev jobservice[1295]: 2023-12-15T02:00:03Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702605600, status=Running, revision=1702605517, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 09:13:45 abndev jobservice[1295]: 2023-12-15T02:13:45Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 09:13:45 abndev jobservice[1295]: 2023-12-15T02:13:45Z [INFO] [/jobservice/logger/sweeper_controller.go:121]: 25 outdated log entries are sweepped by sweeper *sweeper.FileSweeper
  Dec 15 09:18:45 abndev jobservice[1295]: 2023-12-15T02:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 09:18:45 abndev jobservice[1295]: 2023-12-15T02:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 10:00:00 abndev jobservice[1295]: 2023-12-15T03:00:00Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702609200,"args":null}
  Dec 15 10:00:00 abndev jobservice[1295]: 2023-12-15T03:00:00Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702609200
  Dec 15 10:00:00 abndev jobservice[1295]: 2023-12-15T03:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 10:00:00 abndev jobservice[1295]: 2023-12-15T03:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 10:00:00 abndev jobservice[1295]: 2023-12-15T03:00:00Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 10:00:00 abndev jobservice[1295]: 2023-12-15T03:00:00Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 10:00:00 abndev jobservice[1295]: 2023-12-15T03:00:00Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 10:00:00 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702609200, status=Running, revision=1702609149, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=1.43920818s
  Dec 15 10:00:02 abndev jobservice[1295]: 2023-12-15T03:00:02Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702609200, status=Running, revision=1702609149, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 10:18:45 abndev jobservice[1295]: 2023-12-15T03:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 10:18:45 abndev jobservice[1295]: 2023-12-15T03:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 11:00:01 abndev jobservice[1295]: 2023-12-15T04:00:01Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702612800,"args":null}
  Dec 15 11:00:01 abndev jobservice[1295]: 2023-12-15T04:00:01Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702612800
  Dec 15 11:00:01 abndev jobservice[1295]: 2023-12-15T04:00:01Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 11:00:01 abndev jobservice[1295]: 2023-12-15T04:00:01Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 11:00:01 abndev jobservice[1295]: 2023-12-15T04:00:01Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 11:00:01 abndev jobservice[1295]: 2023-12-15T04:00:01Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 11:00:01 abndev jobservice[1295]: 2023-12-15T04:00:01Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 11:00:01 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702612800, status=Running, revision=1702612780, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=1.594491021s
  Dec 15 11:00:02 abndev jobservice[1295]: 2023-12-15T04:00:02Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702612800, status=Running, revision=1702612780, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 11:18:45 abndev jobservice[1295]: 2023-12-15T04:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 11:18:45 abndev jobservice[1295]: 2023-12-15T04:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
  Dec 15 12:00:00 abndev jobservice[1295]: 2023-12-15T05:00:00Z [INFO] [/jobservice/worker/cworker/c_worker.go:77]: Job incoming: {"name":"SCHEDULER","id":"9af458772b2ed997e8576215","t":1702616400,"args":null}
  Dec 15 12:00:00 abndev jobservice[1295]: 2023-12-15T05:00:00Z [INFO] [/jobservice/runner/redis.go:78]: Start to run periodical job execution: 9af458772b2ed997e8576215@1702616400
  Dec 15 12:00:00 abndev jobservice[1295]: 2023-12-15T05:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 12:00:00 abndev jobservice[1295]: 2023-12-15T05:00:00Z [INFO] [/pkg/config/rest/rest.go:47]: get configuration from url: http://core:8080/api/v2.0/internalconfig
  Dec 15 12:00:00 abndev jobservice[1295]: 2023-12-15T05:00:00Z [ERROR] [/jobservice/runtime/bootstrap.go:166]: trigger hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 12:00:00 abndev jobservice[1295]: 2023-12-15T05:00:00Z [INFO] [/jobservice/runner/redis.go:152]: Job 'SCHEDULER:9af458772b2ed997e8576215' exit with success
  Dec 15 12:00:00 abndev jobservice[1295]: 2023-12-15T05:00:00Z [ERROR] [/jobservice/hook/hook_agent.go:155]: Retry: sending hook event error: {"errors":[{"code":"UNAUTHORIZED","message":"Unauthorized\n"}]}
  Dec 15 12:00:00 abndev jobservice[1295]: , evt=status change: job=9af458772b2ed997e8576215@1702616400, status=Running, revision=1702616397, check_in=checkin->http://core:8080/service/notifications/tasks/2, duration=1.042293325s
  Dec 15 12:00:01 abndev jobservice[1295]: 2023-12-15T05:00:01Z [INFO] [/jobservice/hook/hook_agent.go:148]: Hook event is abandoned as it's outdated: status change: job=9af458772b2ed997e8576215@1702616400, status=Running, revision=1702616397, check_in=checkin->http://core:8080/service/notifications/tasks/2
  Dec 15 12:18:45 abndev jobservice[1295]: 2023-12-15T05:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:134]: Start: reap outdated job stats
  Dec 15 12:18:45 abndev jobservice[1295]: 2023-12-15T05:18:45Z [INFO] [/jobservice/worker/cworker/reaper.go:223]: End: reap outdated job stats
retention api 

{
    "algorithm": "or",
    "id": 1,
    "rules": [
        {
            "action": "retain",
            "params": {
                "latestPushedK": 3
            },
            "scope_selectors": {
                "repository": [
                    {
                        "decoration": "repoMatches",
                        "kind": "doublestar",
                        "pattern": "**"
                    }
                ]
            },
            "tag_selectors": [
                {
                    "decoration": "matches",
                    "extras": "{\"untagged\":true}",
                    "kind": "doublestar",
                    "pattern": "**"
                }
            ],
            "template": "latestPushedK"
        }
    ],
    "scope": {
        "level": "project",
        "ref": 2
    },
    "trigger": {
        "kind": "Schedule",
        "settings": {
            "cron": "0 0 0 * * 0"
        }
    }
}
response 

{
    "errors": [
        {
            "code": "UNAUTHORIZED",
            "message": "Unauthorized\n"
        }
    ]
}
GUI Event log ![Screenshot from 2023-12-15 12-33-35](https://github.com/goharbor/harbor/assets/10544636/1bda74fc-7d72-44a8-8fd4-718c1eed535a)

asule90 avatar Dec 15 '23 05:12 asule90

Could you please upload the core.log when the issue occur?

stonezdj avatar Dec 19 '23 07:12 stonezdj

oh here is the core.log

core.log 
Dec 19 15:09:42 abndev core[1295]: 2023-12-19T08:09:42Z [INFO] [/common/job/client.go:249]: failed to get job service config from jobservice:8080/api/v1/config, job service container version maybe mismatch
Dec 19 15:09:57 abndev core[1295]: 2023-12-19T08:09:57Z [ERROR] [/pkg/task/task.go:116]: delete task 1010 from db due to failed to submit job SCHEDULER, error: http error: code 401, message Unauthorized
Dec 19 15:09:57 abndev core[1295]: 2023-12-19T08:09:57Z [INFO] [/common/job/client.go:249]: failed to get job service config from jobservice:8080/api/v1/config, job service container version maybe mismatch
Dec 19 15:10:01 abndev core[1295]: 2023-12-19T08:10:01Z [ERROR] [/pkg/task/task.go:116]: delete task 1011 from db due to failed to submit job RETENTION, error: http error: code 401, message Unauthorized
Dec 19 15:10:01 abndev core[1295]: 2023-12-19T08:10:01Z [ERROR] [/lib/http/error.go:57]: {"errors":[{"code":"UNKNOWN","message":"launcher: http error: code 401, message Unauthorized\n"}]} 
Dec 19 15:10:01 abndev core[1295]: /harbor/src/pkg/retention/launcher.go:263, github.com/goharbor/harbor/src/pkg/retention.launcherError
Dec 19 15:10:01 abndev core[1295]: /harbor/src/pkg/retention/launcher.go:202, github.com/goharbor/harbor/src/pkg/retention.(*launcher).Launch
Dec 19 15:10:01 abndev core[1295]: /harbor/src/controller/retention/controller.go:250, github.com/goharbor/harbor/src/controller/retention.(*defaultController).TriggerRetentionExec
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/v2.0/handler/retention.go:276, github.com/goharbor/harbor/src/server/v2.0/handler.(*retentionAPI).TriggerRetentionExecution
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/v2.0/restapi/configure_harbor.go:3509, github.com/goharbor/harbor/src/server/v2.0/restapi.HandlerAPI.func189
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/v2.0/restapi/operations/retention/trigger_retention_execution.go:21, github.com/goharbor/harbor/src/server/v2.0/restapi/operations/retention.TriggerRetentionExecutionHandlerFunc.Handle
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/v2.0/restapi/operations/retention/trigger_retention_execution.go:71, github.com/goharbor/harbor/src/server/v2.0/restapi/operations/retention.(*TriggerRetentionExecution).ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/v2.0/restapi/operations/harbor_api.go:1971, github.com/goharbor/harbor/src/server/v2.0/restapi/operations.(*HarborAPI).initHandlerCache.(*HarborAPI).handler.func187
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: message repeated 4 times: [ /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP]
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/apiversion/api_version.go:29, github.com/goharbor/harbor/src/server/v2.0/route.RegisterRoutes.Middleware.func1.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/router/router.go:92, github.com/goharbor/harbor/src/server/router.(*Route).Handler.func1
Dec 19 15:10:01 abndev core[1295]: /harbor/src/vendor/github.com/beego/beego/v2/server/web/router.go:1149, github.com/beego/beego/v2/server/web.(*ControllerRegister).serveHttp
Dec 19 15:10:01 abndev core[1295]: /harbor/src/vendor/github.com/beego/beego/v2/server/web/filter.go:83, github.com/beego/beego/v2/server/web.(*FilterRouter).filter
Dec 19 15:10:01 abndev core[1295]: /harbor/src/vendor/github.com/beego/beego/v2/server/web/router.go:1002, github.com/beego/beego/v2/server/web.(*ControllerRegister).ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/readonly/readonly.go:77, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.MiddlewareWithConfig.func20
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/middleware.go:57, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.MiddlewareWithConfig.New.func22.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/security/security.go:75, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.UnauthorizedMiddleware.func10
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/middleware.go:57, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.UnauthorizedMiddleware.New.func19.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/security/security.go:62, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.func9
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/middleware.go:57, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.New.func18.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/artifactinfo/artifact_info.go:62, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.func8.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/transaction/transaction.go:60, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.func7.1
Dec 19 15:10:01 abndev core[1295]: /harbor/src/lib/orm/orm.go:157, github.com/goharbor/harbor/src/lib/orm.WithTransaction.func1
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/transaction/transaction.go:69, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.func7
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/middleware.go:57, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.New.func17.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/notification/notification.go:31, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.func6
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/middleware.go:57, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.New.func16.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/orm/orm.go:54, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.MiddlewareWithConfig.func15
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/middleware.go:57, github.com/goharbor/harbor/src/core/middlewares.MiddleWares.Middleware.MiddlewareWithConfig.New.func21.1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/csrf/csrf.go:62, github.com/goharbor/harbor/src/server/middleware/csrf.Middleware.func2.attach.func1
Dec 19 15:10:01 abndev core[1295]: /usr/local/go/src/net/http/server.go:2136, net/http.HandlerFunc.ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/vendor/github.com/gorilla/csrf/csrf.go:297, github.com/gorilla/csrf.(*csrf).ServeHTTP
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/csrf/csrf.go:82, github.com/goharbor/harbor/src/server/middleware/csrf.Middleware.func2
Dec 19 15:10:01 abndev core[1295]: /harbor/src/server/middleware/middleware.go:57, github.com/goharbor/harbor/src/server/middleware/csrf.Middleware.New.func3.1

asule90 avatar Dec 19 '23 08:12 asule90

This issue is being marked stale due to a period of inactivity. If this issue is still relevant, please comment or remove the stale label. Otherwise, this issue will close in 30 days.

github-actions[bot] avatar Feb 17 '24 09:02 github-actions[bot]

still relevant..

asule90 avatar Feb 17 '24 14:02 asule90

This issue is being marked stale due to a period of inactivity. If this issue is still relevant, please comment or remove the stale label. Otherwise, this issue will close in 30 days.

github-actions[bot] avatar Apr 18 '24 09:04 github-actions[bot]

This issue was closed because it has been stalled for 30 days with no activity. If this issue is still relevant, please re-open a new issue.

github-actions[bot] avatar May 19 '24 09:05 github-actions[bot]