boxmot
boxmot copied to clipboard
Strong-OCSort
I have implemented Strong-OCSort, which is a combination between StrongSort and OCSort.
StrongOCSort performs association in 3 steps:
For all detections with confidence above a detection threshold: 1. Associate using feature matching (StrongSort) 2. Associate using trajectory matching (OCSort)
(optional) For all detections with confidence below a detection threshold: 3. Associate using byte association
I have also implemented a resurrection system. This is my attempt to cache features of tracks that have "died". In case a detection with a similar feature shows up again in a sequence (lady with a red shirt in MOT17-05 for example), it should create a track of the same ID as the one that previously "died". This system is not solving this issue at the moment, but I left the code in together with a parameter to toggle the system on and off (default off).
Eval results (can be tuned for better results), based on detector weights crowdhuman_yolov5m.pt
HOTA: exp15-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-04-FRCNN 60.825 59.138 63.116 64.129 76.426 67.275 80.735 81.156 63.564 80.714 75.474 60.918
MOT17-05-FRCNN 39.572 38.377 40.885 40.461 77.312 50.886 65.91 82.316 40.667 50.308 78.129 39.305
MOT17-09-FRCNN 57.6 61.734 53.789 66.385 82.209 57.95 82.977 86.121 59.744 70.633 82.976 58.609
MOT17-10-FRCNN 50.489 50.549 50.58 53.689 76.855 54.478 79.142 81.023 52.106 66.309 76.676 50.843
MOT17-11-FRCNN 63.41 60.258 66.942 70.522 75.302 73.393 83.735 86.99 68.697 75.341 83.895 63.207
MOT17-13-FRCNN 46.94 42.853 51.795 46.001 74.34 56.438 77.363 80.765 48.761 60.994 75.77 46.216
COMBINED 56.889 54.669 59.764 59.472 76.522 64.677 80.779 82.155 59.525 73.537 77.147 56.731
CLEAR: exp15-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-04-FRCNN 70.095 78.644 70.263 77.086 91.868 50.602 36.145 13.253 53.632 36660 10897 3245 80 42 30 11 441
MOT17-05-FRCNN 45.829 79.61 46.697 49.516 94.613 16.541 57.895 25.564 35.733 3425 3492 195 60 22 77 34 168
MOT17-09-FRCNN 69.164 84.578 69.746 75.249 93.186 46.154 53.846 0 57.559 4007 1318 293 31 12 14 0 67
MOT17-10-FRCNN 63.066 77.822 63.595 66.726 95.518 33.333 56.14 10.526 48.267 8567 4272 402 68 19 32 6 558
MOT17-11-FRCNN 65.112 85.561 65.441 79.546 84.938 45.333 40 14.667 53.627 7506 1930 1331 31 34 30 11 104
MOT17-13-FRCNN 52.843 77.367 53.548 57.713 93.268 30.909 40.909 28.182 39.781 6719 4923 485 82 34 45 31 278
COMBINED 64.643 79.592 65.019 71.369 91.829 33.678 47.107 19.215 50.078 66884 26832 5951 352 163 228 93 1616
Identity: exp15-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-04-FRCNN 76.335 70.194 83.654 33382 14175 6523
MOT17-05-FRCNN 53.753 40.943 78.232 2832 4085 788
MOT17-09-FRCNN 70.919 64.094 79.372 3413 1912 887
MOT17-10-FRCNN 68.204 57.925 82.919 7437 5402 1532
MOT17-11-FRCNN 74.449 72.086 76.972 6802 2634 2035
MOT17-13-FRCNN 62.602 50.67 81.885 5899 5743 1305
COMBINED 71.768 63.772 82.055 59765 33951 13070
Count: exp15-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-04-FRCNN 39905 47557 140 83
MOT17-05-FRCNN 3620 6917 117 133
MOT17-09-FRCNN 4300 5325 54 26
MOT17-10-FRCNN 8969 12839 105 57
MOT17-11-FRCNN 8837 9436 153 75
MOT17-13-FRCNN 7204 11642 141 110
COMBINED 72835 93716 710 484
Previews (MOT17-05):
Without trajectories:
With trajectories :
Blue circles are feature-matched tracks Green circles are trajectory-matched tracks White circles are unmatched tracks No byte association was seen in this sequence (should probably seldom happen for a large enough detector model, will happen more often for smaller detection models).
If the resurrection system is turned on, you will see resurrected tracks as purple circles in the trajectory plot.
Impressive boost for MOTA, I bet that comes from the OCSORT KF! Not so sure why IDF1 went down so much. Need to have closer look at that.
Impressive boost for MOTA, I bet that comes from the OCSORT KF! Not so sure why IDF1 went down so much. Need to have closer look at that.
OCSort KF is actually pyfilter. I have made some other changes to the KF that might provide a boost :-)
The main differences between the KFs as I can see is that OCSort uses (x, y, s, r) state space instead, where s is area of bbox and r is aspect ratio.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
Code is updated according to latest changes to master now @mikel-brostrom
Hi henriksod, thanks for the contribution. Can you point us how to use your code and you method Strong-OCSort? Which commit do we need to use and how to use the method Strong-OCSort with track.py?
Thanks
Hi, the commit associated with this PR,
python track.py --tracking-method strong_ocsort ....
You can enable the "resurrection" system in the config file
Optimized config parameters, resurrection system was turned on by default.
yolov8n.pt:
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-02-FRCNN 29.295 23.572 36.801 24.285 81.481 38.604 85.236 85.099 29.791 34.082 81.522 27.784
MOT17-04-FRCNN 45.258 41.368 49.799 43.465 81.741 54.218 81.741 84.877 46.48 55.47 80.189 44.481
MOT17-05-FRCNN 34.602 34.933 34.78 37.781 68.735 41.009 64.793 77.62 36.143 48.919 68.684 33.6
MOT17-09-FRCNN 51.291 55.53 47.512 58.988 81.166 50.814 81.529 84.126 52.934 64.881 79.959 51.878
MOT17-10-FRCNN 40.071 39.154 41.164 41.293 75.222 45.764 75.318 80.012 41.215 53.281 74.553 39.723
MOT17-11-FRCNN 51.077 51.315 51.022 56.181 78.606 55.68 82.288 85.213 53.528 63.836 80.146 51.162
MOT17-13-FRCNN 33.812 27.276 42.239 28.299 77.048 46.368 78.363 81.499 34.509 42.631 76.956 32.807
COMBINED 41.734 37.869 46.366 39.925 79.261 50.648 80.73 83.604 42.955 51.951 78.58 40.823
CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-02-FRCNN 26.285 82.758 27.038 28.422 95.359 9.6774 30.645 59.677 21.384 5281 13300 257 140 6 19 37 215
MOT17-04-FRCNN 45.314 83.238 45.89 49.532 93.151 16.867 53.012 30.12 37.011 23556 24001 1732 274 14 44 25 627
MOT17-05-FRCNN 30.418 75.868 32.268 43.617 79.353 7.5188 60.15 32.331 19.892 3017 3900 785 128 10 80 43 159
MOT17-09-FRCNN 63.155 82.302 64.376 68.526 94.289 42.308 42.308 15.385 51.027 3649 1676 221 65 11 11 4 77
MOT17-10-FRCNN 46.141 76.923 47.231 51.063 93.019 22.807 43.86 33.333 34.357 6556 6283 492 140 13 25 19 377
MOT17-11-FRCNN 53.095 84.576 53.37 62.421 87.337 29.333 28 42.667 43.467 5890 3546 854 26 22 21 32 52
MOT17-13-FRCNN 32.64 78.371 33.482 35.106 95.58 15.455 35.455 49.091 25.047 4087 7555 189 98 17 39 54 217
COMBINED 41.528 81.67 42.304 46.338 91.992 17.033 43.773 39.194 33.034 52036 60261 4530 871 93 239 214 1724
Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-02-FRCNN 34.006 22.071 74.052 4101 14480 1437
MOT17-04-FRCNN 53.327 40.842 76.807 19423 28134 5865
MOT17-05-FRCNN 41.795 32.384 58.916 2240 4677 1562
MOT17-09-FRCNN 63.839 55.117 75.84 2935 2390 935
MOT17-10-FRCNN 51.954 40.237 73.297 5166 7673 1882
MOT17-11-FRCNN 56.786 48.686 68.12 4594 4842 2150
MOT17-13-FRCNN 42.656 29.162 79.397 3395 8247 881
COMBINED 49.572 37.271 73.991 41854 70443 14712
Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-02-FRCNN 5538 18581 109 62
MOT17-04-FRCNN 25288 47557 157 83
MOT17-05-FRCNN 3802 6917 143 133
MOT17-09-FRCNN 3870 5325 58 26
MOT17-10-FRCNN 7048 12839 112 57
MOT17-11-FRCNN 6744 9436 97 75
MOT17-13-FRCNN 4276 11642 124 110
COMBINED 56566 112297 800 546
yolov8m.pt:
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-02-FRCNN 31.231 26.88 36.634 27.723 82.99 38.059 87.264 85.846 31.779 36.186 82.285 29.775
MOT17-04-FRCNN 48.928 43.072 55.75 46.18 80.112 59.103 85.071 85.599 50.729 61.485 78.985 48.564
MOT17-05-FRCNN 39.324 40.898 38.347 45.462 67.626 43.294 69.366 78.156 41.654 54.711 70.09 38.347
MOT17-09-FRCNN 50.347 56.516 44.968 61.454 79.044 49.513 80.588 84.291 52.566 63.656 80.035 50.947
MOT17-10-FRCNN 38.644 44.137 34.066 47.468 73.694 38.087 73.697 79.943 40.177 51.916 73.967 38.401
MOT17-11-FRCNN 51.031 50.459 51.864 59.23 71.406 56.864 82.325 84.687 55.405 65.305 77.558 50.649
MOT17-13-FRCNN 39.152 34.088 45.267 35.696 77.765 48.061 80.576 82.322 40.146 49.023 78.051 38.263
COMBINED 44.234 40.806 48.301 43.963 77.318 51.926 82.608 83.94 46.026 55.827 77.853 43.463
CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-02-FRCNN 29.875 83.586 30.822 32.113 96.133 11.29 35.484 53.226 24.604 5967 12614 240 176 7 22 33 204
MOT17-04-FRCNN 42.719 85.206 43.228 50.436 87.495 21.687 40.964 37.349 35.258 23986 23571 3428 242 18 34 31 454
MOT17-05-FRCNN 40.451 75.082 43.256 55.241 82.172 15.038 63.158 21.805 26.686 3821 3096 829 194 20 84 29 193
MOT17-09-FRCNN 63.568 82.413 64.789 71.268 91.667 46.154 46.154 7.6923 51.035 3795 1530 345 65 12 12 2 57
MOT17-10-FRCNN 49.303 76.988 51.733 58.073 90.157 24.561 50.877 24.561 35.939 7456 5383 814 312 14 29 14 441
MOT17-11-FRCNN 46.895 84.44 47.255 65.102 78.485 32 25.333 42.667 36.765 6143 3293 1684 34 24 19 32 59
MOT17-13-FRCNN 40.225 79.631 41.178 43.541 94.854 19.091 38.182 42.727 31.356 5069 6573 275 111 21 42 47 227
COMBINED 42.288 82.482 43.298 50.079 88.074 21.245 44.322 34.432 33.515 56237 56060 7615 1134 116 242 188 1635
Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-02-FRCNN 36.534 24.369 72.95 4528 14053 1679
MOT17-04-FRCNN 57.462 45.293 78.573 21540 26017 5874
MOT17-05-FRCNN 51.941 43.429 64.602 3004 3913 1646
MOT17-09-FRCNN 60.75 53.991 69.444 2875 2450 1265
MOT17-10-FRCNN 47.695 39.209 60.871 5034 7805 3236
MOT17-11-FRCNN 55.715 50.964 61.441 4809 4627 3018
MOT17-13-FRCNN 50.029 36.497 79.51 4249 7393 1095
COMBINED 52.273 40.998 72.103 46039 66258 17813
Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-02-FRCNN 6207 18581 121 62
MOT17-04-FRCNN 27414 47557 124 83
MOT17-05-FRCNN 4650 6917 173 133
MOT17-09-FRCNN 4140 5325 74 26
MOT17-10-FRCNN 8270 12839 146 57
MOT17-11-FRCNN 7827 9436 142 75
MOT17-13-FRCNN 5344 11642 154 110
COMBINED 63852 112297 934 546
优化配置参数,复活系统默认开启。
yolov8n.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 29.295 23.572 36.801 24.285 81.481 38.604 85.236 85.099 29.791 34.082 81.522 27.784 MOT17-04-FRCNN 45.258 41.368 49.799 43.465 81.741 54.218 81.741 84.877 46.48 55.47 80.189 44.481 MOT17-05-FRCNN 34.602 34.933 34.78 37.781 68.735 41.009 64.793 77.62 36.143 48.919 68.684 33.6 MOT17-09-FRCNN 51.291 55.53 47.512 58.988 81.166 50.814 81.529 84.126 52.934 64.881 79.959 51.878 MOT17-10-FRCNN 40.071 39.154 41.164 41.293 75.222 45.764 75.318 80.012 41.215 53.281 74.553 39.723 MOT17-11-FRCNN 51.077 51.315 51.022 56.181 78.606 55.68 82.288 85.213 53.528 63.836 80.146 51.162 MOT17-13-FRCNN 33.812 27.276 42.239 28.299 77.048 46.368 78.363 81.499 34.509 42.631 76.956 32.807 COMBINED 41.734 37.869 46.366 39.925 79.261 50.648 80.73 83.604 42.955 51.951 78.58 40.823 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 26.285 82.758 27.038 28.422 95.359 9.6774 30.645 59.677 21.384 5281 13300 257 140 6 19 37 215 MOT17-04-FRCNN 45.314 83.238 45.89 49.532 93.151 16.867 53.012 30.12 37.011 23556 24001 1732 274 14 44 25 627 MOT17-05-FRCNN 30.418 75.868 32.268 43.617 79.353 7.5188 60.15 32.331 19.892 3017 3900 785 128 10 80 43 159 MOT17-09-FRCNN 63.155 82.302 64.376 68.526 94.289 42.308 42.308 15.385 51.027 3649 1676 221 65 11 11 4 77 MOT17-10-FRCNN 46.141 76.923 47.231 51.063 93.019 22.807 43.86 33.333 34.357 6556 6283 492 140 13 25 19 377 MOT17-11-FRCNN 53.095 84.576 53.37 62.421 87.337 29.333 28 42.667 43.467 5890 3546 854 26 22 21 32 52 MOT17-13-FRCNN 32.64 78.371 33.482 35.106 95.58 15.455 35.455 49.091 25.047 4087 7555 189 98 17 39 54 217 COMBINED 41.528 81.67 42.304 46.338 91.992 17.033 43.773 39.194 33.034 52036 60261 4530 871 93 239 214 1724 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 34.006 22.071 74.052 4101 14480 1437 MOT17-04-FRCNN 53.327 40.842 76.807 19423 28134 5865 MOT17-05-FRCNN 41.795 32.384 58.916 2240 4677 1562 MOT17-09-FRCNN 63.839 55.117 75.84 2935 2390 935 MOT17-10-FRCNN 51.954 40.237 73.297 5166 7673 1882 MOT17-11-FRCNN 56.786 48.686 68.12 4594 4842 2150 MOT17-13-FRCNN 42.656 29.162 79.397 3395 8247 881 COMBINED 49.572 37.271 73.991 41854 70443 14712 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 5538 18581 109 62 MOT17-04-FRCNN 25288 47557 157 83 MOT17-05-FRCNN 3802 6917 143 133 MOT17-09-FRCNN 3870 5325 58 26 MOT17-10-FRCNN 7048 12839 112 57 MOT17-11-FRCNN 6744 9436 97 75 MOT17-13-FRCNN 4276 11642 124 110 COMBINED 56566 112297 800 546
yolov8m.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 31.231 26.88 36.634 27.723 82.99 38.059 87.264 85.846 31.779 36.186 82.285 29.775 MOT17-04-FRCNN 48.928 43.072 55.75 46.18 80.112 59.103 85.071 85.599 50.729 61.485 78.985 48.564 MOT17-05-FRCNN 39.324 40.898 38.347 45.462 67.626 43.294 69.366 78.156 41.654 54.711 70.09 38.347 MOT17-09-FRCNN 50.347 56.516 44.968 61.454 79.044 49.513 80.588 84.291 52.566 63.656 80.035 50.947 MOT17-10-FRCNN 38.644 44.137 34.066 47.468 73.694 38.087 73.697 79.943 40.177 51.916 73.967 38.401 MOT17-11-FRCNN 51.031 50.459 51.864 59.23 71.406 56.864 82.325 84.687 55.405 65.305 77.558 50.649 MOT17-13-FRCNN 39.152 34.088 45.267 35.696 77.765 48.061 80.576 82.322 40.146 49.023 78.051 38.263 COMBINED 44.234 40.806 48.301 43.963 77.318 51.926 82.608 83.94 46.026 55.827 77.853 43.463 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 29.875 83.586 30.822 32.113 96.133 11.29 35.484 53.226 24.604 5967 12614 240 176 7 22 33 204 MOT17-04-FRCNN 42.719 85.206 43.228 50.436 87.495 21.687 40.964 37.349 35.258 23986 23571 3428 242 18 34 31 454 MOT17-05-FRCNN 40.451 75.082 43.256 55.241 82.172 15.038 63.158 21.805 26.686 3821 3096 829 194 20 84 29 193 MOT17-09-FRCNN 63.568 82.413 64.789 71.268 91.667 46.154 46.154 7.6923 51.035 3795 1530 345 65 12 12 2 57 MOT17-10-FRCNN 49.303 76.988 51.733 58.073 90.157 24.561 50.877 24.561 35.939 7456 5383 814 312 14 29 14 441 MOT17-11-FRCNN 46.895 84.44 47.255 65.102 78.485 32 25.333 42.667 36.765 6143 3293 1684 34 24 19 32 59 MOT17-13-FRCNN 40.225 79.631 41.178 43.541 94.854 19.091 38.182 42.727 31.356 5069 6573 275 111 21 42 47 227 COMBINED 42.288 82.482 43.298 50.079 88.074 21.245 44.322 34.432 33.515 56237 56060 7615 1134 116 242 188 1635 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 36.534 24.369 72.95 4528 14053 1679 MOT17-04-FRCNN 57.462 45.293 78.573 21540 26017 5874 MOT17-05-FRCNN 51.941 43.429 64.602 3004 3913 1646 MOT17-09-FRCNN 60.75 53.991 69.444 2875 2450 1265 MOT17-10-FRCNN 47.695 39.209 60.871 5034 7805 3236 MOT17-11-FRCNN 55.715 50.964 61.441 4809 4627 3018 MOT17-13-FRCNN 50.029 36.497 79.51 4249 7393 1095 COMBINED 52.273 40.998 72.103 46039 66258 17813 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 6207 18581 121 62 MOT17-04-FRCNN 27414 47557 124 83 MOT17-05-FRCNN 4650 6917 173 133 MOT17-09-FRCNN 4140 5325 74 26 MOT17-10-FRCNN 8270 12839 146 57 MOT17-11-FRCNN 7827 9436 142 75 MOT17-13-FRCNN 5344 11642 154 110 COMBINED 63852 112297 934 546
Hi! I am changing the iou match of strongsort (# Associate remaining tracks together with unconfirmed tracks using IOU.) to the iou match of oc-sort. (Put the momentum in the direction of velocity into the cost matrix) As shown in the formula below, do you have any good suggestions?
优化配置参数,复活系统默认开启。
yolov8n.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 29.295 23.572 36.801 24.285 81.481 38.604 85.236 85.099 29.791 34.082 81.522 27.784 MOT17-04-FRCNN 45.258 41.368 49.799 43.465 81.741 54.218 81.741 84.877 46.48 55.47 80.189 44.481 MOT17-05-FRCNN 34.602 34.933 34.78 37.781 68.735 41.009 64.793 77.62 36.143 48.919 68.684 33.6 MOT17-09-FRCNN 51.291 55.53 47.512 58.988 81.166 50.814 81.529 84.126 52.934 64.881 79.959 51.878 MOT17-10-FRCNN 40.071 39.154 41.164 41.293 75.222 45.764 75.318 80.012 41.215 53.281 74.553 39.723 MOT17-11-FRCNN 51.077 51.315 51.022 56.181 78.606 55.68 82.288 85.213 53.528 63.836 80.146 51.162 MOT17-13-FRCNN 33.812 27.276 42.239 28.299 77.048 46.368 78.363 81.499 34.509 42.631 76.956 32.807 COMBINED 41.734 37.869 46.366 39.925 79.261 50.648 80.73 83.604 42.955 51.951 78.58 40.823 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 26.285 82.758 27.038 28.422 95.359 9.6774 30.645 59.677 21.384 5281 13300 257 140 6 19 37 215 MOT17-04-FRCNN 45.314 83.238 45.89 49.532 93.151 16.867 53.012 30.12 37.011 23556 24001 1732 274 14 44 25 627 MOT17-05-FRCNN 30.418 75.868 32.268 43.617 79.353 7.5188 60.15 32.331 19.892 3017 3900 785 128 10 80 43 159 MOT17-09-FRCNN 63.155 82.302 64.376 68.526 94.289 42.308 42.308 15.385 51.027 3649 1676 221 65 11 11 4 77 MOT17-10-FRCNN 46.141 76.923 47.231 51.063 93.019 22.807 43.86 33.333 34.357 6556 6283 492 140 13 25 19 377 MOT17-11-FRCNN 53.095 84.576 53.37 62.421 87.337 29.333 28 42.667 43.467 5890 3546 854 26 22 21 32 52 MOT17-13-FRCNN 32.64 78.371 33.482 35.106 95.58 15.455 35.455 49.091 25.047 4087 7555 189 98 17 39 54 217 COMBINED 41.528 81.67 42.304 46.338 91.992 17.033 43.773 39.194 33.034 52036 60261 4530 871 93 239 214 1724 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 34.006 22.071 74.052 4101 14480 1437 MOT17-04-FRCNN 53.327 40.842 76.807 19423 28134 5865 MOT17-05-FRCNN 41.795 32.384 58.916 2240 4677 1562 MOT17-09-FRCNN 63.839 55.117 75.84 2935 2390 935 MOT17-10-FRCNN 51.954 40.237 73.297 5166 7673 1882 MOT17-11-FRCNN 56.786 48.686 68.12 4594 4842 2150 MOT17-13-FRCNN 42.656 29.162 79.397 3395 8247 881 COMBINED 49.572 37.271 73.991 41854 70443 14712 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 5538 18581 109 62 MOT17-04-FRCNN 25288 47557 157 83 MOT17-05-FRCNN 3802 6917 143 133 MOT17-09-FRCNN 3870 5325 58 26 MOT17-10-FRCNN 7048 12839 112 57 MOT17-11-FRCNN 6744 9436 97 75 MOT17-13-FRCNN 4276 11642 124 110 COMBINED 56566 112297 800 546
yolov8m.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 31.231 26.88 36.634 27.723 82.99 38.059 87.264 85.846 31.779 36.186 82.285 29.775 MOT17-04-FRCNN 48.928 43.072 55.75 46.18 80.112 59.103 85.071 85.599 50.729 61.485 78.985 48.564 MOT17-05-FRCNN 39.324 40.898 38.347 45.462 67.626 43.294 69.366 78.156 41.654 54.711 70.09 38.347 MOT17-09-FRCNN 50.347 56.516 44.968 61.454 79.044 49.513 80.588 84.291 52.566 63.656 80.035 50.947 MOT17-10-FRCNN 38.644 44.137 34.066 47.468 73.694 38.087 73.697 79.943 40.177 51.916 73.967 38.401 MOT17-11-FRCNN 51.031 50.459 51.864 59.23 71.406 56.864 82.325 84.687 55.405 65.305 77.558 50.649 MOT17-13-FRCNN 39.152 34.088 45.267 35.696 77.765 48.061 80.576 82.322 40.146 49.023 78.051 38.263 COMBINED 44.234 40.806 48.301 43.963 77.318 51.926 82.608 83.94 46.026 55.827 77.853 43.463 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 29.875 83.586 30.822 32.113 96.133 11.29 35.484 53.226 24.604 5967 12614 240 176 7 22 33 204 MOT17-04-FRCNN 42.719 85.206 43.228 50.436 87.495 21.687 40.964 37.349 35.258 23986 23571 3428 242 18 34 31 454 MOT17-05-FRCNN 40.451 75.082 43.256 55.241 82.172 15.038 63.158 21.805 26.686 3821 3096 829 194 20 84 29 193 MOT17-09-FRCNN 63.568 82.413 64.789 71.268 91.667 46.154 46.154 7.6923 51.035 3795 1530 345 65 12 12 2 57 MOT17-10-FRCNN 49.303 76.988 51.733 58.073 90.157 24.561 50.877 24.561 35.939 7456 5383 814 312 14 29 14 441 MOT17-11-FRCNN 46.895 84.44 47.255 65.102 78.485 32 25.333 42.667 36.765 6143 3293 1684 34 24 19 32 59 MOT17-13-FRCNN 40.225 79.631 41.178 43.541 94.854 19.091 38.182 42.727 31.356 5069 6573 275 111 21 42 47 227 COMBINED 42.288 82.482 43.298 50.079 88.074 21.245 44.322 34.432 33.515 56237 56060 7615 1134 116 242 188 1635 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 36.534 24.369 72.95 4528 14053 1679 MOT17-04-FRCNN 57.462 45.293 78.573 21540 26017 5874 MOT17-05-FRCNN 51.941 43.429 64.602 3004 3913 1646 MOT17-09-FRCNN 60.75 53.991 69.444 2875 2450 1265 MOT17-10-FRCNN 47.695 39.209 60.871 5034 7805 3236 MOT17-11-FRCNN 55.715 50.964 61.441 4809 4627 3018 MOT17-13-FRCNN 50.029 36.497 79.51 4249 7393 1095 COMBINED 52.273 40.998 72.103 46039 66258 17813 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 6207 18581 121 62 MOT17-04-FRCNN 27414 47557 124 83 MOT17-05-FRCNN 4650 6917 173 133 MOT17-09-FRCNN 4140 5325 74 26 MOT17-10-FRCNN 8270 12839 146 57 MOT17-11-FRCNN 7827 9436 142 75 MOT17-13-FRCNN 5344 11642 154 110 COMBINED 63852 112297 934 546
Hi! I am changing the iou match of strongsort (# Associate remaining tracks together with unconfirmed tracks using IOU.) to the iou match of oc-sort. (Put the momentum in the direction of velocity into the cost matrix) As shown in the formula below, do you have any good suggestions?
Hi, this PR is already doing that ☺️
你好
优化配置参数,复活系统默认开启。 yolov8n.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 29.295 23.572 36.801 24.285 81.481 38.604 85.236 85.099 29.791 34.082 81.522 27.784 MOT17-04-FRCNN 45.258 41.368 49.799 43.465 81.741 54.218 81.741 84.877 46.48 55.47 80.189 44.481 MOT17-05-FRCNN 34.602 34.933 34.78 37.781 68.735 41.009 64.793 77.62 36.143 48.919 68.684 33.6 MOT17-09-FRCNN 51.291 55.53 47.512 58.988 81.166 50.814 81.529 84.126 52.934 64.881 79.959 51.878 MOT17-10-FRCNN 40.071 39.154 41.164 41.293 75.222 45.764 75.318 80.012 41.215 53.281 74.553 39.723 MOT17-11-FRCNN 51.077 51.315 51.022 56.181 78.606 55.68 82.288 85.213 53.528 63.836 80.146 51.162 MOT17-13-FRCNN 33.812 27.276 42.239 28.299 77.048 46.368 78.363 81.499 34.509 42.631 76.956 32.807 COMBINED 41.734 37.869 46.366 39.925 79.261 50.648 80.73 83.604 42.955 51.951 78.58 40.823 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 26.285 82.758 27.038 28.422 95.359 9.6774 30.645 59.677 21.384 5281 13300 257 140 6 19 37 215 MOT17-04-FRCNN 45.314 83.238 45.89 49.532 93.151 16.867 53.012 30.12 37.011 23556 24001 1732 274 14 44 25 627 MOT17-05-FRCNN 30.418 75.868 32.268 43.617 79.353 7.5188 60.15 32.331 19.892 3017 3900 785 128 10 80 43 159 MOT17-09-FRCNN 63.155 82.302 64.376 68.526 94.289 42.308 42.308 15.385 51.027 3649 1676 221 65 11 11 4 77 MOT17-10-FRCNN 46.141 76.923 47.231 51.063 93.019 22.807 43.86 33.333 34.357 6556 6283 492 140 13 25 19 377 MOT17-11-FRCNN 53.095 84.576 53.37 62.421 87.337 29.333 28 42.667 43.467 5890 3546 854 26 22 21 32 52 MOT17-13-FRCNN 32.64 78.371 33.482 35.106 95.58 15.455 35.455 49.091 25.047 4087 7555 189 98 17 39 54 217 COMBINED 41.528 81.67 42.304 46.338 91.992 17.033 43.773 39.194 33.034 52036 60261 4530 871 93 239 214 1724 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 34.006 22.071 74.052 4101 14480 1437 MOT17-04-FRCNN 53.327 40.842 76.807 19423 28134 5865 MOT17-05-FRCNN 41.795 32.384 58.916 2240 4677 1562 MOT17-09-FRCNN 63.839 55.117 75.84 2935 2390 935 MOT17-10-FRCNN 51.954 40.237 73.297 5166 7673 1882 MOT17-11-FRCNN 56.786 48.686 68.12 4594 4842 2150 MOT17-13-FRCNN 42.656 29.162 79.397 3395 8247 881 COMBINED 49.572 37.271 73.991 41854 70443 14712 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 5538 18581 109 62 MOT17-04-FRCNN 25288 47557 157 83 MOT17-05-FRCNN 3802 6917 143 133 MOT17-09-FRCNN 3870 5325 58 26 MOT17-10-FRCNN 7048 12839 112 57 MOT17-11-FRCNN 6744 9436 97 75 MOT17-13-FRCNN 4276 11642 124 110 COMBINED 56566 112297 800 546
yolov8m.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 31.231 26.88 36.634 27.723 82.99 38.059 87.264 85.846 31.779 36.186 82.285 29.775 MOT17-04-FRCNN 48.928 43.072 55.75 46.18 80.112 59.103 85.071 85.599 50.729 61.485 78.985 48.564 MOT17-05-FRCNN 39.324 40.898 38.347 45.462 67.626 43.294 69.366 78.156 41.654 54.711 70.09 38.347 MOT17-09-FRCNN 50.347 56.516 44.968 61.454 79.044 49.513 80.588 84.291 52.566 63.656 80.035 50.947 MOT17-10-FRCNN 38.644 44.137 34.066 47.468 73.694 38.087 73.697 79.943 40.177 51.916 73.967 38.401 MOT17-11-FRCNN 51.031 50.459 51.864 59.23 71.406 56.864 82.325 84.687 55.405 65.305 77.558 50.649 MOT17-13-FRCNN 39.152 34.088 45.267 35.696 77.765 48.061 80.576 82.322 40.146 49.023 78.051 38.263 COMBINED 44.234 40.806 48.301 43.963 77.318 51.926 82.608 83.94 46.026 55.827 77.853 43.463 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 29.875 83.586 30.822 32.113 96.133 11.29 35.484 53.226 24.604 5967 12614 240 176 7 22 33 204 MOT17-04-FRCNN 42.719 85.206 43.228 50.436 87.495 21.687 40.964 37.349 35.258 23986 23571 3428 242 18 34 31 454 MOT17-05-FRCNN 40.451 75.082 43.256 55.241 82.172 15.038 63.158 21.805 26.686 3821 3096 829 194 20 84 29 193 MOT17-09-FRCNN 63.568 82.413 64.789 71.268 91.667 46.154 46.154 7.6923 51.035 3795 1530 345 65 12 12 2 57 MOT17-10-FRCNN 49.303 76.988 51.733 58.073 90.157 24.561 50.877 24.561 35.939 7456 5383 814 312 14 29 14 441 MOT17-11-FRCNN 46.895 84.44 47.255 65.102 78.485 32 25.333 42.667 36.765 6143 3293 1684 34 24 19 32 59 MOT17-13-FRCNN 40.225 79.631 41.178 43.541 94.854 19.091 38.182 42.727 31.356 5069 6573 275 111 21 42 47 227 COMBINED 42.288 82.482 43.298 50.079 88.074 21.245 44.322 34.432 33.515 56237 56060 7615 1134 116 242 188 1635 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 36.534 24.369 72.95 4528 14053 1679 MOT17-04-FRCNN 57.462 45.293 78.573 21540 26017 5874 MOT17-05-FRCNN 51.941 43.429 64.602 3004 3913 1646 MOT17-09-FRCNN 60.75 53.991 69.444 2875 2450 1265 MOT17-10-FRCNN 47.695 39.209 60.871 5034 7805 3236 MOT17-11-FRCNN 55.715 50.964 61.441 4809 4627 3018 MOT17-13-FRCNN 50.029 36.497 79.51 4249 7393 1095 COMBINED 52.273 40.998 72.103 46039 66258 17813 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 6207 18581 121 62 MOT17-04-FRCNN 27414 47557 124 83 MOT17-05-FRCNN 4650 6917 173 133 MOT17-09-FRCNN 4140 5325 74 26 MOT17-10-FRCNN 8270 12839 146 57 MOT17-11-FRCNN 7827 9436 142 75 MOT17-13-FRCNN 5344 11642 154 110 COMBINED 63852 112297 934 546
你好!我正在将strongsort的iou配对(#Associate remaining tracks together with unconfirmed tracks using IOU.)改为oc-sort的iou配对。(将速度方向的运动量放入本阵)如下公式所示,大家有什么好的建议?
嗨,这个公关已经在这样做了☺️
Thank you for your excellent work!
你好
优化配置参数,复活系统默认开启。 yolov8n.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 29.295 23.572 36.801 24.285 81.481 38.604 85.236 85.099 29.791 34.082 81.522 27.784 MOT17-04-FRCNN 45.258 41.368 49.799 43.465 81.741 54.218 81.741 84.877 46.48 55.47 80.189 44.481 MOT17-05-FRCNN 34.602 34.933 34.78 37.781 68.735 41.009 64.793 77.62 36.143 48.919 68.684 33.6 MOT17-09-FRCNN 51.291 55.53 47.512 58.988 81.166 50.814 81.529 84.126 52.934 64.881 79.959 51.878 MOT17-10-FRCNN 40.071 39.154 41.164 41.293 75.222 45.764 75.318 80.012 41.215 53.281 74.553 39.723 MOT17-11-FRCNN 51.077 51.315 51.022 56.181 78.606 55.68 82.288 85.213 53.528 63.836 80.146 51.162 MOT17-13-FRCNN 33.812 27.276 42.239 28.299 77.048 46.368 78.363 81.499 34.509 42.631 76.956 32.807 COMBINED 41.734 37.869 46.366 39.925 79.261 50.648 80.73 83.604 42.955 51.951 78.58 40.823 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 26.285 82.758 27.038 28.422 95.359 9.6774 30.645 59.677 21.384 5281 13300 257 140 6 19 37 215 MOT17-04-FRCNN 45.314 83.238 45.89 49.532 93.151 16.867 53.012 30.12 37.011 23556 24001 1732 274 14 44 25 627 MOT17-05-FRCNN 30.418 75.868 32.268 43.617 79.353 7.5188 60.15 32.331 19.892 3017 3900 785 128 10 80 43 159 MOT17-09-FRCNN 63.155 82.302 64.376 68.526 94.289 42.308 42.308 15.385 51.027 3649 1676 221 65 11 11 4 77 MOT17-10-FRCNN 46.141 76.923 47.231 51.063 93.019 22.807 43.86 33.333 34.357 6556 6283 492 140 13 25 19 377 MOT17-11-FRCNN 53.095 84.576 53.37 62.421 87.337 29.333 28 42.667 43.467 5890 3546 854 26 22 21 32 52 MOT17-13-FRCNN 32.64 78.371 33.482 35.106 95.58 15.455 35.455 49.091 25.047 4087 7555 189 98 17 39 54 217 COMBINED 41.528 81.67 42.304 46.338 91.992 17.033 43.773 39.194 33.034 52036 60261 4530 871 93 239 214 1724 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 34.006 22.071 74.052 4101 14480 1437 MOT17-04-FRCNN 53.327 40.842 76.807 19423 28134 5865 MOT17-05-FRCNN 41.795 32.384 58.916 2240 4677 1562 MOT17-09-FRCNN 63.839 55.117 75.84 2935 2390 935 MOT17-10-FRCNN 51.954 40.237 73.297 5166 7673 1882 MOT17-11-FRCNN 56.786 48.686 68.12 4594 4842 2150 MOT17-13-FRCNN 42.656 29.162 79.397 3395 8247 881 COMBINED 49.572 37.271 73.991 41854 70443 14712 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 5538 18581 109 62 MOT17-04-FRCNN 25288 47557 157 83 MOT17-05-FRCNN 3802 6917 143 133 MOT17-09-FRCNN 3870 5325 58 26 MOT17-10-FRCNN 7048 12839 112 57 MOT17-11-FRCNN 6744 9436 97 75 MOT17-13-FRCNN 4276 11642 124 110 COMBINED 56566 112297 800 546
yolov8m.pt :
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) MOT17-02-FRCNN 31.231 26.88 36.634 27.723 82.99 38.059 87.264 85.846 31.779 36.186 82.285 29.775 MOT17-04-FRCNN 48.928 43.072 55.75 46.18 80.112 59.103 85.071 85.599 50.729 61.485 78.985 48.564 MOT17-05-FRCNN 39.324 40.898 38.347 45.462 67.626 43.294 69.366 78.156 41.654 54.711 70.09 38.347 MOT17-09-FRCNN 50.347 56.516 44.968 61.454 79.044 49.513 80.588 84.291 52.566 63.656 80.035 50.947 MOT17-10-FRCNN 38.644 44.137 34.066 47.468 73.694 38.087 73.697 79.943 40.177 51.916 73.967 38.401 MOT17-11-FRCNN 51.031 50.459 51.864 59.23 71.406 56.864 82.325 84.687 55.405 65.305 77.558 50.649 MOT17-13-FRCNN 39.152 34.088 45.267 35.696 77.765 48.061 80.576 82.322 40.146 49.023 78.051 38.263 COMBINED 44.234 40.806 48.301 43.963 77.318 51.926 82.608 83.94 46.026 55.827 77.853 43.463 CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN 29.875 83.586 30.822 32.113 96.133 11.29 35.484 53.226 24.604 5967 12614 240 176 7 22 33 204 MOT17-04-FRCNN 42.719 85.206 43.228 50.436 87.495 21.687 40.964 37.349 35.258 23986 23571 3428 242 18 34 31 454 MOT17-05-FRCNN 40.451 75.082 43.256 55.241 82.172 15.038 63.158 21.805 26.686 3821 3096 829 194 20 84 29 193 MOT17-09-FRCNN 63.568 82.413 64.789 71.268 91.667 46.154 46.154 7.6923 51.035 3795 1530 345 65 12 12 2 57 MOT17-10-FRCNN 49.303 76.988 51.733 58.073 90.157 24.561 50.877 24.561 35.939 7456 5383 814 312 14 29 14 441 MOT17-11-FRCNN 46.895 84.44 47.255 65.102 78.485 32 25.333 42.667 36.765 6143 3293 1684 34 24 19 32 59 MOT17-13-FRCNN 40.225 79.631 41.178 43.541 94.854 19.091 38.182 42.727 31.356 5069 6573 275 111 21 42 47 227 COMBINED 42.288 82.482 43.298 50.079 88.074 21.245 44.322 34.432 33.515 56237 56060 7615 1134 116 242 188 1635 Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP MOT17-02-FRCNN 36.534 24.369 72.95 4528 14053 1679 MOT17-04-FRCNN 57.462 45.293 78.573 21540 26017 5874 MOT17-05-FRCNN 51.941 43.429 64.602 3004 3913 1646 MOT17-09-FRCNN 60.75 53.991 69.444 2875 2450 1265 MOT17-10-FRCNN 47.695 39.209 60.871 5034 7805 3236 MOT17-11-FRCNN 55.715 50.964 61.441 4809 4627 3018 MOT17-13-FRCNN 50.029 36.497 79.51 4249 7393 1095 COMBINED 52.273 40.998 72.103 46039 66258 17813 Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs MOT17-02-FRCNN 6207 18581 121 62 MOT17-04-FRCNN 27414 47557 124 83 MOT17-05-FRCNN 4650 6917 173 133 MOT17-09-FRCNN 4140 5325 74 26 MOT17-10-FRCNN 8270 12839 146 57 MOT17-11-FRCNN 7827 9436 142 75 MOT17-13-FRCNN 5344 11642 154 110 COMBINED 63852 112297 934 546
你好!我正在将strongsort的iou配对(#Associate remaining tracks together with unconfirmed tracks using IOU.)改为oc-sort的iou配对。(将速度方向的运动量放入本阵)如下公式所示,大家有什么好的建议?
嗨,这个公关已经在这样做了☺️
感谢您的出色工作!
I want to replace yolov8 in strong-ocsort with yolov5. What should I pay attention to in this work?
Hi, the code was recently updated to yolov8. Check the commits. It supported yolov5 before. Ideally you should just have to change some parameters in track.py and val.py to use yolov5.
排序
非常感谢。
你好,代码最近更新了yolov8。检查提交。之前是支持yolov5的。理想情况下,您只需要更改track.py和val.py中的一些参数即可使用yolov5。
Thank you!
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.