training_extensions icon indicating copy to clipboard operation
training_extensions copied to clipboard

[MISC] Pose estimation

Open druzhkov-paul opened this issue 3 years ago • 6 comments

druzhkov-paul avatar Mar 24 '21 14:03 druzhkov-paul

@LeonidBeynenson @aleksei-kashapov @Ilya-Krylov

Please take a look at this tests run:

07:27  ======================================================================
08:07:27  FAIL: test_nncf_compress_and_export (nncf_tests_face_detection.PersonDetection0200NNCFint8)
08:07:27  ----------------------------------------------------------------------
08:07:27  Traceback (most recent call last):
08:07:27    File "/home/jenkins/b/workspace/ote/precommit/pt_object_detection/src/models/object_detection/tests/common/object_detection_test_case.py", line 126, in test_nncf_compress_and_export
08:07:27      self.assertGreater(ap, last_compress_ap - self.test_export_thr)
08:07:27  AssertionError: 0.541 not greater than 0.5640000000000001
08:07:27  
08:07:27  ----------------------------------------------------------------------

It does not seem to be connected to the changes in this PR.

druzhkov-paul avatar Apr 05 '21 09:04 druzhkov-paul

@LeonidBeynenson @aleksei-kashapov @Ilya-Krylov

Please take a look at this tests run:

07:27  ======================================================================
08:07:27  FAIL: test_nncf_compress_and_export (nncf_tests_face_detection.PersonDetection0200NNCFint8)
08:07:27  ...
08:07:27  ----------------------------------------------------------------------

It does not seem to be connected to the changes in this PR.

Agree. I think it is a random mistake due to stochastic nature of our CI checks. It may happen (fortunately, it is a seldom issue), If it is the only fail in the test you can either skip it and merge the PR, or re-run the tests.

LeonidBeynenson avatar Apr 05 '21 11:04 LeonidBeynenson

@LeonidBeynenson @aleksei-kashapov

It happened again:

======================================================================
18:19:19  FAIL: test_nncf_compress_and_export (nncf_tests_face_detection.FaceDetection0202NNCFint8)
18:19:19  ----------------------------------------------------------------------
18:19:19  Traceback (most recent call last):
18:19:19    File "/home/jenkins/workspace/ote/precommit/pt_object_detection/src/models/object_detection/tests/common/object_detection_test_case.py", line 126, in test_nncf_compress_and_export
18:19:19      self.assertGreater(ap, last_compress_ap - self.test_export_thr)
18:19:19  AssertionError: 0.172 not greater than 0.18000000000000002
18:19:19  
18:19:19  ----------------------------------------------------------------------

Is there any chance to decrease the number of those tests failures?

druzhkov-paul avatar Apr 07 '21 19:04 druzhkov-paul

run tests

druzhkov-paul avatar Apr 07 '21 20:04 druzhkov-paul

run tests

druzhkov-paul avatar Aug 20 '21 09:08 druzhkov-paul

Can one of the admins verify this patch?

nervana-ff avatar Feb 15 '22 15:02 nervana-ff