mynewt-nimble icon indicating copy to clipboard operation
mynewt-nimble copied to clipboard

Published 20 hours ago • verified publisher icon apache

Assure Nimble supports AutoPts based on PTS 8.1

Open rymanluk opened this issue 3 years ago • 5 comments

  • [ ] Make sure GAP test cases passes and contains all new ones
  • [ ] Same with GATT
  • [ ] Same with SM
  • [ ] Same with L2CAP
  • [ ] Same with Mesh

rymanluk avatar Sep 09 '21 08:09 rymanluk

Update of PTS workspace in autopts: https://github.com/intel/auto-pts/pull/592

First batch of fixed tests in autopts: https://github.com/intel/auto-pts/pull/590

NimBLE fixes: https://github.com/apache/mynewt-nimble/pull/1024 https://github.com/apache/mynewt-nimble/pull/1025 https://github.com/apache/mynewt-nimble/pull/1032 https://github.com/apache/mynewt-nimble/pull/1033

KKopyscinski avatar Sep 28 '21 12:09 KKopyscinski

FYI @jrotkiewicz

KKopyscinski avatar Sep 28 '21 12:09 KKopyscinski

Pending fixes:

  • Host:
    • https://github.com/apache/mynewt-nimble/pull/1099
    • https://github.com/apache/mynewt-nimble/pull/1107
    • https://github.com/apache/mynewt-nimble/pull/1003
    • https://github.com/apache/mynewt-nimble/pull/1025 - this is a GAP API change
  • bttester
    • https://github.com/apache/mynewt-nimble/pull/1096
    • https://github.com/apache/mynewt-nimble/pull/1094
    • https://github.com/apache/mynewt-nimble/pull/1091
  • autopts:
    • https://github.com/intel/auto-pts/pull/590

KKopyscinski avatar Nov 19 '21 09:11 KKopyscinski

With submitted PR test results are as follows:

Results
Group Test Verdict
GAP GAP/BROB/BCST/BV-01-C PASS
GAP GAP/BROB/BCST/BV-02-C PASS
GAP GAP/BROB/OBSV/BV-01-C PASS
GAP GAP/BROB/OBSV/BV-02-C PASS
GAP GAP/BROB/OBSV/BV-05-C PASS
GAP GAP/BROB/OBSV/BV-06-C PASS
GAP GAP/DISC/NONM/BV-01-C PASS
GAP GAP/DISC/NONM/BV-02-C PASS
GAP GAP/DISC/LIMM/BV-03-C PASS
GAP GAP/DISC/LIMM/BV-04-C PASS
GAP GAP/DISC/GENM/BV-04-C PASS
GAP GAP/DISC/LIMP/BV-01-C PASS
GAP GAP/DISC/LIMP/BV-02-C PASS
GAP GAP/DISC/LIMP/BV-03-C PASS
GAP GAP/DISC/LIMP/BV-04-C PASS
GAP GAP/DISC/LIMP/BV-05-C PASS
GAP GAP/DISC/GENP/BV-01-C PASS
GAP GAP/DISC/GENP/BV-02-C PASS
GAP GAP/DISC/GENP/BV-03-C PASS
GAP GAP/DISC/GENP/BV-04-C PASS
GAP GAP/DISC/GENP/BV-05-C PASS
GAP GAP/DISC/RPA/BV-01-C PASS
GAP GAP/IDLE/NAMP/BV-01-C PASS
GAP GAP/IDLE/NAMP/BV-02-C PASS
GAP GAP/CONN/NCON/BV-01-C PASS
GAP GAP/CONN/NCON/BV-02-C PASS
GAP GAP/CONN/NCON/BV-03-C PASS
GAP GAP/CONN/DCON/BV-01-C PASS
GAP GAP/CONN/UCON/BV-01-C PASS
GAP GAP/CONN/UCON/BV-02-C PASS
GAP GAP/CONN/UCON/BV-03-C PASS
GAP GAP/CONN/ACEP/BV-01-C INCONC
GAP GAP/CONN/ACEP/BV-03-C INCONC
GAP GAP/CONN/GCEP/BV-01-C INCONC
GAP GAP/CONN/GCEP/BV-02-C PASS
GAP GAP/CONN/SCEP/BV-01-C INCONC
GAP GAP/CONN/SCEP/BV-03-C INCONC
GAP GAP/CONN/DCEP/BV-01-C INCONC
GAP GAP/CONN/DCEP/BV-03-C PASS
GAP GAP/CONN/CPUP/BV-08-C PASS
GAP GAP/CONN/CPUP/BV-10-C PASS
GAP GAP/CONN/TERM/BV-01-C PASS
GAP GAP/CONN/PRDA/BV-01-C PASS
GAP GAP/CONN/PRDA/BV-02-C PTS TIMEOUT
GAP GAP/BOND/NBON/BV-01-C PASS
GAP GAP/BOND/NBON/BV-02-C PASS
GAP GAP/BOND/NBON/BV-03-C PASS
GAP GAP/BOND/BON/BV-01-C PASS
GAP GAP/BOND/BON/BV-02-C PASS
GAP GAP/BOND/BON/BV-03-C PASS
GAP GAP/BOND/BON/BV-04-C PASS
GAP GAP/SEC/SEM/BV-45-C PASS
GAP GAP/SEC/AUT/BV-11-C PASS
GAP GAP/SEC/AUT/BV-12-C PASS
GAP GAP/SEC/AUT/BV-13-C PASS
GAP GAP/SEC/AUT/BV-14-C PASS
GAP GAP/SEC/AUT/BV-17-C FAIL
GAP GAP/SEC/AUT/BV-18-C PASS
GAP GAP/SEC/AUT/BV-19-C INCONC
GAP GAP/SEC/AUT/BV-20-C PASS
GAP GAP/SEC/AUT/BV-21-C PASS
GAP GAP/SEC/AUT/BV-22-C PASS
GAP GAP/SEC/AUT/BV-23-C PASS
GAP GAP/SEC/AUT/BV-24-C PASS
GAP GAP/SEC/AUT/BV-25-C INCONC
GAP GAP/SEC/AUT/BV-26-C BTP ERROR
GAP GAP/SEC/AUT/BV-27-C BTP ERROR
GAP GAP/SEC/AUT/BV-28-C BTP ERROR
GAP GAP/PRIV/CONN/BV-12-C PASS
GAP GAP/ADV/BV-01-C PASS
GAP GAP/ADV/BV-02-C PASS
GAP GAP/ADV/BV-03-C PASS
GAP GAP/ADV/BV-04-C PASS
GAP GAP/ADV/BV-05-C PASS
GAP GAP/ADV/BV-08-C PASS
GAP GAP/ADV/BV-10-C PASS
GAP GAP/ADV/BV-11-C PASS
GAP GAP/ADV/BV-14-C PASS
GAP GAP/ADV/BV-17-C PASS
GAP GAP/ADV/BV-18-C PASS
GAP GAP/GAT/BV-04-C PASS
GAP GAP/GAT/BV-05-C PASS
GAP GAP/GAT/BV-06-C PASS
GATT GATT/CL/GAC/BV-01-C PASS
GATT GATT/CL/GAD/BV-01-C PASS
GATT GATT/CL/GAD/BV-02-C PASS
GATT GATT/CL/GAD/BV-03-C PASS
GATT GATT/CL/GAD/BV-04-C PASS
GATT GATT/CL/GAD/BV-05-C PASS
GATT GATT/CL/GAD/BV-06-C PASS
GATT GATT/CL/GAR/BV-01-C PASS
GATT GATT/CL/GAR/BI-01-C PASS
GATT GATT/CL/GAR/BI-02-C PASS
GATT GATT/CL/GAR/BI-04-C PASS
GATT GATT/CL/GAR/BI-05-C PASS
GATT GATT/CL/GAR/BV-03-C PASS
GATT GATT/CL/GAR/BI-06-C PASS
GATT GATT/CL/GAR/BI-07-C PASS
GATT GATT/CL/GAR/BI-10-C PASS
GATT GATT/CL/GAR/BI-11-C PASS
GATT GATT/CL/GAR/BV-04-C PASS
GATT GATT/CL/GAR/BI-12-C PASS
GATT GATT/CL/GAR/BI-13-C PASS
GATT GATT/CL/GAR/BI-14-C PASS
GATT GATT/CL/GAR/BI-16-C PASS
GATT GATT/CL/GAR/BI-17-C PASS
GATT GATT/CL/GAR/BV-05-C PASS
GATT GATT/CL/GAR/BI-18-C PASS
GATT GATT/CL/GAR/BI-19-C PASS
GATT GATT/CL/GAR/BI-21-C PASS
GATT GATT/CL/GAR/BI-22-C PASS
GATT GATT/CL/GAR/BV-06-C PASS
GATT GATT/CL/GAR/BV-07-C PASS
GATT GATT/CL/GAR/BI-35-C PASS
GATT GATT/CL/GAW/BV-01-C PASS
GATT GATT/CL/GAW/BV-03-C PASS
GATT GATT/CL/GAW/BI-02-C PASS
GATT GATT/CL/GAW/BI-03-C PASS
GATT GATT/CL/GAW/BI-05-C PASS
GATT GATT/CL/GAW/BI-06-C PASS
GATT GATT/CL/GAW/BV-05-C PASS
GATT GATT/CL/GAW/BI-07-C PASS
GATT GATT/CL/GAW/BI-08-C PASS
GATT GATT/CL/GAW/BI-09-C PASS
GATT GATT/CL/GAW/BI-12-C PASS
GATT GATT/CL/GAW/BI-13-C PASS
GATT GATT/CL/GAW/BV-06-C PASS
GATT GATT/CL/GAW/BV-08-C PASS
GATT GATT/CL/GAW/BV-09-C PASS
GATT GATT/CL/GAW/BI-32-C PASS
GATT GATT/CL/GAW/BI-33-C PASS
GATT GATT/CL/GAW/BI-34-C PASS
GATT GATT/CL/GAN/BV-01-C PASS
GATT GATT/CL/GAI/BV-01-C PASS
GATT GATT/CL/GAI/BI-01-C PASS
GATT GATT/CL/GAS/BV-01-C PASS
GATT GATT/CL/GAT/BV-01-C PASS
GATT GATT/CL/GAT/BV-02-C PASS
GATT GATT/SR/GAC/BV-01-C PASS
GATT GATT/SR/GAD/BV-01-C PASS
GATT GATT/SR/GAD/BV-02-C PASS
GATT GATT/SR/GAD/BV-03-C PASS
GATT GATT/SR/GAD/BV-04-C PASS
GATT GATT/SR/GAD/BV-05-C PASS
GATT GATT/SR/GAD/BV-06-C PASS
GATT GATT/SR/GAR/BV-01-C PASS
GATT GATT/SR/GAR/BI-01-C PASS
GATT GATT/SR/GAR/BI-02-C PASS
GATT GATT/SR/GAR/BI-04-C PASS
GATT GATT/SR/GAR/BI-05-C PASS
GATT GATT/SR/GAR/BV-03-C PASS
GATT GATT/SR/GAR/BI-06-C PASS
GATT GATT/SR/GAR/BI-07-C PASS
GATT GATT/SR/GAR/BI-08-C PASS
GATT GATT/SR/GAR/BI-10-C PASS
GATT GATT/SR/GAR/BI-11-C PASS
GATT GATT/SR/GAR/BV-04-C PASS
GATT GATT/SR/GAR/BI-12-C PASS
GATT GATT/SR/GAR/BI-13-C PASS
GATT GATT/SR/GAR/BI-14-C PASS
GATT GATT/SR/GAR/BI-16-C PASS
GATT GATT/SR/GAR/BI-17-C PASS
GATT GATT/SR/GAR/BV-05-C PASS
GATT GATT/SR/GAR/BI-18-C PASS
GATT GATT/SR/GAR/BI-19-C PASS
GATT GATT/SR/GAR/BI-21-C PASS
GATT GATT/SR/GAR/BI-22-C PASS
GATT GATT/SR/GAR/BV-06-C PASS
GATT GATT/SR/GAR/BV-07-C PASS
GATT GATT/SR/GAR/BV-08-C PASS
GATT GATT/SR/GAR/BI-45-C PASS
GATT GATT/SR/GAW/BV-01-C PASS
GATT GATT/SR/GAW/BV-03-C PASS
GATT GATT/SR/GAW/BI-02-C PASS
GATT GATT/SR/GAW/BI-03-C PASS
GATT GATT/SR/GAW/BI-05-C PASS
GATT GATT/SR/GAW/BI-06-C PASS
GATT GATT/SR/GAW/BV-05-C PASS
GATT GATT/SR/GAW/BI-07-C PASS
GATT GATT/SR/GAW/BI-08-C PASS
GATT GATT/SR/GAW/BI-09-C PASS
GATT GATT/SR/GAW/BI-12-C PASS
GATT GATT/SR/GAW/BI-13-C PASS
GATT GATT/SR/GAW/BV-06-C PASS
GATT GATT/SR/GAW/BV-10-C PASS
GATT GATT/SR/GAW/BV-11-C PASS
GATT GATT/SR/GAW/BV-07-C PASS
GATT GATT/SR/GAW/BV-08-C PASS
GATT GATT/SR/GAW/BV-09-C PASS
GATT GATT/SR/GAW/BI-32-C PASS
GATT GATT/SR/GAW/BI-33-C PASS
GATT GATT/SR/GAN/BV-01-C PASS
GATT GATT/SR/GAI/BV-01-C PASS
GATT GATT/SR/GAS/BV-01-C PASS
GATT GATT/SR/GAT/BV-01-C PASS
GATT GATT/SR/UNS/BI-01-C PASS
GATT GATT/SR/UNS/BI-02-C PASS
L2CAP L2CAP/COS/CFC/BV-01-C PASS
L2CAP L2CAP/COS/CFC/BV-02-C PASS
L2CAP L2CAP/COS/CFC/BV-03-C PASS
L2CAP L2CAP/COS/CFC/BV-04-C PASS
L2CAP L2CAP/COS/CFC/BV-05-C PASS
L2CAP L2CAP/COS/ECFC/BV-01-C PASS
L2CAP L2CAP/COS/ECFC/BV-02-C PASS
L2CAP L2CAP/COS/ECFC/BV-03-C PASS
L2CAP L2CAP/LE/CPU/BV-02-C PASS
L2CAP L2CAP/LE/CPU/BI-01-C PASS
L2CAP L2CAP/LE/CPU/BI-02-C PASS
L2CAP L2CAP/LE/REJ/BI-01-C PASS
L2CAP L2CAP/LE/REJ/BI-02-C PASS
L2CAP L2CAP/LE/CFC/BV-01-C PASS
L2CAP L2CAP/LE/CFC/BV-02-C PASS
L2CAP L2CAP/LE/CFC/BV-03-C PASS
L2CAP L2CAP/LE/CFC/BV-04-C PASS
L2CAP L2CAP/LE/CFC/BV-05-C PASS
L2CAP L2CAP/LE/CFC/BV-06-C PASS
L2CAP L2CAP/LE/CFC/BV-07-C PASS
L2CAP L2CAP/LE/CFC/BI-01-C PASS
L2CAP L2CAP/LE/CFC/BV-08-C PASS
L2CAP L2CAP/LE/CFC/BV-09-C PASS
L2CAP L2CAP/LE/CFC/BV-10-C PASS
L2CAP L2CAP/LE/CFC/BV-11-C PASS
L2CAP L2CAP/LE/CFC/BV-12-C PASS
L2CAP L2CAP/LE/CFC/BV-13-C PASS
L2CAP L2CAP/LE/CFC/BV-14-C PASS
L2CAP L2CAP/LE/CFC/BV-15-C PASS
L2CAP L2CAP/LE/CFC/BV-16-C PASS
L2CAP L2CAP/LE/CFC/BV-18-C PASS
L2CAP L2CAP/LE/CFC/BV-19-C PASS
L2CAP L2CAP/LE/CFC/BV-20-C PASS
L2CAP L2CAP/LE/CFC/BV-21-C PASS
L2CAP L2CAP/LE/CFC/BV-22-C PASS
L2CAP L2CAP/LE/CFC/BV-23-C PASS
L2CAP L2CAP/LE/CFC/BV-24-C PASS
L2CAP L2CAP/LE/CFC/BV-25-C PASS
L2CAP L2CAP/LE/CFC/BV-26-C PASS
L2CAP L2CAP/LE/CFC/BV-27-C PASS
L2CAP L2CAP/LE/CFC/BV-28-C PASS
L2CAP L2CAP/LE/CFC/BV-29-C BTP ERROR
L2CAP L2CAP/LE/CFC/BV-30-C PASS
L2CAP L2CAP/LE/CFC/BV-31-C PASS
L2CAP L2CAP/LE/CFC/BI-02-C PASS
L2CAP L2CAP/LE/CID/BI-01-C PASS
L2CAP L2CAP/ECFC/BV-01-C PASS
L2CAP L2CAP/ECFC/BV-02-C PASS
L2CAP L2CAP/ECFC/BV-03-C PASS
L2CAP L2CAP/ECFC/BV-04-C PASS
L2CAP L2CAP/ECFC/BV-06-C PASS
L2CAP L2CAP/ECFC/BV-07-C PASS
L2CAP L2CAP/ECFC/BI-01-C PASS
L2CAP L2CAP/ECFC/BI-02-C PASS
L2CAP L2CAP/ECFC/BV-08-C PASS
L2CAP L2CAP/ECFC/BV-09-C PASS
L2CAP L2CAP/ECFC/BV-10-C PASS
L2CAP L2CAP/ECFC/BV-11-C PASS
L2CAP L2CAP/ECFC/BV-12-C PASS
L2CAP L2CAP/ECFC/BV-13-C PASS
L2CAP L2CAP/ECFC/BV-14-C PASS
L2CAP L2CAP/ECFC/BV-15-C PASS
L2CAP L2CAP/ECFC/BV-16-C PASS
L2CAP L2CAP/ECFC/BV-17-C PASS
L2CAP L2CAP/ECFC/BV-18-C PASS
L2CAP L2CAP/ECFC/BV-19-C PASS
L2CAP L2CAP/ECFC/BV-20-C PASS
L2CAP L2CAP/ECFC/BV-21-C PASS
L2CAP L2CAP/ECFC/BV-22-C PASS
L2CAP L2CAP/ECFC/BV-23-C PASS
L2CAP L2CAP/ECFC/BI-03-C PASS
L2CAP L2CAP/ECFC/BV-24-C INCONC
L2CAP L2CAP/ECFC/BV-25-C PASS
L2CAP L2CAP/ECFC/BI-04-C PASS
L2CAP L2CAP/ECFC/BV-26-C PASS
L2CAP L2CAP/ECFC/BV-27-C PASS
L2CAP L2CAP/ECFC/BV-28-C PASS
L2CAP L2CAP/ECFC/BV-29-C PASS
L2CAP L2CAP/ECFC/BV-30-C PASS
L2CAP L2CAP/ECFC/BV-31-C PASS
L2CAP L2CAP/ECFC/BV-32-C PASS
L2CAP L2CAP/ECFC/BV-33-C PASS
L2CAP L2CAP/ECFC/BV-34-C PASS
L2CAP L2CAP/ECFC/BV-35-C PASS
L2CAP L2CAP/ECFC/BV-38-C INCONC
L2CAP L2CAP/ECFC/BV-41-C PASS
L2CAP L2CAP/ECFC/BI-05-C PASS
L2CAP L2CAP/ECFC/BI-06-C PASS
L2CAP L2CAP/ECFC/BI-07-C PASS
MESH MESH/NODE/PBADV/BV-01-C PASS
MESH MESH/NODE/PBADV/BV-02-C PASS
MESH MESH/NODE/PBADV/BV-03-C PASS
MESH MESH/NODE/PBADV/BV-04-C PASS
MESH MESH/NODE/PBADV/BI-01-C PASS
MESH MESH/NODE/PBADV/BI-02-C PASS
MESH MESH/NODE/PBADV/BI-03-C PASS
MESH MESH/NODE/PBADV/BI-04-C PASS
MESH MESH/NODE/MPS/BV-01-C PASS
MESH MESH/NODE/MPS/BV-02-C PASS
MESH MESH/NODE/MPS/BV-03-C PASS
MESH MESH/NODE/MPS/BV-04-C PASS
MESH MESH/NODE/MPS/BV-05-C PASS
MESH MESH/NODE/MPS/BV-06-C PASS
MESH MESH/NODE/MPS/BV-07-C PASS
MESH MESH/NODE/MPS/BV-08-C PASS
MESH MESH/NODE/MPS/BV-09-C PASS
MESH MESH/NODE/MPS/BV-10-C PASS
MESH MESH/NODE/MPS/BI-01-C PASS
MESH MESH/NODE/PROV/BV-01-C PASS
MESH MESH/NODE/PROV/BV-07-C PASS
MESH MESH/NODE/PROV/BV-09-C PASS
MESH MESH/NODE/PROV/BV-10-C PASS
MESH MESH/NODE/PROV/BV-11-C PASS
MESH MESH/NODE/PROV/BV-12-C PASS
MESH MESH/NODE/PROV/BI-01-C PASS
MESH MESH/NODE/PROV/BI-02-C PASS
MESH MESH/NODE/PROV/BI-03-C PASS
MESH MESH/NODE/PROV/BI-13-C PASS
MESH MESH/NODE/PROV/BI-15-C PASS
MESH MESH/NODE/PROV/BI-17-C PASS
MESH MESH/NODE/BCN/SNB/BV-01-C PASS
MESH MESH/NODE/NET/BV-01-C PASS
MESH MESH/NODE/NET/BV-02-C PASS
MESH MESH/NODE/NET/BV-03-C PASS
MESH MESH/NODE/NET/BV-04-C PASS
MESH MESH/NODE/NET/BV-05-C PASS
MESH MESH/NODE/NET/BV-06-C PASS
MESH MESH/NODE/NET/BV-07-C BTP TIMEOUT
MESH MESH/NODE/NET/BV-08-C PASS
MESH MESH/NODE/NET/BV-09-C PASS
MESH MESH/NODE/NET/BV-10-C PASS
MESH MESH/NODE/NET/BV-11-C PASS
MESH MESH/NODE/NET/BV-12-C PASS
MESH MESH/NODE/NET/BV-13-C PASS
MESH MESH/NODE/NET/BV-14-C INCONC
MESH MESH/NODE/NET/BI-01-C PASS
MESH MESH/NODE/NET/BI-02-C PASS
MESH MESH/NODE/NET/BI-03-C PASS
MESH MESH/NODE/RLY/BV-01-C PASS
MESH MESH/NODE/RLY/BV-02-C BTP TIMEOUT
MESH MESH/NODE/RLY/BI-01-C PASS
MESH MESH/NODE/RLY/BI-02-C PASS
MESH MESH/NODE/TNPT/BV-01-C PASS
MESH MESH/NODE/TNPT/BV-02-C PASS
MESH MESH/NODE/TNPT/BV-03-C PASS
MESH MESH/NODE/TNPT/BV-04-C PASS
MESH MESH/NODE/TNPT/BV-05-C PASS
MESH MESH/NODE/TNPT/BV-06-C PASS
MESH MESH/NODE/TNPT/BV-07-C PASS
MESH MESH/NODE/TNPT/BV-08-C PASS
MESH MESH/NODE/TNPT/BV-09-C PASS
MESH MESH/NODE/TNPT/BV-10-C PASS
MESH MESH/NODE/TNPT/BV-11-C PASS
MESH MESH/NODE/TNPT/BV-12-C PASS
MESH MESH/NODE/TNPT/BV-13-C FAIL
MESH MESH/NODE/TNPT/BI-01-C PASS
MESH MESH/NODE/TNPT/BI-02-C PASS
MESH MESH/NODE/IVU/BV-01-C PASS
MESH MESH/NODE/IVU/BV-02-C PASS
MESH MESH/NODE/IVU/BV-03-C PASS
MESH MESH/NODE/IVU/BV-04-C PTS TIMEOUT
MESH MESH/NODE/IVU/BV-05-C PASS
MESH MESH/NODE/IVU/BI-01-C PASS
MESH MESH/NODE/IVU/BI-02-C PASS
MESH MESH/NODE/IVU/BI-04-C PASS
MESH MESH/NODE/IVU/BI-05-C PASS
MESH MESH/NODE/IVU/BI-06-C PASS
MESH MESH/NODE/KR/BV-01-C PASS
MESH MESH/NODE/KR/BV-02-C PASS
MESH MESH/NODE/KR/BV-03-C PASS
MESH MESH/NODE/KR/BI-01-C PASS
MESH MESH/NODE/KR/BI-02-C PASS
MESH MESH/NODE/KR/BI-03-C PASS
MESH MESH/NODE/KR/BI-04-C PASS
MESH MESH/NODE/KR/BI-05-C PASS
MESH MESH/NODE/FRND/FN/BV-01-C PASS
MESH MESH/NODE/FRND/FN/BV-02-C PASS
MESH MESH/NODE/FRND/FN/BV-03-C PASS
MESH MESH/NODE/FRND/FN/BV-04-C PASS
MESH MESH/NODE/FRND/FN/BV-05-C PASS
MESH MESH/NODE/FRND/FN/BV-06-C PASS
MESH MESH/NODE/FRND/FN/BV-07-C PASS
MESH MESH/NODE/FRND/FN/BV-08-C PASS
MESH MESH/NODE/FRND/FN/BV-09-C PASS
MESH MESH/NODE/FRND/FN/BV-10-C PASS
MESH MESH/NODE/FRND/FN/BV-11-C PASS
MESH MESH/NODE/FRND/FN/BV-12-C PASS
MESH MESH/NODE/FRND/FN/BV-13-C PASS
MESH MESH/NODE/FRND/FN/BV-14-C PASS
MESH MESH/NODE/FRND/FN/BV-15-C PASS
MESH MESH/NODE/FRND/FN/BV-16-C PASS
MESH MESH/NODE/FRND/FN/BV-17-C PASS
MESH MESH/NODE/FRND/FN/BV-18-C PASS
MESH MESH/NODE/FRND/FN/BV-19-C PASS
MESH MESH/NODE/FRND/FN/BV-20-C INCONC
MESH MESH/NODE/FRND/FN/BV-21-C PASS
MESH MESH/NODE/FRND/FN/BV-22-C PASS
MESH MESH/NODE/FRND/FN/BV-23-C PASS
MESH MESH/NODE/FRND/FN/BI-01-C PASS
MESH MESH/NODE/FRND/FN/BI-02-C PASS
MESH MESH/NODE/FRND/FN/BI-03-C PASS
MESH MESH/NODE/FRND/LPN/BV-01-C PASS
MESH MESH/NODE/FRND/LPN/BV-02-C PASS
MESH MESH/NODE/FRND/LPN/BV-03-C PASS
MESH MESH/NODE/FRND/LPN/BV-04-C PASS
MESH MESH/NODE/FRND/LPN/BV-05-C PASS
MESH MESH/NODE/FRND/LPN/BV-06-C PASS
MESH MESH/NODE/FRND/LPN/BV-07-C PASS
MESH MESH/NODE/FRND/LPN/BV-08-C PASS
MESH MESH/NODE/FRND/LPN/BI-01-C PASS
MESH MESH/NODE/FRND/LPN/BI-02-C PASS
MESH MESH/NODE/FRND/LPN/BI-03-C PASS
MESH MESH/SR/PROX/BV-01-C PASS
MESH MESH/SR/PROX/BV-02-C PASS
MESH MESH/SR/PROX/BV-03-C PASS
MESH MESH/SR/PROX/BV-04-C PASS
MESH MESH/SR/PROX/BV-05-C PASS
MESH MESH/SR/PROX/BV-06-C PASS
MESH MESH/SR/PROX/BV-07-C PASS
MESH MESH/SR/PROX/BV-08-C PASS
MESH MESH/SR/PROX/BV-09-C PASS
MESH MESH/SR/PROX/BV-10-C PASS
MESH MESH/SR/PROX/BV-11-C PASS
MESH MESH/SR/PROX/BV-12-C PASS
MESH MESH/SR/PROX/BV-13-C PASS
MESH MESH/SR/PROX/BV-14-C INCONC
MESH MESH/SR/PROX/BV-15-C PASS
MESH MESH/SR/PROX/BI-01-C PASS
MESH MESH/SR/PROX/BI-02-C PASS
MESH MESH/SR/MPXS/BV-01-C PASS
MESH MESH/SR/MPXS/BV-02-C PASS
MESH MESH/SR/MPXS/BV-03-C PASS
MESH MESH/SR/MPXS/BV-04-C PASS
MESH MESH/SR/MPXS/BV-05-C PASS
MESH MESH/SR/MPXS/BV-06-C PASS
MESH MESH/SR/MPXS/BV-07-C PASS
MESH MESH/SR/MPXS/BV-09-C INCONC
MESH MESH/NODE/CFG/SNBP/BV-01-C PASS
MESH MESH/NODE/CFG/SNBP/BI-01-C PASS
MESH MESH/NODE/CFG/COMP/BV-01-C PASS
MESH MESH/NODE/CFG/DTTL/BV-01-C PASS
MESH MESH/NODE/CFG/DTTL/BI-01-C PASS
MESH MESH/NODE/CFG/GPXY/BV-01-C PASS
MESH MESH/NODE/CFG/GPXY/BV-02-C PASS
MESH MESH/NODE/CFG/GPXY/BI-01-C PASS
MESH MESH/NODE/CFG/CFGF/BV-01-C PASS
MESH MESH/NODE/CFG/CFGF/BI-01-C PASS
MESH MESH/NODE/CFG/CFGR/BV-01-C PASS
MESH MESH/NODE/CFG/CFGR/BI-01-C PASS
MESH MESH/NODE/CFG/MP/BV-01-C PASS
MESH MESH/NODE/CFG/MP/BV-02-C PASS
MESH MESH/NODE/CFG/MP/BV-03-C PASS
MESH MESH/NODE/CFG/MP/BI-01-C PASS
MESH MESH/NODE/CFG/MP/BI-02-C PASS
MESH MESH/NODE/CFG/MP/BI-03-C PASS
MESH MESH/NODE/CFG/SL/BV-01-C PASS
MESH MESH/NODE/CFG/SL/BV-02-C PASS
MESH MESH/NODE/CFG/SL/BV-03-C PASS
MESH MESH/NODE/CFG/SL/BI-01-C PASS
MESH MESH/NODE/CFG/SL/BI-02-C PASS
MESH MESH/NODE/CFG/SL/BI-03-C PASS
MESH MESH/NODE/CFG/SL/BI-04-C PASS
MESH MESH/NODE/CFG/SL/BI-05-C PASS
MESH MESH/NODE/CFG/SL/BI-06-C PASS
MESH MESH/NODE/CFG/SL/BI-07-C PASS
MESH MESH/NODE/CFG/SL/BI-08-C PASS
MESH MESH/NODE/CFG/SL/BI-09-C PASS
MESH MESH/NODE/CFG/SL/BI-10-C PASS
MESH MESH/NODE/CFG/NKL/BV-01-C PASS
MESH MESH/NODE/CFG/NKL/BV-02-C PASS
MESH MESH/NODE/CFG/NKL/BV-04-C PASS
MESH MESH/NODE/CFG/NKL/BI-01-C PASS
MESH MESH/NODE/CFG/NKL/BI-02-C PASS
MESH MESH/NODE/CFG/AKL/BV-01-C PASS
MESH MESH/NODE/CFG/AKL/BV-02-C PASS
MESH MESH/NODE/CFG/AKL/BV-03-C PASS
MESH MESH/NODE/CFG/AKL/BI-01-C PASS
MESH MESH/NODE/CFG/AKL/BI-02-C PASS
MESH MESH/NODE/CFG/AKL/BI-03-C PASS
MESH MESH/NODE/CFG/AKL/BI-04-C PASS
MESH MESH/NODE/CFG/MAKL/BV-01-C PASS
MESH MESH/NODE/CFG/MAKL/BV-02-C PASS
MESH MESH/NODE/CFG/MAKL/BI-01-C PASS
MESH MESH/NODE/CFG/MAKL/BI-02-C PASS
MESH MESH/NODE/CFG/MAKL/BI-03-C PASS
MESH MESH/NODE/CFG/MAKL/BI-04-C PASS
MESH MESH/NODE/CFG/NID/BV-01-C PASS
MESH MESH/NODE/CFG/NID/BV-02-C PASS
MESH MESH/NODE/CFG/NID/BV-03-C PASS
MESH MESH/NODE/CFG/NID/BI-01-C PASS
MESH MESH/NODE/CFG/NID/BI-03-C PASS
MESH MESH/NODE/CFG/RST/BV-01-C PASS
MESH MESH/NODE/CFG/HBP/BV-01-C PASS
MESH MESH/NODE/CFG/HBP/BV-02-C PASS
MESH MESH/NODE/CFG/HBP/BV-03-C PASS
MESH MESH/NODE/CFG/HBP/BV-04-C PASS
MESH MESH/NODE/CFG/HBP/BV-05-C PASS
MESH MESH/NODE/CFG/HBP/BV-06-C PASS
MESH MESH/NODE/CFG/HBP/BV-07-C PASS
MESH MESH/NODE/CFG/HBP/BI-01-C PASS
MESH MESH/NODE/CFG/HBP/BI-02-C PASS
MESH MESH/NODE/CFG/HBS/BV-01-C PASS
MESH MESH/NODE/CFG/HBS/BV-02-C PASS
MESH MESH/NODE/CFG/HBS/BV-03-C PASS
MESH MESH/NODE/CFG/HBS/BV-04-C PASS
MESH MESH/NODE/CFG/HBS/BV-05-C PASS
MESH MESH/NODE/CFG/HBS/BI-01-C PASS
MESH MESH/NODE/CFG/NTX/BV-01-C PASS
MESH MESH/NODE/CFG/LPNPT/BI-01-C PASS
MESH MESH/SR/HM/CFS/BV-01-C PASS
MESH MESH/SR/HM/CFS/BV-02-C PASS
MESH MESH/SR/HM/RFS/BV-01-C PASS
MESH MESH/SR/HM/RFS/BV-02-C PASS
MESH MESH/SR/HM/RFS/BV-03-C PASS
MESH MESH/SR/HM/RFS/BI-01-C PASS
MESH MESH/SR/HM/RFS/BI-02-C PASS
MESH MESH/SR/HM/HPS/BV-01-C PASS
MESH MESH/SR/HM/ATS/BV-01-C PASS
SM SM/CEN/PROT/BV-01-C PASS
SM SM/CEN/JW/BV-05-C PASS
SM SM/CEN/JW/BI-04-C PASS
SM SM/CEN/JW/BI-01-C PASS
SM SM/CEN/PKE/BV-01-C PASS
SM SM/CEN/PKE/BV-04-C PASS
SM SM/CEN/PKE/BI-01-C PASS
SM SM/CEN/PKE/BI-02-C FAIL
SM SM/CEN/OOB/BV-01-C PASS
SM SM/CEN/OOB/BV-03-C PASS
SM SM/CEN/OOB/BV-09-C PASS
SM SM/CEN/OOB/BI-01-C PASS
SM SM/CEN/EKS/BV-01-C PASS
SM SM/CEN/EKS/BI-01-C PASS
SM SM/CEN/KDU/BV-04-C PASS
SM SM/CEN/KDU/BV-05-C PASS
SM SM/CEN/KDU/BV-06-C PASS
SM SM/CEN/KDU/BV-10-C PASS
SM SM/CEN/KDU/BV-11-C PASS
SM SM/CEN/KDU/BI-01-C PASS
SM SM/CEN/KDU/BI-02-C PASS
SM SM/CEN/KDU/BI-03-C PASS
SM SM/CEN/SIP/BV-02-C PASS
SM SM/CEN/SCJW/BV-01-C PASS
SM SM/CEN/SCJW/BV-04-C PASS
SM SM/CEN/SCJW/BI-01-C PASS
SM SM/CEN/SCPK/BV-01-C PASS
SM SM/CEN/SCPK/BV-04-C PASS
SM SM/CEN/SCPK/BI-01-C PASS
SM SM/CEN/SCPK/BI-02-C PASS
SM SM/CEN/SCOB/BV-01-C PASS
SM SM/CEN/SCOB/BV-04-C PASS
SM SM/CEN/SCOB/BI-01-C PASS
SM SM/CEN/SCOB/BI-04-C PASS
SM SM/PER/PROT/BV-02-C PASS
SM SM/PER/JW/BV-02-C PASS
SM SM/PER/JW/BI-03-C PASS
SM SM/PER/JW/BI-02-C PASS
SM SM/PER/PKE/BV-02-C PASS
SM SM/PER/PKE/BV-05-C PASS
SM SM/PER/PKE/BI-03-C PASS
SM SM/PER/OOB/BV-02-C PASS
SM SM/PER/OOB/BV-04-C PASS
SM SM/PER/OOB/BV-10-C PASS
SM SM/PER/OOB/BI-02-C PASS
SM SM/PER/EKS/BV-02-C PASS
SM SM/PER/EKS/BI-02-C PASS
SM SM/PER/KDU/BV-01-C PASS
SM SM/PER/KDU/BV-02-C PASS
SM SM/PER/KDU/BV-03-C PASS
SM SM/PER/KDU/BV-07-C PASS
SM SM/PER/KDU/BV-08-C PASS
SM SM/PER/KDU/BV-09-C PASS
SM SM/PER/KDU/BI-01-C PASS
SM SM/PER/KDU/BI-02-C PASS
SM SM/PER/KDU/BI-03-C PASS
SM SM/PER/SIP/BV-01-C PASS
SM SM/PER/SIE/BV-01-C PASS
SM SM/PER/SCJW/BV-02-C PASS
SM SM/PER/SCJW/BV-03-C PASS
SM SM/PER/SCJW/BI-02-C PASS
SM SM/PER/SCPK/BV-02-C PASS
SM SM/PER/SCPK/BV-03-C PASS
SM SM/PER/SCPK/BI-03-C PASS
SM SM/PER/SCPK/BI-04-C PASS
SM SM/PER/SCOB/BV-02-C PASS
SM SM/PER/SCOB/BV-03-C PASS
SM SM/PER/SCOB/BI-02-C PASS
SM SM/PER/SCOB/BI-03-C PASS
GAP GAP/BROB/BCST/BV-03-C PASS
GAP GAP/DISC/GENM/BV-03-C PASS
GAP GAP/CONN/UCON/BV-06-C PASS
GAP GAP/CONN/ACEP/BV-04-C INCONC
GAP GAP/CONN/GCEP/BV-05-C INCONC
GAP GAP/CONN/GCEP/BV-06-C INCONC
GAP GAP/CONN/DCEP/BV-05-C INCONC
GAP GAP/CONN/DCEP/BV-06-C INCONC
GAP GAP/PRIV/CONN/BV-10-C PASS
GAP GAP/PRIV/CONN/BV-11-C PASS
GAP GAP/SEC/SEM/BV-21-C PASS
GAP GAP/SEC/SEM/BV-22-C PASS
GAP GAP/SEC/SEM/BV-24-C PASS
GAP GAP/SEC/SEM/BV-26-C PASS
GAP GAP/SEC/SEM/BV-27-C PASS
GAP GAP/SEC/SEM/BV-28-C PASS
GAP GAP/SEC/SEM/BV-29-C PASS
GAP GAP/SEC/SEM/BV-37-C PASS
GAP GAP/SEC/SEM/BV-39-C PASS
GAP GAP/SEC/SEM/BV-41-C PASS
GAP GAP/SEC/SEM/BV-43-C PASS
GAP GAP/SEC/SEM/BV-38-C PASS
GAP GAP/SEC/SEM/BV-40-C PASS
GAP GAP/SEC/SEM/BV-42-C PASS
GAP GAP/SEC/SEM/BV-44-C PASS
GAP GAP/SEC/SEM/BV-23-C PASS
GAP GAP/SEC/SEM/BI-09-C PASS
GAP GAP/SEC/SEM/BI-10-C PASS
GAP GAP/SEC/SEM/BI-20-C PASS
GAP GAP/SEC/SEM/BI-21-C PASS
GAP GAP/SEC/SEM/BI-22-C PASS
GAP GAP/SEC/SEM/BI-23-C PASS
GAP GAP/BROB/BCST/BV-04-C PASS
MESH MESH/NODE/CFG/NKL/BI-03-C FAIL
GAP GAP/CONN/CPUP/BV-06-C INCONC
L2CAP L2CAP/LE/CPU/BV-01-C PASS

Status of tests with no PASS verdicts are:

  • Passing with use of LE dongle:
    • GAP/CONN/ACEP/BV-03-C
    • GAP/CONN/SCEP/BV-03-C
    • GAP/CONN/SCEP/BV-03-C
    • GAP/CONN/SCEP/BV-03-C
    • GAP/CONN/ACEP/BV-04-C
    • GAP/CONN/GCEP/BV-05-C
    • GAP/CONN/GCEP/BV-06-C
    • GAP/CONN/DCEP/BV-05-C
    • GAP/CONN/DCEP/BV-05-C
    • GAP/CONN/CPUP/BV-06-C
  • Errata:
    • GAP/CONN/ACEP/BV-01-C CASE0072061
    • GAP/CONN/GCEP/BV-01-C CASE0072061
    • GAP/CONN/SCEP/BV-01-C CASE0072061
    • GAP/CONN/DCEP/BV-01-C CASE0072061
    • L2CAP/LE/CFC/BV-29-C CASE0071766
    • L2CAP/ECFC/BV-24-C TSE14759 (TCW1333)
    • L2CAP/ECFC/BV-38-C TSE17458
    • GAP/SEC/AUT/BV-25-C CASE0072001
    • GAP/SEC/AUT/BV-27-C CASE0072001
  • Passing with additional fixes (updated ones from previous comment)
    • GAP/CONN/SCEP/BV-01-C
    • GAP/CONN/PRDA/BV-02-C
    • GAP/SEC/AUT/BV-17-C
    • GAP/SEC/AUT/BV-19-C CASE0072154 + https://github.com/intel/auto-pts/pull/657/
    • MESH/NODE/CFG/NKL/BI-03-C

KKopyscinski avatar Nov 29 '21 06:11 KKopyscinski

I think we should just assume that LE dongles are used for LE testing from no on (ie don't care if test is failing on old dual mode dongle)

sjanc avatar Nov 29 '21 11:11 sjanc