interop
interop copied to clipboard
web-platform-tests
[Post-facto] Many changes to IndexedDB tests
Test List
/IndexedDB/abort-in-initial-upgradeneeded.html /IndexedDB/bigint_value.htm /IndexedDB/bindings-inject-keys-bypass-setters.html /IndexedDB/bindings-inject-values-bypass-chain.html /IndexedDB/bindings-inject-values-bypass-setters.html /IndexedDB/clone-before-keypath-eval.html /IndexedDB/close-in-upgradeneeded.html /IndexedDB/cursor-overloads.htm /IndexedDB/delete-request-queue.html /IndexedDB/error-attributes.html /IndexedDB/event-dispatch-active-flag.html /IndexedDB/fire-error-event-exception.html /IndexedDB/fire-success-event-exception.html /IndexedDB/fire-upgradeneeded-event-exception.html /IndexedDB/globalscope-indexedDB-SameObject.html /IndexedDB/historical.html /IndexedDB/idb-binary-key-detached.htm /IndexedDB/idb-binary-key-roundtrip.htm /IndexedDB/idb_binary_key_conversion.htm /IndexedDB/idbcursor-advance-continue-async.htm /IndexedDB/idbcursor-advance-exception-order.html /IndexedDB/idbcursor-advance-invalid.htm /IndexedDB/idbcursor-advance.htm /IndexedDB/idbcursor-continue-exception-order.htm /IndexedDB/idbcursor-continue.htm /IndexedDB/idbcursor-continuePrimaryKey.htm /IndexedDB/idbcursor-delete-exception-order.htm /IndexedDB/idbcursor-direction-index-keyrange.htm /IndexedDB/idbcursor-direction-index.htm /IndexedDB/idbcursor-direction-objectstore-keyrange.htm /IndexedDB/idbcursor-direction-objectstore.htm /IndexedDB/idbcursor-direction.htm /IndexedDB/idbcursor-iterating-update.htm /IndexedDB/idbcursor-key.htm /IndexedDB/idbcursor-primarykey.htm /IndexedDB/idbcursor-request-source.html /IndexedDB/idbcursor-reused.htm /IndexedDB/idbcursor-source.htm /IndexedDB/idbcursor-update-exception-order.htm /IndexedDB/idbcursor_advance_index.htm /IndexedDB/idbcursor_advance_index2.htm /IndexedDB/idbcursor_advance_index3.htm /IndexedDB/idbcursor_advance_index5.htm /IndexedDB/idbcursor_advance_index6.htm /IndexedDB/idbcursor_advance_index7.htm /IndexedDB/idbcursor_advance_index8.htm /IndexedDB/idbcursor_advance_index9.htm /IndexedDB/idbcursor_advance_objectstore.htm /IndexedDB/idbcursor_advance_objectstore2.htm /IndexedDB/idbcursor_advance_objectstore3.htm /IndexedDB/idbcursor_advance_objectstore4.htm /IndexedDB/idbcursor_advance_objectstore5.htm /IndexedDB/idbcursor_continue_delete_objectstore.htm /IndexedDB/idbcursor_continue_index.htm /IndexedDB/idbcursor_continue_index2.htm /IndexedDB/idbcursor_continue_index3.htm /IndexedDB/idbcursor_continue_index4.htm /IndexedDB/idbcursor_continue_index5.htm /IndexedDB/idbcursor_continue_index6.htm /IndexedDB/idbcursor_continue_index7.htm /IndexedDB/idbcursor_continue_index8.htm /IndexedDB/idbcursor_continue_invalid.htm /IndexedDB/idbcursor_continue_objectstore.htm /IndexedDB/idbcursor_continue_objectstore2.htm /IndexedDB/idbcursor_continue_objectstore3.htm /IndexedDB/idbcursor_continue_objectstore4.htm /IndexedDB/idbcursor_continue_objectstore5.htm /IndexedDB/idbcursor_continue_objectstore6.htm /IndexedDB/idbcursor_delete_index.htm /IndexedDB/idbcursor_delete_index2.htm /IndexedDB/idbcursor_delete_index3.htm /IndexedDB/idbcursor_delete_index4.htm /IndexedDB/idbcursor_delete_index5.htm /IndexedDB/idbcursor_delete_objectstore.htm /IndexedDB/idbcursor_delete_objectstore2.htm /IndexedDB/idbcursor_delete_objectstore3.htm /IndexedDB/idbcursor_delete_objectstore4.htm /IndexedDB/idbcursor_delete_objectstore5.htm /IndexedDB/idbcursor_iterating.htm /IndexedDB/idbcursor_iterating_index.htm /IndexedDB/idbcursor_iterating_index2.htm /IndexedDB/idbcursor_iterating_objectstore.htm /IndexedDB/idbcursor_iterating_objectstore2.htm /IndexedDB/idbcursor_update_index.htm /IndexedDB/idbcursor_update_index2.htm /IndexedDB/idbcursor_update_index3.htm /IndexedDB/idbcursor_update_index4.htm /IndexedDB/idbcursor_update_index5.htm /IndexedDB/idbcursor_update_index6.htm /IndexedDB/idbcursor_update_index7.htm /IndexedDB/idbcursor_update_index8.htm /IndexedDB/idbcursor_update_objectstore.htm /IndexedDB/idbcursor_update_objectstore2.htm /IndexedDB/idbcursor_update_objectstore3.htm /IndexedDB/idbcursor_update_objectstore4.htm /IndexedDB/idbcursor_update_objectstore5.htm /IndexedDB/idbcursor_update_objectstore6.htm /IndexedDB/idbcursor_update_objectstore7.htm /IndexedDB/idbcursor_update_objectstore8.htm /IndexedDB/idbcursor_update_objectstore9.htm /IndexedDB/idbdatabase_createObjectStore-createIndex-emptyname.htm /IndexedDB/idbdatabase_createObjectStore.htm /IndexedDB/idbdatabase_createObjectStore10-1000ends.htm /IndexedDB/idbdatabase_createObjectStore10-emptyname.htm /IndexedDB/idbdatabase_createObjectStore11.htm /IndexedDB/idbdatabase_createObjectStore2.htm /IndexedDB/idbdatabase_createObjectStore3.htm /IndexedDB/idbdatabase_createObjectStore4.htm /IndexedDB/idbdatabase_createObjectStore5.htm /IndexedDB/idbdatabase_createObjectStore6.htm /IndexedDB/idbdatabase_createObjectStore7.htm /IndexedDB/idbdatabase_createObjectStore8-parameters.htm /IndexedDB/idbdatabase_createObjectStore9-invalidparameters.htm /IndexedDB/idbdatabase_deleteObjectStore.htm /IndexedDB/idbdatabase_deleteObjectStore3.htm /IndexedDB/idbdatabase_deleteObjectStore4-not_reused.htm /IndexedDB/idbdatabase_transaction.htm /IndexedDB/idbdatabase_transaction2.htm /IndexedDB/idbdatabase_transaction3.htm /IndexedDB/idbdatabase_transaction4.htm /IndexedDB/idbdatabase_transaction5.htm /IndexedDB/idbfactory-origin-isolation.html /IndexedDB/idbfactory_cmp.htm /IndexedDB/idbfactory_cmp2.htm /IndexedDB/idbfactory_cmp3.htm /IndexedDB/idbfactory_cmp4.htm /IndexedDB/idbfactory_deleteDatabase.htm /IndexedDB/idbfactory_deleteDatabase2.htm /IndexedDB/idbfactory_deleteDatabase3.htm /IndexedDB/idbfactory_deleteDatabase4.htm /IndexedDB/idbfactory_open.htm /IndexedDB/idbfactory_open10.htm /IndexedDB/idbfactory_open11.htm /IndexedDB/idbfactory_open12.htm /IndexedDB/idbfactory_open2.htm /IndexedDB/idbfactory_open3.htm /IndexedDB/idbfactory_open4.htm /IndexedDB/idbfactory_open5.htm /IndexedDB/idbfactory_open6.htm /IndexedDB/idbfactory_open7.htm /IndexedDB/idbfactory_open8.htm /IndexedDB/idbfactory_open9.htm /IndexedDB/idbindex-cross-realm-methods.html /IndexedDB/idbindex-getAll-enforcerange.html /IndexedDB/idbindex-getAllKeys-enforcerange.html /IndexedDB/idbindex-multientry-arraykeypath.htm /IndexedDB/idbindex-multientry-big.htm /IndexedDB/idbindex-multientry.htm /IndexedDB/idbindex-objectStore-SameObject.html /IndexedDB/idbindex-query-exception-order.html /IndexedDB/idbindex-rename-abort.html /IndexedDB/idbindex-rename-errors.html /IndexedDB/idbindex-rename.html /IndexedDB/idbindex-request-source.html /IndexedDB/idbindex_count.htm /IndexedDB/idbindex_count2.htm /IndexedDB/idbindex_count3.htm /IndexedDB/idbindex_count4.htm /IndexedDB/idbindex_get.htm /IndexedDB/idbindex_get2.htm /IndexedDB/idbindex_get3.htm /IndexedDB/idbindex_get4.htm /IndexedDB/idbindex_get5.htm /IndexedDB/idbindex_get6.htm /IndexedDB/idbindex_get7.htm /IndexedDB/idbindex_get8.htm /IndexedDB/idbindex_getAll.html /IndexedDB/idbindex_getAllKeys.html /IndexedDB/idbindex_getKey.htm /IndexedDB/idbindex_getKey2.htm /IndexedDB/idbindex_getKey3.htm /IndexedDB/idbindex_getKey4.htm /IndexedDB/idbindex_getKey5.htm /IndexedDB/idbindex_getKey6.htm /IndexedDB/idbindex_getKey7.htm /IndexedDB/idbindex_getKey8.htm /IndexedDB/idbindex_indexNames.htm /IndexedDB/idbindex_openCursor.htm /IndexedDB/idbindex_openCursor2.htm /IndexedDB/idbindex_openCursor3.htm /IndexedDB/idbindex_openKeyCursor.htm /IndexedDB/idbindex_openKeyCursor2.htm /IndexedDB/idbindex_openKeyCursor3.htm /IndexedDB/idbindex_openKeyCursor4.htm /IndexedDB/idbobjectstore-add-put-exception-order.html /IndexedDB/idbobjectstore-clear-exception-order.html /IndexedDB/idbobjectstore-cross-realm-methods.html /IndexedDB/idbobjectstore-delete-exception-order.html /IndexedDB/idbobjectstore-deleteIndex-exception-order.html /IndexedDB/idbobjectstore-getAll-enforcerange.html /IndexedDB/idbobjectstore-getAllKeys-enforcerange.html /IndexedDB/idbobjectstore-index-finished.html /IndexedDB/idbobjectstore-query-exception-order.html /IndexedDB/idbobjectstore-rename-abort.html /IndexedDB/idbobjectstore-rename-errors.html /IndexedDB/idbobjectstore-rename-store.html /IndexedDB/idbobjectstore-request-source.html /IndexedDB/idbobjectstore-transaction-SameObject.html /IndexedDB/idbobjectstore_add.htm /IndexedDB/idbobjectstore_add10.htm /IndexedDB/idbobjectstore_add11.htm /IndexedDB/idbobjectstore_add12.htm /IndexedDB/idbobjectstore_add13.htm /IndexedDB/idbobjectstore_add14.htm /IndexedDB/idbobjectstore_add15.htm /IndexedDB/idbobjectstore_add16.htm /IndexedDB/idbobjectstore_add2.htm /IndexedDB/idbobjectstore_add3.htm /IndexedDB/idbobjectstore_add4.htm /IndexedDB/idbobjectstore_add5.htm /IndexedDB/idbobjectstore_add6.htm /IndexedDB/idbobjectstore_add7.htm /IndexedDB/idbobjectstore_add8.htm /IndexedDB/idbobjectstore_add9.htm /IndexedDB/idbobjectstore_clear.htm /IndexedDB/idbobjectstore_clear2.htm /IndexedDB/idbobjectstore_clear3.htm /IndexedDB/idbobjectstore_clear4.htm /IndexedDB/idbobjectstore_count.htm /IndexedDB/idbobjectstore_count2.htm /IndexedDB/idbobjectstore_count3.htm /IndexedDB/idbobjectstore_count4.htm /IndexedDB/idbobjectstore_createIndex.htm /IndexedDB/idbobjectstore_createIndex10.htm /IndexedDB/idbobjectstore_createIndex11.htm /IndexedDB/idbobjectstore_createIndex12.htm /IndexedDB/idbobjectstore_createIndex13.htm /IndexedDB/idbobjectstore_createIndex14-exception_order.htm /IndexedDB/idbobjectstore_createIndex15-autoincrement.htm /IndexedDB/idbobjectstore_createIndex2.htm /IndexedDB/idbobjectstore_createIndex3-usable-right-away.htm /IndexedDB/idbobjectstore_createIndex4-deleteIndex-event_order.htm /IndexedDB/idbobjectstore_createIndex5-emptykeypath.htm /IndexedDB/idbobjectstore_createIndex6-event_order.htm /IndexedDB/idbobjectstore_createIndex7-event_order.htm /IndexedDB/idbobjectstore_createIndex8-valid_keys.htm /IndexedDB/idbobjectstore_createIndex9-emptyname.htm /IndexedDB/idbobjectstore_delete.htm /IndexedDB/idbobjectstore_delete2.htm /IndexedDB/idbobjectstore_delete3.htm /IndexedDB/idbobjectstore_delete4.htm /IndexedDB/idbobjectstore_delete5.htm /IndexedDB/idbobjectstore_delete6.htm /IndexedDB/idbobjectstore_delete7.htm /IndexedDB/idbobjectstore_deleteIndex.htm /IndexedDB/idbobjectstore_deleted.htm /IndexedDB/idbobjectstore_index.htm /IndexedDB/idbobjectstore_openCursor.htm /IndexedDB/idbobjectstore_openCursor_invalid.htm /IndexedDB/idbobjectstore_openKeyCursor.htm /IndexedDB/idbobjectstore_put.htm /IndexedDB/idbobjectstore_put10.htm /IndexedDB/idbobjectstore_put11.htm /IndexedDB/idbobjectstore_put12.htm /IndexedDB/idbobjectstore_put13.htm /IndexedDB/idbobjectstore_put14.htm /IndexedDB/idbobjectstore_put15.htm /IndexedDB/idbobjectstore_put16.htm /IndexedDB/idbobjectstore_put2.htm /IndexedDB/idbobjectstore_put3.htm /IndexedDB/idbobjectstore_put4.htm /IndexedDB/idbobjectstore_put5.htm /IndexedDB/idbobjectstore_put6.htm /IndexedDB/idbobjectstore_put7.htm /IndexedDB/idbobjectstore_put8.htm /IndexedDB/idbobjectstore_put9.htm /IndexedDB/idbrequest-onupgradeneeded.htm /IndexedDB/idbrequest_error.html /IndexedDB/idbrequest_result.html /IndexedDB/idbtransaction-db-SameObject.html /IndexedDB/idbtransaction-objectStore-exception-order.html /IndexedDB/idbtransaction-objectStore-finished.html /IndexedDB/idbtransaction-oncomplete.htm /IndexedDB/idbtransaction.htm /IndexedDB/idbtransaction_abort.htm /IndexedDB/idbtransaction_objectStoreNames.html /IndexedDB/idbversionchangeevent.htm /IndexedDB/index_sort_order.htm /IndexedDB/interleaved-cursors-large.html /IndexedDB/interleaved-cursors-small.html /IndexedDB/key_valid.html /IndexedDB/keygenerator-constrainterror.htm /IndexedDB/keygenerator-explicit.html /IndexedDB/keygenerator-inject.html /IndexedDB/keygenerator-overflow.htm /IndexedDB/keygenerator.htm /IndexedDB/keypath-exceptions.htm /IndexedDB/keypath-special-identifiers.htm /IndexedDB/keypath.htm /IndexedDB/keypath_invalid.htm /IndexedDB/keypath_maxsize.htm /IndexedDB/large-requests-abort.html /IndexedDB/list_ordering.htm /IndexedDB/name-scopes.html /IndexedDB/nested-cloning-basic.html /IndexedDB/nested-cloning-large-multiple.html /IndexedDB/nested-cloning-large.html /IndexedDB/nested-cloning-small.html /IndexedDB/objectstore_keyorder.htm /IndexedDB/open-request-queue.html /IndexedDB/parallel-cursors-upgrade.html /IndexedDB/ready-state-destroyed-execution-context.html /IndexedDB/request-abort-ordering.html /IndexedDB/request-event-ordering.html /IndexedDB/request_bubble-and-capture.htm /IndexedDB/serialize-sharedarraybuffer-throws.https.html /IndexedDB/string-list-ordering.htm /IndexedDB/transaction-abort-generator-revert.html /IndexedDB/transaction-abort-index-metadata-revert.html /IndexedDB/transaction-abort-multiple-metadata-revert.html /IndexedDB/transaction-abort-object-store-metadata-revert.html /IndexedDB/transaction-abort-request-error.html /IndexedDB/transaction-create_in_versionchange.htm /IndexedDB/transaction-deactivation-timing.html /IndexedDB/transaction-lifetime-blocked.htm /IndexedDB/transaction-lifetime-empty.html /IndexedDB/transaction-lifetime.htm /IndexedDB/transaction-requestqueue.htm /IndexedDB/transaction_bubble-and-capture.htm /IndexedDB/upgrade-transaction-deactivation-timing.html /IndexedDB/upgrade-transaction-lifecycle-backend-aborted.html /IndexedDB/upgrade-transaction-lifecycle-committed.html /IndexedDB/upgrade-transaction-lifecycle-user-aborted.html /IndexedDB/value.htm /IndexedDB/value_recursive.htm /IndexedDB/writer-starvation.htm
Rationale
There have been a large number of changes to IndexedDB tests, especially in the last few months, which has impacted Interop 2024 scores:
https://github.com/web-platform-tests/wpt/commit/ebccc9d428 (2025-02-04, https://github.com/web-platform-tests/wpt/pull/50506) https://github.com/web-platform-tests/wpt/commit/0d6926290b (2025-02-04, https://github.com/web-platform-tests/wpt/pull/50505) https://github.com/web-platform-tests/wpt/commit/3bec105e13 (2025-02-04, https://github.com/web-platform-tests/wpt/pull/50504) https://github.com/web-platform-tests/wpt/commit/9535feafce (2025-02-04, https://github.com/web-platform-tests/wpt/pull/50503) https://github.com/web-platform-tests/wpt/commit/c82056c890 (2025-02-04, https://github.com/web-platform-tests/wpt/pull/50490) https://github.com/web-platform-tests/wpt/commit/792e6b89d1 (2025-02-03, https://github.com/web-platform-tests/wpt/pull/50470) https://github.com/web-platform-tests/wpt/commit/c3a6f612e3 (2025-02-03, https://github.com/web-platform-tests/wpt/pull/50435) https://github.com/web-platform-tests/wpt/commit/92eefefb1d (2025-01-31, https://github.com/web-platform-tests/wpt/pull/50423) https://github.com/web-platform-tests/wpt/commit/34c4d1cdc8 (2025-01-30, https://github.com/web-platform-tests/wpt/pull/50398) https://github.com/web-platform-tests/wpt/commit/9c8557be55 (2025-01-30, https://github.com/web-platform-tests/wpt/pull/50382) https://github.com/web-platform-tests/wpt/commit/7eb87d2740 (2025-01-29, https://github.com/web-platform-tests/wpt/pull/50381) https://github.com/web-platform-tests/wpt/commit/402df6903f (2025-01-29, https://github.com/web-platform-tests/wpt/pull/50380) https://github.com/web-platform-tests/wpt/commit/318f66d1f4 (2025-01-28, https://github.com/web-platform-tests/wpt/pull/50361) https://github.com/web-platform-tests/wpt/commit/5753f6c478 (2025-01-22, https://github.com/web-platform-tests/wpt/pull/50229) https://github.com/web-platform-tests/wpt/commit/19b2aac226 (2025-01-22, https://github.com/web-platform-tests/wpt/pull/50230) https://github.com/web-platform-tests/wpt/commit/719c62bf03 (2025-01-21, https://github.com/web-platform-tests/wpt/pull/50206) https://github.com/web-platform-tests/wpt/commit/b0074f39f7 (2025-01-21, https://github.com/web-platform-tests/wpt/pull/50205) https://github.com/web-platform-tests/wpt/commit/55e0dc1903 (2025-01-19, https://github.com/web-platform-tests/wpt/pull/50168) https://github.com/web-platform-tests/wpt/commit/ca924f858f (2025-01-15, https://github.com/web-platform-tests/wpt/pull/50104) https://github.com/web-platform-tests/wpt/commit/a93700267a (2025-01-15, https://github.com/web-platform-tests/wpt/pull/50105) https://github.com/web-platform-tests/wpt/commit/7f4566f7a3 (2025-01-15, https://github.com/web-platform-tests/wpt/pull/50106) https://github.com/web-platform-tests/wpt/commit/a6d816a2c2 (2025-01-14, https://github.com/web-platform-tests/wpt/pull/50037) https://github.com/web-platform-tests/wpt/commit/acb6ee3523 (2025-01-09, https://github.com/web-platform-tests/wpt/pull/50013) https://github.com/web-platform-tests/wpt/commit/6680e5386a (2025-01-09, https://github.com/web-platform-tests/wpt/pull/49253) https://github.com/web-platform-tests/wpt/commit/b28af7109b (2025-01-03, https://github.com/web-platform-tests/wpt/pull/49908) https://github.com/web-platform-tests/wpt/commit/399a44ab6e (2024-12-17, https://github.com/web-platform-tests/wpt/pull/49724) https://github.com/web-platform-tests/wpt/commit/5b30d15296 (2024-12-16, https://github.com/web-platform-tests/wpt/pull/49712) https://github.com/web-platform-tests/wpt/commit/3f6bcb30dc (2024-12-12, https://github.com/web-platform-tests/wpt/pull/49669) https://github.com/web-platform-tests/wpt/commit/ea5f9829b2 (2024-11-20, https://github.com/web-platform-tests/wpt/pull/49295) https://github.com/web-platform-tests/wpt/commit/58e4c50fb7 (2024-11-19, https://github.com/web-platform-tests/wpt/pull/49269) https://github.com/web-platform-tests/wpt/commit/9a1f194b93 (2024-10-17, https://github.com/web-platform-tests/wpt/pull/48686) https://github.com/web-platform-tests/wpt/commit/477be4a284 (2024-10-16, https://github.com/web-platform-tests/wpt/pull/48629) https://github.com/web-platform-tests/wpt/commit/c4de27055b (2024-10-10, https://github.com/web-platform-tests/wpt/pull/48567) https://github.com/web-platform-tests/wpt/commit/d536d5f30c (2024-09-12, https://github.com/web-platform-tests/wpt/pull/48132) https://github.com/web-platform-tests/wpt/commit/d35f9879ca (2024-09-11, https://github.com/web-platform-tests/wpt/pull/48105) https://github.com/web-platform-tests/wpt/commit/1998d1ee55 (2024-09-05, https://github.com/web-platform-tests/wpt/pull/47990) https://github.com/web-platform-tests/wpt/commit/d93d2f2b4b (2024-09-05, https://github.com/web-platform-tests/wpt/pull/47978) https://github.com/web-platform-tests/wpt/commit/686cf3e6bf (2024-08-30, https://github.com/web-platform-tests/wpt/pull/47866) https://github.com/web-platform-tests/wpt/commit/8bfdfee78a (2024-08-22, https://github.com/web-platform-tests/wpt/pull/47745) https://github.com/web-platform-tests/wpt/commit/0c217f2bf3 (2024-08-15, https://github.com/web-platform-tests/wpt/pull/47633) https://github.com/web-platform-tests/wpt/commit/d8271a5329 (2024-08-13, https://github.com/web-platform-tests/wpt/pull/47597) https://github.com/web-platform-tests/wpt/commit/fee8ca2d5f (2024-08-07, https://github.com/web-platform-tests/wpt/pull/47517) https://github.com/web-platform-tests/wpt/commit/22fbdfb026 (2024-08-05, https://github.com/web-platform-tests/wpt/pull/47466) https://github.com/web-platform-tests/wpt/commit/25ab53bff7 (2024-08-01, https://github.com/web-platform-tests/wpt/pull/47391) https://github.com/web-platform-tests/wpt/commit/bc4ee2a313 (2024-07-24, https://github.com/web-platform-tests/wpt/pull/47280) https://github.com/web-platform-tests/wpt/commit/61a0206ad3 (2024-07-03, https://github.com/web-platform-tests/wpt/pull/46994) https://github.com/web-platform-tests/wpt/commit/8607a1df68 (2024-07-03, https://github.com/web-platform-tests/wpt/pull/46990) https://github.com/web-platform-tests/wpt/commit/dc11890f5e (2024-07-02, https://github.com/web-platform-tests/wpt/pull/46970) https://github.com/web-platform-tests/wpt/commit/564cd562b3 (2024-07-01, https://github.com/web-platform-tests/wpt/pull/46955) https://github.com/web-platform-tests/wpt/commit/b2dab79f18 (2024-06-27, https://github.com/web-platform-tests/wpt/pull/46927) https://github.com/web-platform-tests/wpt/commit/4298bb7fb5 (2024-06-25, https://github.com/web-platform-tests/wpt/pull/46896) https://github.com/web-platform-tests/wpt/commit/1b7e0b25e6 (2024-06-12, https://github.com/web-platform-tests/wpt/pull/46696) https://github.com/web-platform-tests/wpt/commit/2f355a6b58 (2024-06-07, https://github.com/web-platform-tests/wpt/pull/46650) https://github.com/web-platform-tests/wpt/commit/fd2e974a4f (2024-05-28, https://github.com/web-platform-tests/wpt/pull/46515) https://github.com/web-platform-tests/wpt/commit/18f1bd877a (2024-05-09, https://github.com/web-platform-tests/wpt/pull/46165) https://github.com/web-platform-tests/wpt/commit/4a4aa9d2ef (2024-05-01, https://github.com/web-platform-tests/wpt/pull/45913) https://github.com/web-platform-tests/wpt/commit/5aa50dd415 (2024-04-08, https://github.com/web-platform-tests/wpt/pull/45483) https://github.com/web-platform-tests/wpt/commit/1849930aff (2024-03-26, https://github.com/web-platform-tests/wpt/pull/45303) https://github.com/web-platform-tests/wpt/commit/88149528a9 (2024-03-21, https://github.com/web-platform-tests/wpt/pull/45098) https://github.com/web-platform-tests/wpt/commit/25f2898ab0 (2024-03-11, https://github.com/web-platform-tests/wpt/pull/44999) https://github.com/web-platform-tests/wpt/commit/14d73a79a3 (2024-03-03, https://github.com/web-platform-tests/wpt/pull/44686) https://github.com/web-platform-tests/wpt/commit/695af8663f (2024-03-01, https://github.com/web-platform-tests/wpt/pull/44766) https://github.com/web-platform-tests/wpt/commit/3cc0431fcf (2024-02-27, https://github.com/web-platform-tests/wpt/pull/44690) https://github.com/web-platform-tests/wpt/commit/0b85a2f742 (2024-02-22, https://github.com/web-platform-tests/wpt/pull/44693)
None of these changes have had Test Change Proposals: https://github.com/web-platform-tests/interop/issues?q=is%3Aissue%20indexeddb%20created%3A2024-02-01..2025-02-05%20label%3A%22focus%20area%3A%20IndexedDB%22%20label%3Atest-change-proposal
Various people (@DanielRyanSmith, @jgraham, @KyleJu, @past, @foolip, and @nt1m) have valiantly tried to keep the metadata accurate throughout the year: https://github.com/web-platform-tests/wpt-metadata/commit/65f7fe06, https://github.com/web-platform-tests/wpt-metadata/commit/abce3f37, https://github.com/web-platform-tests/wpt-metadata/commit/9b50d391, https://github.com/web-platform-tests/wpt-metadata/commit/c9f24924, https://github.com/web-platform-tests/wpt-metadata/commit/7032968f, https://github.com/web-platform-tests/wpt-metadata/commit/bf880ccb, https://github.com/web-platform-tests/wpt-metadata/commit/d7430286, https://github.com/web-platform-tests/wpt-metadata/commit/5ef35acc, but this definitely hasn't led to the same tests being in Interop 2024 at the end as at the start — which should absolutely be the case with no Test Change Proposals.
58 out of these 64 changes have been authored by people with microsoft.com emails, thus, fairly, the majority of the work of keeping the metadata up-to-date should be on them and their colleagues.
For example, the oldest of these commits, https://github.com/web-platform-tests/wpt/commit/0b85a2f742 refactored/renamed /IndexedDB/idbobjectstore_add* and since the metadata update removed the now removed tests in https://github.com/web-platform-tests/wpt-metadata/commit/668a28b2c11b5dbf8650e20c8dfd56c09b0529fe, these tests have not been part of Interop 2024.
There's other examples of tests which are now a larger percentage of the focus area than they were in the start of the year; for example https://github.com/web-platform-tests/wpt/commit/9a1f194b93 converted more tests to be run in multiple scopes, and when re-added to Interop, all variants were added: https://github.com/web-platform-tests/wpt-metadata/commit/abce3f37.
This is, of course, without even looking tests which have merely changed, rather than also being renamed.
I think at this point for Interop 2024 we just need to make the best of the situation we're in, which means trying to make the test set match what it was at the start of 2025, and hoping that the worker refactorings haven't substantially changed the results.
Going forward the only plausible option I can think of is adding automation that detects changes to an Interop test and requires additional manual review from some group, along with a checklist of requirements. We've been putting that off for a couple of years, but I think this situation has shown it's not viable to keep doing so.
Thanks for digging up all of the history, @gsnedders! I looked at a single case in https://github.com/web-platform-tests/wpt-metadata/pull/7209 but didn't know it was one of many. In that case, I said:
Since only the window variant was initially labeled, labeling only that one still makes sense.
I think I stand by this as a more general principle, for any tests that were changed from window-only to .any.js tests, our default action should be to label only the .any.html (window) variant.
Since there's been so much activity, I think it would make sense to find the test list as it initially was, and work through any delta to the current list.
The original labeling was done all in one go in https://github.com/web-platform-tests/wpt-metadata/pull/5478. After https://github.com/web-platform-tests/wpt-metadata/pull/7235 the (constructed with tmp files) diff is:
--- idb-orig.yml 2025-02-06 15:05:48
+++ idb-new.yml 2025-02-06 15:07:57
@@ -1,13 +1,8 @@
links:
- label: interop-2024-indexeddb
results:
- - test: abort-in-initial-upgradeneeded.html
- test: back-forward-cache-open-connection.window.html
- test: back-forward-cache-open-transaction.window.html
- - test: bigint_value.htm
- - test: bindings-inject-keys-bypass-setters.html
- - test: bindings-inject-values-bypass-chain.html
- - test: bindings-inject-values-bypass-setters.html
- test: blob-composite-blob-reads.any.html
- test: blob-composite-blob-reads.any.worker.html
- test: blob-contenttype.any.html
@@ -18,109 +13,55 @@
- test: blob-valid-after-deletion.any.worker.html
- test: blob-valid-before-commit.any.html
- test: blob-valid-before-commit.any.worker.html
- - test: clone-before-keypath-eval.html
- - test: close-in-upgradeneeded.html
- - test: cursor-overloads.htm
- test: database-names-by-origin.html
- test: delete-range.any.html
- test: delete-range.any.worker.html
- - test: delete-request-queue.html
- - test: error-attributes.html
- - test: event-dispatch-active-flag.html
+ - test: event-dispatch-active-flag.any.html
+ - test: event-dispatch-active-flag.any.worker.html
- test: file_support.sub.html
- - test: fire-error-event-exception.html
- - test: fire-success-event-exception.html
- - test: fire-upgradeneeded-event-exception.html
+ - test: fire-error-event-exception.any.html
+ - test: fire-error-event-exception.any.serviceworker.html
+ - test: fire-error-event-exception.any.sharedworker.html
+ - test: fire-error-event-exception.any.worker.html
+ - test: fire-success-event-exception.any.html
+ - test: fire-success-event-exception.any.serviceworker.html
+ - test: fire-success-event-exception.any.sharedworker.html
+ - test: fire-success-event-exception.any.worker.html
+ - test: fire-upgradeneeded-event-exception.any.html
+ - test: fire-upgradeneeded-event-exception.any.serviceworker.html
+ - test: fire-upgradeneeded-event-exception.any.sharedworker.html
+ - test: fire-upgradeneeded-event-exception.any.worker.html
- test: get-databases.any.html
- test: get-databases.any.worker.html
- - test: globalscope-indexedDB-SameObject.html
- - test: historical.html
- - test: idb_binary_key_conversion.htm
+ - test: globalscope-indexedDB-SameObject.any.html
+ - test: globalscope-indexedDB-SameObject.any.serviceworker.html
+ - test: globalscope-indexedDB-SameObject.any.sharedworker.html
+ - test: globalscope-indexedDB-SameObject.any.worker.html
+ - test: historical.any.html
+ - test: historical.any.serviceworker.html
+ - test: historical.any.sharedworker.html
+ - test: historical.any.worker.html
+ - test: idb_binary_key_conversion.any.html
+ - test: idb_binary_key_conversion.any.serviceworker.html
+ - test: idb_binary_key_conversion.any.sharedworker.html
+ - test: idb_binary_key_conversion.any.worker.html
- test: idb_webworkers.htm
- test: idb-binary-key-detached.htm
- - test: idb-binary-key-roundtrip.htm
+ - test: idb-binary-key-roundtrip.any.html
- test: idb-explicit-commit-throw.any.html
- test: idb-explicit-commit-throw.any.worker.html
- test: idb-explicit-commit.any.html
- test: idb-explicit-commit.any.worker.html
- - test: idbcursor_advance_index.htm
- - test: idbcursor_advance_index2.htm
- - test: idbcursor_advance_index3.htm
- - test: idbcursor_advance_index5.htm
- - test: idbcursor_advance_index6.htm
- - test: idbcursor_advance_index7.htm
- - test: idbcursor_advance_index8.htm
- - test: idbcursor_advance_index9.htm
- - test: idbcursor_advance_objectstore.htm
- - test: idbcursor_advance_objectstore2.htm
- - test: idbcursor_advance_objectstore3.htm
- - test: idbcursor_advance_objectstore4.htm
- - test: idbcursor_advance_objectstore5.htm
- - test: idbcursor_continue_delete_objectstore.htm
- - test: idbcursor_continue_index.htm
- - test: idbcursor_continue_index2.htm
- - test: idbcursor_continue_index3.htm
- - test: idbcursor_continue_index4.htm
- - test: idbcursor_continue_index5.htm
- - test: idbcursor_continue_index6.htm
- - test: idbcursor_continue_index7.htm
- - test: idbcursor_continue_index8.htm
- - test: idbcursor_continue_invalid.htm
- - test: idbcursor_continue_objectstore.htm
- - test: idbcursor_continue_objectstore2.htm
- - test: idbcursor_continue_objectstore3.htm
- - test: idbcursor_continue_objectstore4.htm
- - test: idbcursor_continue_objectstore5.htm
- - test: idbcursor_continue_objectstore6.htm
- - test: idbcursor_delete_index.htm
- - test: idbcursor_delete_index2.htm
- - test: idbcursor_delete_index3.htm
- - test: idbcursor_delete_index4.htm
- - test: idbcursor_delete_index5.htm
- - test: idbcursor_delete_objectstore.htm
- - test: idbcursor_delete_objectstore2.htm
- - test: idbcursor_delete_objectstore3.htm
- - test: idbcursor_delete_objectstore4.htm
- - test: idbcursor_delete_objectstore5.htm
- - test: idbcursor_iterating_index.htm
- - test: idbcursor_iterating_index2.htm
- - test: idbcursor_iterating_objectstore.htm
- - test: idbcursor_iterating_objectstore2.htm
- - test: idbcursor_iterating.htm
- - test: idbcursor_update_index.htm
- - test: idbcursor_update_index2.htm
- - test: idbcursor_update_index3.htm
- - test: idbcursor_update_index4.htm
- - test: idbcursor_update_index5.htm
- - test: idbcursor_update_index6.htm
- - test: idbcursor_update_index7.htm
- - test: idbcursor_update_index8.htm
- - test: idbcursor_update_index9.any.html
- - test: idbcursor_update_index9.any.worker.html
- - test: idbcursor_update_objectstore.htm
- - test: idbcursor_update_objectstore2.htm
- - test: idbcursor_update_objectstore3.htm
- - test: idbcursor_update_objectstore4.htm
- - test: idbcursor_update_objectstore5.htm
- - test: idbcursor_update_objectstore6.htm
- - test: idbcursor_update_objectstore7.htm
- - test: idbcursor_update_objectstore8.htm
- - test: idbcursor_update_objectstore9.htm
- - test: idbcursor-advance-continue-async.htm
- - test: idbcursor-advance-exception-order.html
- - test: idbcursor-advance-invalid.htm
- - test: idbcursor-advance.htm
+ - test: idbcursor_continue_delete_objectstore.any.html
+ - test: idbcursor_continue_invalid.any.html
+ - test: idbcursor_update_index.any.html
+ - test: idbcursor_update_index.any.worker.html
- test: idbcursor-continue-exception-order.htm
- test: idbcursor-continue.htm
- test: idbcursor-continuePrimaryKey-exception-order.htm
- test: idbcursor-continuePrimaryKey-exceptions.htm
- test: idbcursor-continuePrimaryKey.htm
- test: idbcursor-delete-exception-order.htm
- - test: idbcursor-direction-index-keyrange.htm
- - test: idbcursor-direction-index.htm
- - test: idbcursor-direction-objectstore-keyrange.htm
- - test: idbcursor-direction-objectstore.htm
- - test: idbcursor-direction.htm
- test: idbcursor-iterating-update.htm
- test: idbcursor-key.htm
- test: idbcursor-primarykey.htm
@@ -132,50 +73,11 @@
- test: idbcursor-update-exception-order.htm
- test: idbdatabase_close.htm
- test: idbdatabase_close2.htm
- - test: idbdatabase_createObjectStore-createIndex-emptyname.htm
- - test: idbdatabase_createObjectStore.htm
- - test: idbdatabase_createObjectStore10-1000ends.htm
- - test: idbdatabase_createObjectStore10-emptyname.htm
- - test: idbdatabase_createObjectStore11.htm
- - test: idbdatabase_createObjectStore2.htm
- - test: idbdatabase_createObjectStore3.htm
- - test: idbdatabase_createObjectStore4.htm
- - test: idbdatabase_createObjectStore5.htm
- - test: idbdatabase_createObjectStore6.htm
- - test: idbdatabase_createObjectStore7.htm
- - test: idbdatabase_createObjectStore8-parameters.htm
- - test: idbdatabase_createObjectStore9-invalidparameters.htm
- - test: idbdatabase_deleteObjectStore.htm
- - test: idbdatabase_deleteObjectStore3.htm
- - test: idbdatabase_deleteObjectStore4-not_reused.htm
- - test: idbdatabase_transaction.htm
- - test: idbdatabase_transaction2.htm
- - test: idbdatabase_transaction3.htm
- - test: idbdatabase_transaction4.htm
- - test: idbdatabase_transaction5.htm
+ - test: idbdatabase_createObjectStore.any.html
- test: idbdatabase-createObjectStore-exception-order.htm
- test: idbdatabase-deleteObjectStore-exception-order.htm
- test: idbdatabase-transaction-exception-order.html
- - test: idbfactory_cmp.htm
- - test: idbfactory_cmp2.htm
- - test: idbfactory_cmp3.htm
- - test: idbfactory_cmp4.htm
- - test: idbfactory_deleteDatabase.htm
- - test: idbfactory_deleteDatabase2.htm
- - test: idbfactory_deleteDatabase3.htm
- - test: idbfactory_deleteDatabase4.htm
- - test: idbfactory_open.htm
- - test: idbfactory_open10.htm
- - test: idbfactory_open11.htm
- - test: idbfactory_open12.htm
- - test: idbfactory_open2.htm
- - test: idbfactory_open3.htm
- - test: idbfactory_open4.htm
- - test: idbfactory_open5.htm
- - test: idbfactory_open6.htm
- - test: idbfactory_open7.htm
- - test: idbfactory_open8.htm
- - test: idbfactory_open9.htm
+ - test: idbfactory_cmp.any.html
- test: idbfactory-databases-opaque-origin.html
- test: idbfactory-deleteDatabase-opaque-origin.html
- test: idbfactory-deleteDatabase-request-success.html
@@ -184,119 +86,29 @@
- test: idbfactory-open-request-error.html
- test: idbfactory-open-request-success.html
- test: idbfactory-origin-isolation.html
- - test: idbindex_count.htm
- - test: idbindex_count2.htm
- - test: idbindex_count3.htm
- - test: idbindex_count4.htm
- - test: idbindex_get.htm
- - test: idbindex_get2.htm
- - test: idbindex_get3.htm
- - test: idbindex_get4.htm
- - test: idbindex_get5.htm
- - test: idbindex_get6.htm
- - test: idbindex_get7.htm
- - test: idbindex_get8.htm
- - test: idbindex_getAll.html
- - test: idbindex_getAllKeys.html
- - test: idbindex_getKey.htm
- - test: idbindex_getKey2.htm
- - test: idbindex_getKey3.htm
- - test: idbindex_getKey4.htm
- - test: idbindex_getKey5.htm
- - test: idbindex_getKey6.htm
- - test: idbindex_getKey7.htm
- - test: idbindex_getKey8.htm
- test: idbindex_indexNames.htm
- test: idbindex_keyPath.any.html
- test: idbindex_keyPath.any.worker.html
- - test: idbindex_openCursor.htm
- - test: idbindex_openCursor2.htm
- - test: idbindex_openCursor3.htm
- - test: idbindex_openKeyCursor.htm
- - test: idbindex_openKeyCursor2.htm
- - test: idbindex_openKeyCursor3.htm
- - test: idbindex_openKeyCursor4.htm
+ - test: idbindex_openCursor.any.html
+ - test: idbindex_openCursor.any.worker.html
- test: idbindex_reverse_cursor.any.html
- test: idbindex_reverse_cursor.any.worker.html
- test: idbindex_tombstones.any.html
- test: idbindex_tombstones.any.worker.html
- test: idbindex-cross-realm-methods.html
- - test: idbindex-getAll-enforcerange.html
- - test: idbindex-getAllKeys-enforcerange.html
- - test: idbindex-multientry-arraykeypath.htm
- - test: idbindex-multientry-big.htm
- - test: idbindex-multientry.htm
- - test: idbindex-objectStore-SameObject.html
+ - test: idbindex-getAll-enforcerange.any.html
+ - test: idbindex-getAllKeys-enforcerange.any.html
+ - test: idbindex-objectStore-SameObject.any.html
- test: idbindex-query-exception-order.html
- - test: idbindex-rename-abort.html
- - test: idbindex-rename-errors.html
- - test: idbindex-rename.html
+ - test: idbindex-rename-abort.any.html
+ - test: idbindex-rename-errors.any.html
+ - test: idbindex-rename.any.html
- test: idbindex-request-source.html
- test: idbkeyrange_incorrect.htm
- test: idbkeyrange-includes.htm
- test: idbkeyrange.htm
- - test: idbobjectstore_add.htm
- - test: idbobjectstore_add10.htm
- - test: idbobjectstore_add11.htm
- - test: idbobjectstore_add12.htm
- - test: idbobjectstore_add13.htm
- - test: idbobjectstore_add14.htm
- - test: idbobjectstore_add15.htm
- - test: idbobjectstore_add16.htm
- - test: idbobjectstore_add2.htm
- - test: idbobjectstore_add3.htm
- - test: idbobjectstore_add4.htm
- - test: idbobjectstore_add5.htm
- - test: idbobjectstore_add6.htm
- - test: idbobjectstore_add7.htm
- - test: idbobjectstore_add8.htm
- - test: idbobjectstore_add9.htm
- - test: idbobjectstore_clear.htm
- - test: idbobjectstore_clear2.htm
- - test: idbobjectstore_clear3.htm
- - test: idbobjectstore_clear4.htm
- - test: idbobjectstore_count.htm
- - test: idbobjectstore_count2.htm
- - test: idbobjectstore_count3.htm
- - test: idbobjectstore_count4.htm
- - test: idbobjectstore_createIndex.htm
- - test: idbobjectstore_createIndex10.htm
- - test: idbobjectstore_createIndex11.htm
- - test: idbobjectstore_createIndex12.htm
- - test: idbobjectstore_createIndex13.htm
- - test: idbobjectstore_createIndex14-exception_order.htm
- - test: idbobjectstore_createIndex15-autoincrement.htm
- - test: idbobjectstore_createIndex2.htm
- - test: idbobjectstore_createIndex3-usable-right-away.htm
- - test: idbobjectstore_createIndex4-deleteIndex-event_order.htm
- - test: idbobjectstore_createIndex5-emptykeypath.htm
- - test: idbobjectstore_createIndex6-event_order.htm
- - test: idbobjectstore_createIndex7-event_order.htm
- - test: idbobjectstore_createIndex8-valid_keys.htm
- - test: idbobjectstore_createIndex9-emptyname.htm
- - test: idbobjectstore_delete.htm
- - test: idbobjectstore_delete2.htm
- - test: idbobjectstore_delete3.htm
- - test: idbobjectstore_delete4.htm
- - test: idbobjectstore_delete5.htm
- - test: idbobjectstore_delete6.htm
- - test: idbobjectstore_delete7.htm
- - test: idbobjectstore_deleted.htm
- - test: idbobjectstore_deleteIndex.htm
- test: idbobjectstore_get.any.html
- test: idbobjectstore_get.any.worker.html
- - test: idbobjectstore_get2.any.html
- - test: idbobjectstore_get2.any.worker.html
- - test: idbobjectstore_get3.any.html
- - test: idbobjectstore_get3.any.worker.html
- - test: idbobjectstore_get4.any.html
- - test: idbobjectstore_get4.any.worker.html
- - test: idbobjectstore_get5.any.html
- - test: idbobjectstore_get5.any.worker.html
- - test: idbobjectstore_get6.any.html
- - test: idbobjectstore_get6.any.worker.html
- - test: idbobjectstore_get7.any.html
- - test: idbobjectstore_get7.any.worker.html
- test: idbobjectstore_getAll.any.html
- test: idbobjectstore_getAll.any.worker.html
- test: idbobjectstore_getAllKeys.any.html
@@ -309,78 +121,40 @@
- test: idbobjectstore_openCursor_invalid.htm
- test: idbobjectstore_openCursor.htm
- test: idbobjectstore_openKeyCursor.htm
- - test: idbobjectstore_put.htm
- - test: idbobjectstore_put10.htm
- - test: idbobjectstore_put11.htm
- - test: idbobjectstore_put12.htm
- - test: idbobjectstore_put13.htm
- - test: idbobjectstore_put14.htm
- - test: idbobjectstore_put15.htm
- - test: idbobjectstore_put16.htm
- - test: idbobjectstore_put2.htm
- - test: idbobjectstore_put3.htm
- - test: idbobjectstore_put4.htm
- - test: idbobjectstore_put5.htm
- - test: idbobjectstore_put6.htm
- - test: idbobjectstore_put7.htm
- - test: idbobjectstore_put8.htm
- - test: idbobjectstore_put9.htm
- - test: idbobjectstore-add-put-exception-order.html
- - test: idbobjectstore-clear-exception-order.html
- test: idbobjectstore-cross-realm-methods.html
- - test: idbobjectstore-delete-exception-order.html
- - test: idbobjectstore-deleteIndex-exception-order.html
- - test: idbobjectstore-getAll-enforcerange.html
- - test: idbobjectstore-getAllKeys-enforcerange.html
- - test: idbobjectstore-index-finished.html
- - test: idbobjectstore-query-exception-order.html
- - test: idbobjectstore-rename-abort.html
- - test: idbobjectstore-rename-errors.html
- - test: idbobjectstore-rename-store.html
- - test: idbobjectstore-request-source.html
- - test: idbobjectstore-transaction-SameObject.html
- - test: idbrequest_error.html
- - test: idbrequest_result.html
- - test: idbrequest-onupgradeneeded.htm
- - test: idbtransaction_abort.htm
- - test: idbtransaction_objectStoreNames.html
- - test: idbtransaction-db-SameObject.html
- - test: idbtransaction-objectStore-exception-order.html
- - test: idbtransaction-objectStore-finished.html
- - test: idbtransaction-oncomplete.htm
- - test: idbtransaction.htm
- - test: idbversionchangeevent.htm
+ - test: idbobjectstore-rename-abort.any.html
+ - test: idbobjectstore-rename-errors.any.html
+ - test: idbobjectstore-rename-store.any.html
+ - test: idbrequest-onupgradeneeded.any.html
+ - test: idbtransaction-objectStore-exception-order.any.html
+ - test: idbtransaction-objectStore-finished.any.html
+ - test: idbversionchangeevent.any.html
- test: idlharness.any.html
- test: idlharness.any.serviceworker.html
- test: idlharness.any.sharedworker.html
- test: idlharness.any.worker.html
- - test: index_sort_order.htm
- - test: interleaved-cursors-large.html
- - test: interleaved-cursors-small.html
+ - test: index_sort_order.any.html
+ - test: interleaved-cursors-large.any.html
+ - test: interleaved-cursors-small.any.html
- test: key_invalid.htm
- test: key_valid.html
- test: key-conversion-exceptions.htm
- - test: keygenerator-constrainterror.htm
- - test: keygenerator-explicit.html
- - test: keygenerator-inject.html
- - test: keygenerator-overflow.htm
- - test: keygenerator.htm
- test: keyorder.htm
- - test: keypath_invalid.htm
- - test: keypath_maxsize.htm
- - test: keypath-exceptions.htm
- - test: keypath-special-identifiers.htm
- - test: keypath.htm
- - test: large-requests-abort.html
- - test: list_ordering.htm
- - test: name-scopes.html
- - test: nested-cloning-basic.html
- - test: nested-cloning-large-multiple.html
- - test: nested-cloning-large.html
- - test: nested-cloning-small.html
- - test: objectstore_keyorder.htm
- - test: open-request-queue.html
- - test: parallel-cursors-upgrade.html
+ - test: keypath_invalid.any.html
+ - test: keypath_maxsize.any.html
+ - test: keypath-exceptions.any.html
+ - test: keypath-special-identifiers.any.html
+ - test: keypath.any.html
+ - test: large-requests-abort.any.html
+ - test: list_ordering.any.html
+ - test: name-scopes.any.html
+ - test: nested-cloning-basic.any.html
+ - test: nested-cloning-large-multiple.any.html
+ - test: nested-cloning-large.any.html
+ - test: nested-cloning-small.any.html
+ - test: objectstore_keyorder.any.html
+ - test: open-request-queue.any.html
+ - test: parallel-cursors-upgrade.any.html
- test: reading-autoincrement-indexes-cursors.any.html
- test: reading-autoincrement-indexes-cursors.any.serviceworker.html
- test: reading-autoincrement-indexes-cursors.any.sharedworker.html
@@ -398,15 +172,11 @@
- test: reading-autoincrement-store.any.sharedworker.html
- test: reading-autoincrement-store.any.worker.html
- test: ready-state-destroyed-execution-context.html
- - test: request_bubble-and-capture.htm
- - test: request-abort-ordering.html
- - test: request-event-ordering.html
+ - test: request_bubble-and-capture.any.html
+ - test: request-abort-ordering.any.html
+ - test: request-event-ordering.any.html
- test: serialize-sharedarraybuffer-throws.https.html
- - test: storage-buckets.https.any.html
- - test: storage-buckets.https.any.serviceworker.html
- - test: storage-buckets.https.any.sharedworker.html
- - test: storage-buckets.https.any.worker.html
- - test: string-list-ordering.htm
+ - test: string-list-ordering.any.html
- test: structured-clone-transaction-state.any.html
- test: structured-clone-transaction-state.any.worker.html
- test: structured-clone.any.html?1-20
@@ -421,18 +191,17 @@
- test: structured-clone.any.worker.html?41-60
- test: structured-clone.any.worker.html?61-80
- test: structured-clone.any.worker.html?81-100
- - test: transaction_bubble-and-capture.htm
- - test: transaction-abort-generator-revert.html
- - test: transaction-abort-index-metadata-revert.html
- - test: transaction-abort-multiple-metadata-revert.html
- - test: transaction-abort-object-store-metadata-revert.html
- - test: transaction-abort-request-error.html
- - test: transaction-create_in_versionchange.htm
- - test: transaction-deactivation-timing.html
- - test: transaction-lifetime-blocked.htm
- - test: transaction-lifetime-empty.html
- - test: transaction-lifetime.htm
- - test: transaction-requestqueue.htm
+ - test: transaction_bubble-and-capture.any.html
+ - test: transaction-abort-generator-revert.any.html
+ - test: transaction-abort-index-metadata-revert.any.html
+ - test: transaction-abort-multiple-metadata-revert.any.html
+ - test: transaction-abort-object-store-metadata-revert.any.html
+ - test: transaction-abort-request-error.any.html
+ - test: transaction-create_in_versionchange.any.html
+ - test: transaction-deactivation-timing.any.html
+ - test: transaction-lifetime-empty.any.html
+ - test: transaction-lifetime.any.html
+ - test: transaction-requestqueue.any.html
- test: transaction-scheduling-across-connections.any.html
- test: transaction-scheduling-across-connections.any.worker.html
- test: transaction-scheduling-across-databases.any.html
@@ -447,10 +216,21 @@
- test: transaction-scheduling-rw-scopes.any.worker.html
- test: transaction-scheduling-within-database.any.html
- test: transaction-scheduling-within-database.any.worker.html
- - test: upgrade-transaction-deactivation-timing.html
- - test: upgrade-transaction-lifecycle-backend-aborted.html
- - test: upgrade-transaction-lifecycle-committed.html
- - test: upgrade-transaction-lifecycle-user-aborted.html
- - test: value_recursive.htm
- - test: value.htm
- - test: writer-starvation.htm
+ - test: upgrade-transaction-deactivation-timing.any.html
+ - test: upgrade-transaction-deactivation-timing.any.serviceworker.html
+ - test: upgrade-transaction-deactivation-timing.any.sharedworker.html
+ - test: upgrade-transaction-deactivation-timing.any.worker.html
+ - test: upgrade-transaction-lifecycle-backend-aborted.any.html
+ - test: upgrade-transaction-lifecycle-backend-aborted.any.serviceworker.html
+ - test: upgrade-transaction-lifecycle-backend-aborted.any.sharedworker.html
+ - test: upgrade-transaction-lifecycle-backend-aborted.any.worker.html
+ - test: upgrade-transaction-lifecycle-committed.any.html
+ - test: upgrade-transaction-lifecycle-committed.any.serviceworker.html
+ - test: upgrade-transaction-lifecycle-committed.any.sharedworker.html
+ - test: upgrade-transaction-lifecycle-committed.any.worker.html
+ - test: upgrade-transaction-lifecycle-user-aborted.any.html
+ - test: upgrade-transaction-lifecycle-user-aborted.any.serviceworker.html
+ - test: upgrade-transaction-lifecycle-user-aborted.any.sharedworker.html
+ - test: upgrade-transaction-lifecycle-user-aborted.any.worker.html
+ - test: value_recursive.any.html
+ - test: writer-starvation.any.html
That's quite a big diff to sort through...
Should we consider not computing an erroneous score and doing something else instead when the one of the labeled tests in the metadata is missing?
The question is what the "something else" is. I didn't get many takers for my earlier suggestion that we stop updating scores when we get a test outcome that the code can't correctly handle (e.g. an error or timeout with an incomplete set of subtests). This seems like a pretty similar situation.
@nt1m have we had issues with labeled tests that turn out to be missing when scoring? This can happen transiently when tests are renamed, but should always be fixed relatively quickly in wpt-metadata.
@nt1m have we had issues with labeled tests that turn out to be missing when scoring? This can happen transiently when tests are renamed, but should always be fixed relatively quickly in wpt-metadata.
"relatively quickly" can go to around a week or two unnoticed, which would be great to avoid in general, especially towards the end of the year when folks start to write blog posts about Interop.
My suggestion would be to simply not update the dashboard in this case, and display a message on the dashboard if it's more than a week old saying "Due to technical issues, this is a snapshot from XX-XX-XXXX" (wording to be bikeshed)
That's fair, I get that right now is bad timing for these things to be happening. If we want to make the labeling more robust, the most durable solution might be in-WPT-tree metadata more in the style of WEB_FEATURES.yml. But certainly some fix to the dashboard could also flag when things are in a weird state.
On IndexedDB tests specifically, I've sent https://github.com/web-platform-tests/wpt-metadata/pull/7238 to take care of the simple cases of tests being refactored to multi-global .any.js tests. (Note that some such tests were labeled from the beginning and I haven't messed with those.)
@nt1m have we had issues with labeled tests that turn out to be missing when scoring?
Yes, that's how we noticed this issue in the first place. The automatic metadata updates don't handle a bunch of cases (notably when git doesn't detect that something is a rename; I'm not sure if it can correctly handle foo.html → foo.any.js automatically even if it does detect the rename).
Currently to understand that something's wrong you either need to notice that the Interop score doesn't make sense given the browser scores, or that the scores when looking at browsers in detail are different to the front-page score. If we fix things so that the Interop score is never "wrong" then we'll be even less likely to notice.
Oh, https://github.com/web-platform-tests/wpt-metadata/pull/7238 was merged automatically, I was expecting it to require review because I messed with an interop label. I've filed https://github.com/web-platform-tests/wpt-metadata/issues/7239 about that.
If anyone thinks it was a mistake to unlabel those tests, please revert and we can discuss further.
Oh, web-platform-tests/wpt-metadata#7238 was merged automatically, I was expecting it to require review because I messed with an interop label. I've filed web-platform-tests/wpt-metadata#7239 about that.
If anyone thinks it was a mistake to unlabel those tests, please revert and we can discuss further.
I originally tagged the worker variants because it was consistent with the original set of tests where the .html tests had their worker variants tagged as well, but I'm really fine either way.
We briefly touched on this issue in the meeting today. Since Interop 2024 is over, nothing we do now will change the dashboard.
@gsnedders @nt1m is there more that you'd like to see happen here before we close this issue?
https://github.com/web-platform-tests/interop/issues/346 tracks the general problem of unexpected test changes. If we don't want this sort of thing to happen, I think that has to be prioritized.
Discussed in today's interop team meeting. We agreed to close this. https://github.com/web-platform-tests/interop/issues/346 tracks the work to ensure this doesn't happen again, and that work is mostly done, modulo bugs.