autowebcompat

autowebcompat copied to clipboard

Using the differential images as inputs for the CNNs

1

We can try extracting the difference between images using opencv, and train the cnn on the 'differential image'. This approach should be less computationally expensive than siamese CNNs and may...

vrishank97

Make the screenshots in the different browsers equal in size

8

Right now, Chrome is showing a scrollbar that we should get rid of, as it is simply adding noise. Once we remove the scrollbar, the screenshots are probably not the...

marco-c

Using the model we trained on the compatibility problem as a pretrained model, we can fine-tune it to the task of detecting regressions.

marco-c

Let's extend the project to use the last 10 major releases of each browser when collecting screenshots. I'm considering creating a Docker container with the headless browser for each browser...

gabriel-v

After #273 is done, use [mdn/browser-compat-data](https://github.com/mdn/browser-compat-data) to try and guess when a browser will fail rendering a web page. Use this information to automatically label the dataset (labeling a pair...

gabriel-v

Instead of randomly choosing an element to interact with, choose all possible elements

7

Currently, we are choosing elements to interact with in a random fashion. Instead, we should explore all possible paths (up to a maximum level that we need to decide).

marco-c

Collect screenshots at different times during the day or on different days

5

Many websites (e.g. with a carousel, or with news) change pretty often their content, but the overall structure remains the same. If we collect many screenshots for the same website...

marco-c

Investigate if we can find more elements to interact with

3

Right now, the crawler is interacting with `button`s, some `input`s and `a`s: https://github.com/marco-c/autowebcompat/blob/205aae8a174e2d263b9e98246c78a16b587179a7/collect.py#L74

marco-c

Keep running the crawler and collect more screenshots

2

While doing it, we should also take note of on which sites the crawler fails to take screenshots.

marco-c

Investigate cases where the crawler wasn't able to take screenshots

10

There are a few cases where the crawler was not able to take screenshots. We should figure out why and try to fix any issue that we notice. The files...

marco-c