torchbench

torchbench copied to clipboard

TorchMetrics for higher reproducibility !

2

Dear @RJT1990, Awesome project there !!! I looked internally and I have seem metrics being manually implemented without any testing. This makes me pretty scary in term of reproducibility and...

tchaton

This is a minor change which does alter default behaviour. To understand model behaviours on my local setup - images per second, cuda load, as well as numbers on the...

xvdp

'Speed' measurement possibly misleading for image classification

4

If I am correct in assuming that the time calculated for evaluating the whole dataset (https://github.com/paperswithcode/torchbench/blob/master/torchbench/image_classification/utils.py#L75) is used for calculating the speed on the leaderboard, then I would like to...

mehtadushy

Bumps [black](https://github.com/psf/black) from 19.3b0 to 24.3.0. Release notes Sourced from black's releases. 24.3.0 Highlights This release is a milestone: it fixes Black's first CVE security vulnerability. If you run Black...

dependabot[bot]

Hi, your project torchbench(commit id: dca5f740ff58b2e419db3ca1eb38e1cd3cb658f4) requires "albumentations==0.3.0" in its dependency. After analyzing the source code, we found that the following versions of albumentations can also be suitable, i.e., albumentations...

Agnes-U