Ditsmod disappeared from benchmark results for unknown reasons

[KostyaTretyak]

In the last two benchmarks, Ditsmod disappeared for unclear reasons, even though I didn’t make any changes, and locally I’m running the latest code from techempower.

[p8]

This was the error:

ditsmod: Step 1/7 : FROM node:20.16-slim
ditsmod: Docker build failed; terminating
ditsmod: Traceback (most recent call last):
ditsmod:   File "/FrameworkBenchmarks/toolset/utils/docker_helper.py", line 53, in __build
ditsmod:     raise Exception(token['errorDetail']['message'])
ditsmod: Exception: unauthorized: authentication required
ditsmod: Build time: 1s

https://tfb-status.techempower.com/unzip/results.2025-09-25-03-36-05-327.zip/results/20250918125421/ditsmod/build/ditsmod.log

But this error occured for other frameworks as well. Some examples: https://tfb-status.techempower.com/unzip/results.2025-09-25-03-36-05-327.zip/results/20250918125421/cutelyst/build/cutelyst.log https://tfb-status.techempower.com/unzip/results.2025-09-25-03-36-05-327.zip/results/20250918125421/chi/build/chi.log https://tfb-status.techempower.com/unzip/results.2025-09-25-03-36-05-327.zip/results/20250918125421/blade/build/blade.log ...

[KostyaTretyak]

But this error occured for other frameworks as well.

That's right. This error has been known for a long time, and it says that Docker Hub has a limit on the number of Docker image downloads from one host. It is highly desirable that TechEmpower handles such errors, because it is obvious that these errors are not caused by any framework.

[msmith-techempower]

I wasn't aware of the limit... this is sort of a tough one to solve (though, we could catch it and report it more cleanly, for sure).

[KostyaTretyak]

I wasn't aware of the limit

100 pulls in 6 hours from one IP address.

this is sort of a tough one to solve

ChatGPT says that you can create a registry mirror (with Docker daemon):

docker run -d \
  -p 5000:5000 \
  --restart=always \
  --name registry-mirror \
  -e REGISTRY_PROXY_REMOTEURL=https://registry-1.docker.io \
  registry:2

2. In /etc/docker/daemon.json:

{
  "registry-mirrors": ["http://localhost:5000"]
}

3. Restart Docker:

sudo systemctl restart docker

[volyrique]

Anyway, ditsmod and its permutations seemed to be back during the last continuous benchmarking run.

[KostyaTretyak]

That's true, but the issue remains. At any moment, frameworks that are not launched first in the list may disappear.

[KostyaTretyak]

On the other hand, I don't see the error that caused this issue to be opened. Maybe this issue has actually been fixed already.