[Bug]: Slow Caching Speeds when Resuming from Backup

[swimmingyoshi]

What happened?

Caching is slower when continuing training from backup.

What did you expect would happen?

The caching speed would be the same as when i start a normal training.

Relevant log output

| 1389/8554 [1:03:50<7:18:04,  3.67s/it]
| 1390/8554 [1:03:50<6:48:18,  3.42s/it]
| 1391/8554 [1:03:51<6:17:50,  3.16s/it]
| 1392/8554 [1:03:51<5:47:19,  2.91s/it]

Output of pip freeze

No response