Investigate flaky test `test_download_charngram_vectors` on Windows

[joecummings]

🐛 Bug

CI tests are failing for test_download_charngram_vectors with this trace

To Reproduce

1. Open CI and view failed tests

Environment

• PyTorch Version (e.g., 1.0): nightly
• OS (e.g., Linux): Windows
• How you installed PyTorch (conda, pip, source): conda
• Build command you used (if compiling from source):
• Python version: 3.9 and 3.10
• CUDA/cuDNN version: N/A
• GPU models and configuration: N/A
• Any other relevant information: Does not always fail - sometimes it succeeds no problem.