[Failing Test]: Some tests in tox-py38-embeddings are flaky or failing

[tvalentyn]

What happened?

There might be a race in sentence_transformers tests:

            if os.path.exists(path + ".lock"):
>               os.remove(path + ".lock")
E               FileNotFoundError: [Errno 2] No such file or directory: '/home/runner/.cache/torch/sentence_transformers/sentence-transformers_all-mpnet-base-v2/sentence_bert_config.json.lock'

from: https://github.com/apache/beam/actions/runs/8901016437/job/24443884286?pr=31134

Issue Failure

Failure: Test is flaky

Issue Priority

Priority: 2 (backlog / disabled test but we think the product is healthy)

Issue Components

• [x] Component: Python SDK
• [ ] Component: Java SDK
• [ ] Component: Go SDK
• [ ] Component: Typescript SDK
• [ ] Component: IO connector
• [ ] Component: Beam YAML
• [ ] Component: Beam examples
• [ ] Component: Beam playground
• [ ] Component: Beam katas
• [ ] Component: Website
• [ ] Component: Spark Runner
• [ ] Component: Flink Runner
• [ ] Component: Samza Runner
• [ ] Component: Twister2 Runner
• [ ] Component: Hazelcast Jet Runner
• [ ] Component: Google Cloud Dataflow Runner