Default Python Version on cloud

[aniketmaurya]

🚀 Feature

Right now the default Python version on the cloud is 3.8 and there is no way to specify it. I want to use the shutdown of the ThreadPoolExecutor with the cancel_futurers argument which is only available in Python>=3.9

Motivation

Pitch

Alternatives

Additional context

cc: @hhsecond

---

If you enjoy Lightning, check out our other projects! ⚡

• Metrics: Machine learning metrics for distributed, scalable PyTorch applications.

• Lite: enables pure PyTorch users to scale their existing code on any kind of device while retaining full control over their own loops and optimization logic.

• Flash: The fastest way to get a Lightning baseline! A collection of tasks for fast prototyping, baselining, fine-tuning, and solving problems with deep learning.

• Bolts: Pretrained SOTA Deep Learning models, callbacks, and more for research and production with PyTorch Lightning and PyTorch.

• Lightning Transformers: Flexible interface for high-performance research using SOTA Transformers leveraging PyTorch Lightning, Transformers, and Hydra.

cc @borda

[awaelchli]

Maybe platform could provide a set of base images that we can choose from via build config or similar?

@aniketmaurya In the mean time, you can implement the cancel_futurers using this method.

[aniketmaurya]

Sure I'll use this solution. Thanks for sharing Adrian 🔥

[Borda]

So far from downloads stats, it seems 3.9 is not yet so popular yet... see: https://pypistats.org/packages/pytorch-lightning

[aniketmaurya]

Yes, some features are not available in 3.7 which are there in 3.9, so maybe a way to select the Python version would be awesome 😄

[stale[bot]]

This issue has been automatically marked as stale because it hasn't had any recent activity. This issue will be closed in 7 days if no further activity occurs. Thank you for your contributions - the Lightning Team!

[awaelchli]

Closing. The Python version can be changed in Lightning AI Studio in the environment settings now. This is probably the closes we will get to "specify the Python version" for apps.