SteamOS
SteamOS copied to clipboard
ValveSoftware
[Feature Request] Add frame generation capabilities, similar to Lossless Scaling Frame Generation (LSFG) or AMD Fluid Motion Frames (AFMF)
Your system information
- Steam client version: Latest Stable
- SteamOS version: Latest Stable
- Opted into Steam client beta?: No
- Opted into SteamOS beta?: No
- Have you checked for updates in Settings > System?: Yes
Please describe your issue in as much detail as possible:
A feature request to add frame generation capabilities, similar to Lossless Scaling Frame Generation (LSFG) or AMD Fluid Motion Frames (AFMF).
Details:
LSFG:
- Introducing Frame Generation - LSFG
- New frame capture API
- LSFG 1.1 – New UI detection model
- Introducing LSFG 2.0
AFMF:
Steps for reproducing this issue:
- N/A
To better illustrate what is being requested, here is a video showing a Windows-based handheld PC using Lossless Scaling Frame Generation:
https://youtu.be/KbaX35ky0rQ
As you can see, even using a relatively low 30 FPS base, the fluidity and overall experience is much better with frame generation on the Windows-based handheld PC.
+1 to this. It would be a game changer and extend the life of Steam Deck to a few years more and allow it to run games at a higher FPS than it is rated.
Imagine a game barely running 40FPS being frame genned to 60fps. (you need some FPS/performance allowance to have frame gen, a game barely running 30fps will not go up to 60)
I understand that the current solutions presented are Windows-centric only, but that's no stranger for the Steam Deck, which already runs games designed for Windows. Having one baked into SteamOS itself (like FSR or gamescope) will probably work wonders.
PS. Having used both, LSFG implementation is better imo simply because it doesn't turn off at fast movement, so no disorienting stutters.
This would also benefit emulation both on Steam Deck and usual linux desktop, especially for games that don't have 60 fps patches available.
Latest developments
LSFG:
Definitely would be a huge feature in allowing SteamOS and SteamDeck users to play demanding games in higher fidelity than their hardware can handle. By far my most desired feature for SteamOS.
This has most likely not yet been implemented due to the absence of Vulkan support, which would be needed for it to run on top of DXVK.
However AMD are planning to open source the recently released FSR 3.1 in July 2024, which not only has Vulkan support, but also decouples Frame Generation, allowing it to be used separately from the upscaling, which is the last ingredient to it being implemented.
It is definitely the number 1 on my most exciting features list, and I just hope that some sort of AMD Anti-Lag alternative can be implemented to reduce its most obvious deficiency.
Source: https://community.amd.com/t5/gaming/amd-fsr-3-1-now-available-fsr-3-available-and-upcoming-in-60/ba-p/692000
I think it would be a good time for valve to officially support 70hz for the steam deck lcd because 35fps looks perfect with framegen unlike 30fps. And people are going to want to upgrade to better handhelds without frame generation on deck lcd.
@Pahheb:
This has most likely not yet been implemented due to the absence of Vulkan support, which would be needed for it to run on top of DXVK.
However AMD are planning to open source the recently released FSR 3.1 in July 2024, which not only has Vulkan support, but also decouples Frame Generation, allowing it to be used separately from the upscaling, which is the last ingredient to it being implemented.
It is definitely the number 1 on my most exciting features list, and I just hope that some sort of AMD Anti-Lag alternative can be implemented to reduce its most obvious deficiency.
Source: https://community.amd.com/t5/gaming/amd-fsr-3-1-now-available-fsr-3-available-and-upcoming-in-60/ba-p/692000
It seems AMD has publicly released FSR 3.1 today:
- AMD FidelityFX™ Super Resolution 3.1 released as part of FidelityFX SDK 1.1
- Vulkan support
- With FSR 3.1, we provide support for the Vulkan graphics API.
- Vulkan support
- Release FidelityFX SDK v1.1.0 · GPUOpen-LibrariesAndSDKs/FidelityFX-SDK
- AMD FidelityFX Super Resolution 3 (FSR 3)
- AMD FidelityFX FSR 3.1 has been added to the FidelityFX FSR sample.
- AMD FidelityFX Super Resolution 3 (FSR 3)
Forgive my ignorance, but does this mean that we might see FSR3 implemented system-wide and thus compatible with all games? Has Valve commented on this?
@lmills87: Forgive my ignorance, but does this mean that we might see FSR3 implemented system-wide and thus compatible with all games? Has Valve commented on this?
FSR3.1 Frame Generation requires developer integration into a game engine:
What is being requested via this issue is for Valve to add system-wide frame generation capabilities, similar to:
- Lossless Scaling Frame Generation (LSFG), which is capture-based; or
- AMD Fluid Motion Frames (AFMF), which is driver-based.
The idea is, now that AMD has released FSR 3.1 Frame Generation source code with a permissive license, maybe Valve can adapt such code to incorporate system-wide Frame Generation functionality into SteamOS, similar to when they previously incorporated system-wide FSR1 upscaling functionality.
Latest developments
- AFMF:
- AMD Fluid Motion Frames 2 Technical Preview Now Available
- AI-Optimized Enhancements.
- Performance Improvements.
- Lower Latency Frame Generation.
- AMD Fluid Motion Frames 2 Technical Preview Now Available
- LSFG:
- X4 Frame Generation & G-Sync Support
- LSFG 2.3 introduces X4 frame generation mode, generating three intermediate frames.
- X3 mode has been updated to further reduce artifacts on patterned textures and in dark scenes.
- Increased UI detection rate from every 4th frame to 1 for "performance" mode.
- Initial support for G-Sync.
- X4 Frame Generation & G-Sync Support
FSR3.1 Frame Generation requires developer integration into a game engine
I'm just curious here, but couldn't frame generation on linux be even better than LSFG? Lossless Scaling only uses the rendered frames to derive(guess) motion vectors (so it works with anything, including videos). In the linux ecosystem could we somehow [hand-waving] get real motion data via modifications to DXVK and the like?
The lack of motion vectors is the biggest downside to Lossless Scaling when compared to FSR 3:
Screenshot from a youtube video: https://www.youtube.com/watch?v=69k7ZXLK1to
Absolutely +1 for this. It's a game changer and the reason I'm currently on Windows. The Steam Deck would also majorly benefit from this.
+1. In some use cases, it is incredibly useful. Would be lovely to see it ever being implemented
Just here to +1 visible interest in this. Although, I'd like this to extend beyond just SteamOS, it'd be good as a gamescope feature.
+1 from me as well. Would be a literal game changer. And they know it. Just a matter of time, I suppose.
Yeah that would be an amazing feature, atm we only have DLSS Enabler for framegen, but it only works on DX12 compatible games.
+1 it would be amazing for AFMF2 to be supported globally in SteamOS game mode. Extending Steam Deck life, improving gaming for all "deckers" in some cases increasing battery life as well, when you are on the go in a game that doesn't need crazy latency, but you enjoy 60fps, scale down to 30, upscale to 60 with some slight artifacts (less visible on small screen), but much better battery life.
+1 adding this would make so many games more playable even on bigger screens. I see no reason not to implement this in some way
If it's like lossless scaling it will feel seamless 35fps doubled to 70fps and I think there is even less lag on afmf 2. Also steam deck should officially support 70hz now because I've been using it for a year now with no issues.
