Bokeh Depth Of Field

Implementing Different Algorithms to mimic Bokeh Depth Of Field: A Physical Camera Effect created due to Focal Length, Aperture size, shape

This Project is using The Forge Rendering API, a cross-platform rendering, and targeted for these devices: PC, Android, macOS, IOS, IPad OS devices.

❗️❗️ This Project is Further Developed on The Forge Rendering API as a UnitTest and no longer maintained in this repository page. But Shaders are always up to date :) ❗️❗️

Motivation

To mimic the physical camera in real-time in an efficient way to reduce postfx overheads.

Sample Real Camera Effects

Here is the 3 different methods implemented explained briefly:

I will soon write a blog post with a lot more detail and pros-and-cons on it.

Techniques Brief Description:

1. Circular Seperable Depth of Field

• [x] Computation in 1/2 Resolution
• [x] Seperable Filter
• [x] Seperate Near and Far
• [x] Multiple Passess
• [x] Scatter-as-Gather

Circular Sperable DOF by Kleber Garcia at Frostbite EA which was shipped with FIFA17 , NHS, Mass Effect Andromeda, Anthem and is going to be shipped with the new Need For Speed Heat.

This technique is a seperable convolution filter like the Gaussian Filter and this makes it super faster than the "1-Pass 2D Kernel".

Derivation of the Kernel Weights and the Math includes Complex Numbers and Fourier Transforms explained in Olli Niemitalo's blog post.

In his paper some important notes were missing like how we do the "blending" so I had to get creative and do a lot of thinking myself.

This method is operating on Near, Far Field Seperatly on multiple passes

• Circular Seperable Depth of Field

2. Practical Gather-based Bokeh Depth of Field

• [x] Computation in 1/2 Resolution
• [ ] Seperable Filter
• [x] Seperate Near and Far
• [x] Multiple Passess
• [x] Scatter-as-Gather

Practical Gather-Based Depth of Field which is fully described in GPU-Zen Book.

This approach is also Gather-Based but the sampling and computation is not seperable and is circular sampling with 48 samples.

• Practical Gather-based Bokeh Depth of Field

3. Single Pass Depth of Field

• [ ] Computation in 1/2 Resolution
• [x] Computation in Full Resolution
• [ ] Seperable Filter
• [ ] Seperate Near and Far
• [x] Single Pass
• [x] Scatter-as-Gather

Depth of Field in a Single Pass which is described in Dennis Gustafsson awsome blog post.

This Depth of Field effect is done in a Single Pass.

Due to this technique being in full-res and needing a lot more sample and calculations It performance is now worse than the other two.

There are a lot of optimizations for this technique but since I forced it to be in a single pass my hands were tight (by myself).

• Single Pass Depth of Field

Implemented Techniques

• Circular Seperable Depth of Field - Resources
• Practical Gather-based Bokeh Depth of Field - Resources
• Single Pass Depth of Field - Resources

Build

• [x] Visual Studio 2017:
  • Put Repository folder next to cloned The-Forge API repository folder
  • Build The-Forge API Renderer and Tools and place library files in build/VisualStudio2017/$(Configuration) for example build/VisualStudio2017/ReleaseDx
  • Assimp:
    • Build Assimp for Projects involving Loading Models
    • Don't change the directory of assimp.lib, the Default is:
      • The-Forge\Common_3\ThirdParty\OpenSource\assimp\4.1.0\win64\Bin

Issues

Report any bug on your devices with most detail here

Resources

All Bokeh Links and Book Chapters gathered for R&D are in this github gist; for detailed resources and links see below:

• Circular Depth of Field (Kleber Garcia)
  • Circular Separable Convolution Depth of Field Paper - Keleber Garcia
  • Circularly Symmetric Convolution and Lens Blur - Olli Niemitalo
• GPU Zen (Wolfgang Engel) : Screen Space/Practical Gather-based Bokeh Depth of Field
  • Book Amazon
  • GitHub
• Bokeh depth of field in a single pass - Dennis Gustafsson

Built and Tested Devices (See UnitTest 29_DepthOfField in TheForge)

• [x] PC
  • [x] Windows 10 - DX12
  • [x] Windows 10 - Vulkan 1.1
  • [ ] Windows 7 - Fallback DX11
  • [x] Linux Ubuntu 18.04 LTS - Vulkan 1.1
• [x] Android Pie - Vulkan 1.1
• [x] macOS / iOS / iPad OS - Metal 2.2