NeuralNetworkPostProcessing icon indicating copy to clipboard operation
NeuralNetworkPostProcessing copied to clipboard

VR

Open andybak opened this issue 5 years ago • 1 comments

So the good news is that this runs in VR without any modification.

Bad news is that it runs at 2fps on a GTX 1080 ;-)

My hunch is that reprojection would make this tolerable if we could hit 45fps.

So only a 20x speedup!

Supporting single pass rendering would probably buy a 1.5x speedup and might not be too hard. Rendering at half res would probably give a 4x speedup.

I haven't looked at the code. How much scope is there for something completely improbably like a 10x speedup through optimization? I'm guessing that's a fairly tall order.

andybak avatar Feb 21 '19 16:02 andybak

Hi! Yes it true performance is a big issue right now. There are some ways

  1. Quantization, let all computation run in 8bit than 32bit, but I don't think compute shader can do that, maybe need to use OpenCL?
  2. Shallower network, for now it is around 30 layers, I can try train it with less layers.

Anyway thanks, I will take a look at it later.

maajor avatar Feb 22 '19 01:02 maajor