engine icon indicating copy to clipboard operation
engine copied to clipboard

Gaussian Splatting: Significant quality loss when unified is enabled on multiple entities

Open MotivaCG opened this issue 3 months ago • 12 comments

When enabling unified rendering on more than one gaussian entity, image quality degrades noticeably. With a single splat, it looks correct without ordering it.

Sample:

One model without unified https://www.scanmenow.es/samples/dev/tmp/?model=model Two models with unified https://www.scanmenow.es/samples/dev/tmp/?model=model2

MotivaCG avatar Sep 22 '25 12:09 MotivaCG

Such a great scene! ❤️❤️❤️

slimbuck avatar Sep 22 '25 13:09 slimbuck

Updated to 2.12 it 'feels' faster and more responsive unfortunately the issue seems to be still there (you can check on the same url)

Btw congrats for the release!

MotivaCG avatar Oct 09 '25 16:10 MotivaCG

Hi .. thanks for the repro, I confirmed this is fixed in my PR where I added needed functionality. Please reopen if you still see some issue. The engine with this should be out in the near future ( a week maybe), but you can test with local engine if needed.

mvaligursky avatar Nov 04 '25 11:11 mvaligursky

Looks great now!

MotivaCG avatar Nov 11 '25 00:11 MotivaCG

@mvaligursky Unfortunately, although it looks much better now it still has some small glitches (attached video), maybe ordering issues?

TestMultiGS.zip

MotivaCG avatar Nov 11 '25 17:11 MotivaCG

@slimbuck @mvaligursky Uppps it was on the desktop browser in the Android one (tested with Chrome and Brave) looks really bad (and it was working with the previous version with some small glitches but working.

Image

Testing url https://www.scanmenow.es/samples/dev/pc/?model=andreaisasog&controls=1

MotivaCG avatar Nov 11 '25 17:11 MotivaCG

My pixel 7 pro seems to work

Image

slimbuck avatar Nov 11 '25 18:11 slimbuck

Samsung S24 Ultra here :/

MotivaCG avatar Nov 11 '25 22:11 MotivaCG

do you have the same issue with the engine examples using unified, such as this: https://playcanvas.vercel.app/#/gaussian-splatting/global-sorting ?

mvaligursky avatar Nov 12 '25 08:11 mvaligursky

I can reproduce this on browser stack using your ply This PR is causing the issue: https://github.com/playcanvas/engine/pull/8055

mvaligursky avatar Nov 12 '25 11:11 mvaligursky

missing highp?

slimbuck avatar Nov 12 '25 11:11 slimbuck

missing highp?

Tried those first, so probably not. It affects WebGPU as well, so not highp issue.

mvaligursky avatar Nov 12 '25 11:11 mvaligursky

I have a workaround here, seems GPU / driver issue. I'll release engine patch in the next few days.

@MotivaCG - if by any chance you have one of those awesome character splats (individual or a small group) you could contribute to this repo, I'd be very much be in favor, please let me know. They look awesome and are a great test case too.

mvaligursky avatar Nov 12 '25 16:11 mvaligursky

I have a workaround here, seems GPU / driver issue. I'll release engine patch in the next few days.

@MotivaCG - if by any chance you have one of those awesome character splats (individual or a small group) you could contribute to this repo, I'd be very much be in favor, please let me know. They look awesome and are a great test case too.

you mean the pub or the characters?

MotivaCG avatar Nov 13 '25 15:11 MotivaCG

Some character splats - one / two characters in a single scene, or anything like that.

mvaligursky avatar Nov 13 '25 15:11 mvaligursky

Ah for sure that I can share characters :) what format do you prefer?

MotivaCG avatar Nov 13 '25 19:11 MotivaCG

uncompressed ply - that way I can convert it to any format without loss. Much appreciated!

mvaligursky avatar Nov 13 '25 20:11 mvaligursky

This is now released: https://github.com/playcanvas/engine/releases/tag/v2.13.1

mvaligursky avatar Nov 14 '25 15:11 mvaligursky

It is 99.9% done! when the canvas is resized (ie. a screen rotation on a smartphone) the problem appears unti you trigger a render by moving the camera or whatever.

MotivaCG avatar Nov 17 '25 17:11 MotivaCG

Btw these kind of assets work for you? https://www.scanmenow.es/samples/leonyyo.ply https://www.scanmenow.es/samples/8yq7294ui.ply

(these are ourselves)

MotivaCG avatar Nov 17 '25 17:11 MotivaCG

It is 99.9% done! when the canvas is resized (ie. a screen rotation on a smartphone) the problem appears unti you trigger a render by moving the camera or whatever.

interesting, I'll see if I can repro, thanks!

mvaligursky avatar Nov 17 '25 17:11 mvaligursky

Btw these kind of assets work for you? https://www.scanmenow.es/samples/leonyyo.ply https://www.scanmenow.es/samples/8yq7294ui.ply

(these are ourselves)

Yes, I'd be happy if I can use some of these!

mvaligursky avatar Nov 17 '25 17:11 mvaligursky

Btw these kind of assets work for you? https://www.scanmenow.es/samples/leonyyo.ply https://www.scanmenow.es/samples/8yq7294ui.ply (these are ourselves)

Yes, I'd be happy if I can use some of these!

I posted them to be used (I'm the one with the moustache hahaha)

MotivaCG avatar Nov 17 '25 20:11 MotivaCG

@mvaligursky really easy to replicate issue in computer

https://github.com/user-attachments/assets/c8dd8ecb-9b9b-4ad8-b05d-3892c64f6303

MotivaCG avatar Nov 18 '25 17:11 MotivaCG

Great video, thanks for that, I've fixed it and we'll release it in the next few days.

And thanks for the splat models, I'll be using them in some future example for sure, much appreciated.

mvaligursky avatar Nov 19 '25 13:11 mvaligursky

Confirm solved in Commit 81bb3b1 v2.13.5

MotivaCG avatar Nov 21 '25 12:11 MotivaCG