jsartoolkit5
jsartoolkit5 copied to clipboard
kalwalt
Jttering of the model or mesh when tracking a NFT marker
You notice that the model or mesh (sphere) without the @hatsumatsu trick interpolating the tracking matrices is flickering/moving a lot. Why this happens? Because we should apply after the tracking a filter to remove the 'noise' with the arFilterTransMat It was 'planned' to add in the first implementation of NFT in jsartoolkit5 in ARMarkerNFT.c The ARMArkerNFT.c is a modified and improved version of ARWrapper/ARMarkerNFT.c. Probably wasn't added for performances reasons. We could try to add this function in a future to test ( if are not threaded functions) and/or develop another one with gpu.js ? @nicolocarpignoli @ThorstenBux What do you think?
The arFilterTransMat seems that not require threading, I think we can try. Starting from ARMarkerNFT.c i willl try to extract an utility function to apply a filter to the pose matrix. I have no a clear idea if I come to something fruitful, maybe it is only a test.
I started to work on this subject in this branch https://github.com/kalwalt/jsartoolkit5/tree/filtering-feature
I have a nice update! I will soon make a PR for this, in my opinino is better, but i would like to see what do you think...
@kalwalt that is a good one! I have been implementing also my own filters for my projects and they are doing okey, I shouldn't ask them for more actually. However my projects with AR.js NFT are demo only.
What of the things that I haven't been able to find out is if the noise filter parameters would change by the characteristics of the target image?
