Semantic Segmentation Annotations for Equirectangular RenderTexture

[lyndonchan]

@StevenBorkman @JonathanHUnity I am trying to get the semantic segmentation labeler to work with an equirectangular 360-degree view.

I am able to get the RGB annotations saved to file using the Camera.RenderToCubemap() and EyeCubemap.ConvertToEquirect() method detailed in this blog post: https://www.alanzucconi.com/2020/05/19/360-video-unity/

However, when I try to enable semantic segmentation labelling, I merely get the annotation for the positive X face of the cubemap and not for the desired equirectangular RenderTexture. I tried feeding in both the cube RenderTexture EyeCubemap and the equirectangular RenderTexture EquirectTexture into the m_TargetTextureOverride argument and directly into the RenderTextureReader of my SemanticSegmentationLabeler but to no avail - only the semantic segmentation annotation for the positive X face is being captured.

If you could point me in the right direction to modify the code and get the equirectangular view working, that would be much appreciated (the Perception package documentation is very inadequate for this kind of tinkering)!