vtkplotlib icon indicating copy to clipboard operation
vtkplotlib copied to clipboard

Displaying images as 3D objects

Open FrankNiemeyer opened this issue 2 years ago • 2 comments
trafficstars

I need to display images (2D) as 3D objects. My idea was to use the images as textures for simple rectangles consisting of two triangles each.

I tried to use plain vtkPolyData for that as suggested .

I used the following code to test the basic idea:

import skimage as ski
import numpy as np
import vtkplotlib as vpl

image = ski.io.imread("image_AP.png") # uint8 gray scale image
rgb_image = ski.color.gray2rgb(image)
texmap = vpl.colors.TextureMap(rgb_image, interpolate=True)

image_PolyData = vpl.PolyData()
# four vertices forming a square
image_PolyData.points = np.array([
    [0.0, 0.0, 0.0],
    [0.0, 1.0, 0.0],
    [1.0, 1.0, 0.0],
    [1.0, 0.0, 0.0]], dtype=float)
# rectangle consisting of two triangles
image_PolyData.polygons = np.array([
    [0, 1, 3],
    [1, 2, 3]])
image_PolyData.texture_map = texmap
# UV coordinates for the four vertices
image_PolyData.point_colors = np.array([
    [0.0, 0.0],
    [0.0, 1.0],
    [1.0, 1.0],
    [1.0, 0.0]])

image_PolyData.quick_show()

This works, in principle, however it seems that pixels in between the vertices are simply interpolated between the vertices instead of using the actual texture information.

Is this by design or a bug? Is it possible to actually map the texture onto the polydata faces?

FrankNiemeyer avatar Oct 20 '23 13:10 FrankNiemeyer

This works, in principle, however it seems that pixels in between the vertices are simply interpolated between the vertices instead of using the actual texture information.

You're right, it's a naive implementation. I don't know what I was thinking when I published that API. I knew this would come back to bite me one day.

I don't have a quick fix for this I'm afraid. I'd need to go digging though vtkTexture and write a Python wrapper for it.

bwoodsend avatar Oct 21 '23 10:10 bwoodsend

Thanks. Good to know it's not because I was doing something wrong. ;)

FrankNiemeyer avatar Oct 21 '23 13:10 FrankNiemeyer