IceCubesApp icon indicating copy to clipboard operation
IceCubesApp copied to clipboard

Feature request: Smarter cropping with face detection

Open sh95014 opened this issue 1 year ago • 2 comments

Web: web

IceCubes: icecubes

A relatively cheap way of improving this might be:

  1. extract downloaded image from the LazyResizableImage
  2. detect faces in the image using Vision.framework
  3. take the average vertical position of the detected faces
  4. set the frame(alignment:) of the image in defaultLinkPreview to whichever is closest to the average vertical position of faces (so .top in the example above)

Unfortunately I can't figure out step 1 and dropping to the lower-level code of Nuke seems like a disproportionate amount of work for the benefit. There's ImageRenderer but that's gross.

Filing here anyway in case anybody has other ideas.

sh95014 avatar Dec 18 '23 21:12 sh95014

When scrolling at 60/120 FPS not sure it's really worth it. Would sure be nice but not sure at all it's worth it indeed.

Dimillian avatar Dec 19 '23 06:12 Dimillian

Yeah, probably better with server support, rather than doing client-side detection.

sh95014 avatar Dec 19 '23 17:12 sh95014