using facial recognition data to prevent cutting faces

[ArchyInf]

Sometines faces are cut of at the top of the image.
It should be possible to prevent this using facial recognition data as it contains face bounds. Maybe optionally only doing this for named faces.
Realistic?

[JW-CH]

If you enable the zoom feature and a face is detected, the frame will zoom in or out of the image. (for named faces I think)

[ArchyInf]

Seems like an issue with !Single view, or it happens much more often there.

Another oddity that might be the issue: I only see people names in the bottom right for ~5% of the images. For others they are not shown. The images contain correct and named face rects. ShowPeopleDesc is set to true. So if for some reason people data is not received correctly this could break the framing.

[JW-CH]

Seems like an issue with !Single view, or it happens much more often there.

Another oddity that might be the issue: I only see people names in the bottom right for ~5% of the images. For others they are not shown. The images contain correct and named face rects. ShowPeopleDesc is set to true. So if for some reason people data is not received correctly this could break the framing.

The 5% issue should be fixed in the next version, sorry, should have mentioned that. It was a limitation in immich's api.

[ArchyInf]

I checked the new version and names are there now. Face framing still doesn't work.
I set up a local dev setup and tracked down the issue, but I don't have anything to do with css & co so I have no idea how to fix this immediately.
Issue is that the face position calculation in image.svelte doesn't handle where the image is placed/scaled. It would have to emulate css styles I guess? It basically calculates the face position as if the image was scaled to fill the space 100% without keeping aspect.

Activating the debug overlay shows that:

The image is made to fit sceen width, height is only visible by 50%. The red boxes should be twice as high but the bottom line is correct making the face center calculation incorrect too.

[JW-CH]

The red squares show the position of faces when the image has reached its final position (after zoom in/out). You can disable zoom to display them correctly.

EDIT: You might be right. Images seem to be a bit offset when not fullscreen.

This (full width) image works

When the image is not full width, the images will be off.

You can play around with the size of your browser. This is ofc. not as it should be.

[JW-CH]

Are you on the immich discord? Feel free to ping me for faster replies ;)

I'm not sure when I will get to fix this, but I think you would be able to just overlay and the image in a

together.

[3rob3]

Zoom also works in non Webview Android, it is just very basic and not "smart".