Any client-side cropping we do in our article images / headers could benefit from this.
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Spike | Tsevener | T225651 Investigate changes in iOS 13 | ||
| Open | Spike | None | T229534 iOS13 [Feature] - Look into new image saliency API for better cropping |
Event Timeline
@Tsevener Thank you Toni from 2019 for filing this 😆
Thanks to our iOS 13 deployment target, the thing we can now leverage to help our poor image cropping in Top read, Picture of the day, and article lead images is attention-based saliency: https://developer.apple.com/documentation/vision/cropping_images_using_saliency. Unlike our current approach in app, which relies on Core Image face detection, this approach would help us crop to the likely most interesting part of an image regardless of the image's subject/content (person, animal, landscape, architecture, etc.).
What remains to be seen is whether the Vision framework can be leveraged within a WidgetKit extension. When I get some free time I wanna toy around with this in the WidgetKit extension to find out, but truthfully even applying this just in the main app target itself, and just to an article's lead image itself, is a huge win in my book.