Page MenuHomePhabricator

[BUG] Face detection failing in many articles on iOS app (works on same articles in Android and mobile web)
Closed, DeclinedPublic

Description

Occurring on
Wikipedia 5.3.0 (959)
iPhone 6S Plus (v10.0.2)

Steps to reproduce

  1. Open app and look through Featured articles for people.
  2. Open the Oct 23 featured article "The Left Hand of Darkness"

Expected
Face detection moves the image to crop on the face of the person in the lead image. This can be seen occurring correctly on the

Android app feed
Screenshot_20161023-095449.png (1,080×1,920 px, 711 KB)
Mobile Web article (beta features turned on)
Mobile web - lead image expected.png (1,242×2,208 px, 2 MB)

Actual
iOS does not apply the face detection on the feed or even in the article

Feed
Simulator Screen Shot Oct 23, 2016, 7.06.07 PM.png (1,242×2,208 px, 945 KB)
Article
Simulator Screen Shot Oct 23, 2016, 7.06.17 PM.png (1,242×2,208 px, 1 MB)

Event Timeline

JMinor moved this task from Needs Triage to Bug Backlog on the Wikipedia-iOS-App board.
JMinor subscribed.

This is probably a tradeoff between process time/cycles and accuracy.

I'd love to see us store this centering on the backend... sigh.

@RHo @JMinor even with changing the preset from "low" (faster, less accurate face detection) to "high" (slower, more accurate), the face is still not picked up by iOS. The issue with this particular one has to do with iOS's face detection and not much we can do outside of computing & storing on the backend.

@RHo @JMinor also, are we sure that Android and the web don't just default to the top portion of the image? Also... maybe we should default to the top or slightly off the top rather than the middle.

I don't think we're perfectly consistent everywhere but here's the same page in Androidland:

screenshot-2016-10-24-11-04-11-474266934.png (1,440×2,560 px, 1 MB)

@Niedzielski – so weird, the screenshot I took on Android yday in the feed showed her face :/

The only predicable part seems to be that this face detection thing works erratically.

I tested tons of pages back in the day and found that defaulting to about 1/4 down from the top seemed to produce the best results on average.

This is, of course, anecdotal, but at the time one way I tested this was to turn off face detection, choose an option (top, 1/4 down, center, 3/4 down, bottom) then I would start with Obama and keep clicking through all the previous presidents until I got to Washington keeping track of how many images looked ok.

Face recognition is non-deterministic. We've made better fallbacks in the 5.4 release, but gonna decline this for now.

I look forward to the magic day when there is editorial control for these things...