Page MenuHomePhabricator

[SPIKE] Image Browsing: investigate how to enable image cropping / moving effect
Closed, ResolvedPublic5 Estimated Story PointsSpike

Description

The image detail view UI would benefit from a facility that crops the main subject of a given image, or moves between its entities.
We assume the general task to be related to object detection.

Acceptance criteria

  • Ping Apps to learn from their experience, see also thread
  • Research off-the-shelf open-source tools for object detection
  • If none is available/viable, then research pre-trained ML models (see e.g., Hugging Face's list) and assess feasibility
  • Understand how to enable moving between image objects

Event Timeline

mfossati changed the subtype of this task from "Task" to "Spike".
ovasileva moved this task from Ready to Incoming/Inbox on the Reader Growth Team board.
egardner set the point value for this task to 5.Aug 5 2025, 6:13 PM
egardner moved this task from Ready to Sprint 3 on the Reader Growth Team board.
bvibber removed bvibber as the assignee of this task.
bvibber subscribed.

whoops, claimed the wrong task :D

Update, for MVP, moving between objects in an image is going to be out-of-scope

We're settling on client side image cropping for now and focusing on refining it. Research results here.

Hey @KSarabia-WMF – can you update your findings doc with info about the client-side solution you explored? Library or libraries used, JS payload size, link to your demo, etc? I think you can keep all the current info, but an additional section to describe the more limited approach we are exploring now would be good.

@egardner Noted. Please see the addendum in the document. I've updated it based on your request.