MediaSearch results not updated 12 hours after overwriting image
Closed, ResolvedPublic8 Estimated Story Points
Actions

Assigned To

Authored By

	Discostu
	Mar 23 2021, 8:27 AM

Description

It seems to me that the search index for MediaSearch on commons is not updated when a file is replaced.

Steps to reproduce

Upload an image with a resolution of for example 2,048 × 1,536 Pixels
Search in MediaSearch with a CirrusSearch query that finds you image by image dimensions, for example user:Discostu filew:<2049 fileh:<2049
Overwrite your image with a larger file, for example 3,648 × 2,736 pixels
Repeat the same search with MediaSearch

Expected results
The image is not among the search results anymore

Actual results
The image is still among the search results, even 12 hours after the re-upload

Details

	Subject	Repo	Branch	Lines +/-
	Reindex the page on UploadComplete	mediawiki/extensions/CirrusSearch	master	+19 -0

Customize query in gerrit

Related Objects

Mentioned In: T342562: File uploads do not appear to get indexed properly
T344285: RevisionStore::newNullRevision (or equivalent higher-level method) missing LinksUpdate

Event Timeline

Discostu created this task.Mar 23 2021, 8:27 AM

Restricted Application added a project: Discovery-Search. · View Herald TranscriptMar 23 2021, 8:27 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Discostu renamed this task from MediaSearch results don't change aftert re-upload of image to MediaSearch results don't change aftert overwriting image.Mar 23 2021, 8:28 AM

Discostu renamed this task from MediaSearch results don't change aftert overwriting image to MediaSearch results don't change after overwriting image.

Discostu updated the task description. (Show Details)

Aklapper renamed this task from MediaSearch results don't change after overwriting image to MediaSearch results not updated 12 hours after overwriting image.Mar 23 2021, 8:58 AM

Aklapper added a project: SDAW-MediaSearch.

Restricted Application added a project: Structured-Data-Backlog. · View Herald TranscriptMar 23 2021, 8:58 AM

Base subscribed.Mar 23 2021, 9:26 AM

@Discostu do you get this on Special:Search as well?

I didn't try. The search index now seems to be updated, so I can't test with the same file. Would have to try it with another one when I can find the time.

OK, tried now with another file:

Right now (3 minutes after upload) both searches show the file, so index is not updated yet.

Same after 30 minutes.

Same after 7 hours.

Same after 8 hours.

Ok thanks @Discostu - the search indexes are updated via a job that runs after the page itself is updated, so it seems there might be something going wrong in the job queue. We'll check into it

CBogen moved this task from Triage to Tracking on the Structured-Data-Backlog board.Mar 24 2021, 2:14 PM

Seems to be getting worse: Still no update after 4 days

Gehel moved this task from needs triage to Current work on the Discovery-Search board.Mar 29 2021, 3:19 PM

Gehel edited projects, added Discovery-Search (Current work); removed Discovery-Search.

Gehel set the point value for this task to 8.Mar 29 2021, 3:32 PM

Gehel moved this task from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.

dcausse claimed this task.Apr 1 2021, 1:22 PM

dcausse moved this task from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.

Change 677504 had a related patch set uploaded (by DCausse; author: DCausse):

[mediawiki/extensions/CirrusSearch@master] Reindex the page on UploadComplete

https://gerrit.wikimedia.org/r/677504

gerritbot added a project: Patch-For-Review.Apr 7 2021, 10:02 AM