Wikimedia hashtag search - continues to have delays
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	klaul
	Feb 27 2024, 7:23 AM

Description

Good day!
Earlier this year I submitted a report on Wikimedia hashtag search for not returning results. It took awhile to catch up but eventually, towards beginning of February it was working.
Now we started a new campaign in Romanian language Wikipedia (#wikimartisor - our WikiGap) and we need to monitor the participation. Just like last year, we were counting on Wikimedia hashtag search for help but it looks like it has delays again.
Please provide the needed support for this tool to work. We are counting on it for a number of local campaigns (there is another campaign in April).
In case this tool will not be maintained anymore please let the affiliates know ahead of time so we can budget time and resources to find alternatives for running our campaigns.

Thank you,

Claudia

Related Objects

Mentioned In: T343104: Hashtags not reflecting new changes

Event Timeline

klaul created this task.Feb 27 2024, 7:23 AM

Restricted Application added a subscriber: Strainu. · View Herald TranscriptFeb 27 2024, 7:23 AM

Strainu added a project: Moderator-Tools-Team.Feb 27 2024, 7:29 AM

Strainu added subscribers: Samwalton9-WMF, jsn.sherman.

It looks like data stopped collecting 7 days ago. The scripts container has the following error:

Traceback (most recent call last):
  File "/scripts/scripts/collect_hashtags.py", line 160, in <module>
    db.insert_db(hashtag, change)
  File "/scripts/scripts/db.py", line 39, in insert_db
    change['user'],
KeyError: 'user'

It seems odd to me that the event stream would be sending an event, which we deem a valid hashtagged edit, that has no user information. Will investigate further.

FRomeo_WMF added a subscriber: Sadads.Feb 27 2024, 11:31 AM

Oh I believe this might be related to changes from T241178. The first example edit I checked without user information had had the username suppressed. I think we should just skip edits entirely without user, as the edit was presumably damaging.

Filed https://github.com/WikipediaLibrary/hashtags/pull/83

Samwalton9-WMF triaged this task as High priority.Feb 27 2024, 11:38 AM

Samwalton9-WMF moved this task from Ready to Eng review on the Moderator-Tools-Team (Kanban) board.

Data is catching up again. Thanks for spotting this!

Samwalton9-WMF mentioned this in T343104: Hashtags not reflecting new changes.Feb 28 2024, 3:15 PM

Wikimedia hashtag search - continues to have delaysClosed, ResolvedPublicActions

Description

Related Objects

Event Timeline

Wikimedia hashtag search - continues to have delays
Closed, ResolvedPublic
Actions