Page MenuHomePhabricator
Create Task
Maniphest T385865

Resume data pipeline operations
Closed, ResolvedPublic
Actions

Description

Tasks

  • resume ALIS
  • let SLIS and and relevant DAG dependencies consume wikitext's latest available snapshot (2024-11 as of now)

Blocked by T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20.
Blocked by T390839: The 20250401 dumps haven't started on time because the mediawikiwiki dump from 20250320 is looping.
T389517: [L] Update seal and section-topics to use wmf_content.mediawiki_content_history_v1 instead of wmf.mediawiki_wikitext_current can unblock.
T394757: Update relevant data pipelines to wmf_content.mediawiki_content_current_v1 can unblock.

Related Objects
Search...

Event Timeline

mfossati created this task.Feb 7 2025, 10:33 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 7 2025, 10:33 AM
mfossati added a parent task: T340437: [EPIC] Image suggestions data pipelines maintenance .Feb 7 2025, 10:33 AM
mfossati moved this task from Incoming to Ready for Development on the Structured-Data-Backlog (Current Work) board.
mfossati claimed this task.Feb 10 2025, 10:34 AM
mfossati moved this task from Ready for Development to Doing on the Structured-Data-Backlog (Current Work) board.
mfossati added a comment.Feb 10 2025, 3:55 PM

Important

At the time of writing this comment, wmf.wikidata_item_page_link and wmf.wikidata_entity latest available snapshots are 2025-01-20.
I've resumed all data pipelines with the following inputs:

  • wmf.wikidata_item_page_link and wmf.wikidata_entity = 2025-01-20
  • discovery.cirrus_index_without_content = 20250119
  • ALIS' monthly inputs = 2025-01
  • wmf.mediawiki_wikitext_current = 2024-11
mfossati moved this task from Doing to Verify on Production on the Structured-Data-Backlog (Current Work) board.Feb 10 2025, 3:55 PM
Michael subscribed.Feb 11 2025, 6:49 AM
mfossati moved this task from Verify on Production to Doing on the Structured-Data-Backlog (Current Work) board.Feb 11 2025, 11:01 AM

T385865#10535846 yielded zero SLIS.
In the meanwhile, wmf.mediawiki_wikitext_current's 2025-01 snapshot became available, so re-running pipelines with it.

Urbanecm_WMF mentioned this in T386116: Create alerts for "Add (Section-) Image" task being broken for users ("No suggestions available").Feb 11 2025, 4:25 PM
mfossati moved this task from Doing to Verify on Production on the Structured-Data-Backlog (Current Work) board.Feb 11 2025, 6:49 PM
mfossati added a comment.Feb 12 2025, 12:02 PM

T385865#10538331 yielded zero section topics, which should also entail zero SLIS. The intuition is that mismatched input snapshots seem to disrupt SLIS.
SLIS is still at 2024-12-23, so I reset its Cassandra TTL.
ALIS is at 2025-01-20.

As of now, wmf.wikidata_item_page_link and wmf.wikidata_entity latest available snapshots are still 2025-01-20. I don't think it makes sense to resume normal operations if weekly inputs are missing.
I have paused all pipelines again.

mfossati moved this task from Verify on Production to Blocked on the Structured-Data-Backlog (Current Work) board.Feb 12 2025, 12:03 PM
KStoller-WMF subscribed.Feb 12 2025, 4:21 PM
Michael mentioned this in T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20.Feb 12 2025, 7:11 PM
Ahoelzl subscribed.Feb 18 2025, 5:41 PM

Work is being tracked on DPE side here: https://phabricator.wikimedia.org/T386255

Michael added a comment.Feb 19 2025, 8:00 AM

For reference, the current upstream chain of tasks seems to be:

T385865: Resume data pipeline operations (This task, Structured Data)
⬇️
T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20 (Data Products Engineering)
⬇️
T386401: No wikidata dumps last week (20250203) (Wikibase Platform Team)
⬇️
T384625: Special:EntityData, dump creation: LogicException: Bad transition: 10 -> 10 (Wikidata Dev Team)

Cparle mentioned this in T387470: structured_data.commons_entity stuck at 2025-01-20.Feb 27 2025, 3:21 PM
mfossati added a comment.Feb 28 2025, 12:32 PM
In T385865#10562380, @Michael wrote:

For reference, the current upstream chain of tasks seems to be:

T385865: Resume data pipeline operations (This task, Structured Data)
⬇️
T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20 (Data Products Engineering)

Update: also T387470: structured_data.commons_entity stuck at 2025-01-20

⬇️
T386401: No wikidata dumps last week (20250203) (Wikibase Platform Team)
⬇️
T384625: Special:EntityData, dump creation: LogicException: Bad transition: 10 -> 10 (Wikidata Dev Team)

AUgolnikova-WMF triaged this task as Unbreak Now! priority.Mar 19 2025, 4:39 PM
AUgolnikova-WMF updated the task description. (Show Details)
AUgolnikova-WMF moved this task from Blocked to Doing on the Structured-Data-Backlog (Current Work) board.Apr 7 2025, 4:23 PM
mfossati added a comment.EditedApr 8 2025, 8:50 AM

Update

  • weekly dependencies are back
  • ALIS has resumed normal operations - the latest snapshot is 2025-03-24
  • wmf.mediawiki_wikitext_current/snapshot=2025-03 isn't available yet
  • SLIS is also at 2025-03-24, but normal operations are expected to be on hold again, as the next scheduled run will wait for the above dependency

CC @KStoller-WMF @HNordeenWMF @Michael .

mfossati added a subscriber: HNordeenWMF.Apr 8 2025, 8:59 AM
mfossati updated the task description. (Show Details)Apr 9 2025, 9:13 AM
mfossati updated the task description. (Show Details)Apr 11 2025, 9:25 AM
AUgolnikova-WMF moved this task from Doing to Blocked on the Structured-Data-Backlog (Current Work) board.Apr 14 2025, 4:14 PM
mfossati mentioned this in T390880: [L] Verify all Airflow DAGs after migration to Kubernetes.Apr 15 2025, 10:58 AM
mfossati added a comment.Apr 28 2025, 5:02 PM

Update

SLIS is still blocked at 2025-03-24. I reset Cassandra's TTL.

CC @KStoller-WMF @HNordeenWMF @Michael .

HNordeenWMF added a subscriber: Seddon.Apr 28 2025, 5:14 PM

Hi @mfossati please also tag @Seddon for these types of updates, thanks!

mfossati updated the task description. (Show Details)May 23 2025, 10:00 AM

Update

SLIS is still blocked at 2025-03-24. I reset Cassandra's TTL again.
T394757: Update relevant data pipelines to wmf_content.mediawiki_content_current_v1 is in progress and can unblock this ticket.

CC @KStoller-WMF @HNordeenWMF @Seddon @Michael .

mfossati updated the task description. (Show Details)Jun 27 2025, 1:30 PM
mfossati closed this task as Resolved.Jun 27 2025, 1:34 PM

Update

T394757: Update relevant data pipelines to wmf_content.mediawiki_content_current_v1 is complete and this week's production runs were successful! 🎉
SLIS is unblocked with fresh data at 2025-06-16. 🎺

CC @KStoller-WMF @HNordeenWMF @Seddon @Michael .

Michael added a comment.Jun 27 2025, 1:39 PM
In T385865#10954100, @mfossati wrote:

Update

T394757: Update relevant data pipelines to wmf_content.mediawiki_content_current_v1 is complete and this week's production runs were successful! 🎉
SLIS is unblocked with fresh data at 2025-06-16. 🎺

CC @KStoller-WMF @HNordeenWMF @Seddon @Michael .

Great news, Thank you!

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits