structured_data.commons_entity stuck at 2025-01-20
Closed, ResolvedPublic
Actions

Description

spark.sql('show partitions structured_data.commons_entity').show()

+-------------------+
|          partition|
+-------------------+
|snapshot=2024-12-16|
|snapshot=2024-12-23|
|snapshot=2024-12-30|
|snapshot=2025-01-06|
|snapshot=2025-01-13|
|snapshot=2025-01-20|
+-------------------+

Maybe related to T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20? Later data seems to have been successfully dumped though (see https://dumps.wikimedia.org/commonswiki/entities/20250203/) so maybe it's just a problem with ingestion into hive

Downstream tracking task: T385865: Resume data pipeline operations

Related Objects

Mentioned In: T380624: Migrate the airflow-platform-eng scheduler to Kubernetes
T380618: Migrate the airflow-platform-eng database to Kubernetes
T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20
T385865: Resume data pipeline operations
Mentioned Here: T385865: Resume data pipeline operations
T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20

Event Timeline

Cparle created this task.Feb 27 2025, 3:21 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 27 2025, 3:21 PM

Cparle updated the task description. (Show Details)Feb 27 2025, 3:23 PM

mfossati subscribed.Feb 27 2025, 3:24 PM

CC @Ahoelzl @xcollazo .

Michael subscribed.Feb 28 2025, 2:18 PM

Dbrant moved this task from Needs Triage to Tracking on the Wikipedia-Android-App-Backlog board.Mar 3 2025, 7:07 PM

Ahoelzl claimed this task.Mar 3 2025, 9:21 PM

Ahoelzl triaged this task as High priority.

Ahoelzl edited projects, added Data-Engineering (Q3 2025 January 1st - March 31th), Dumps-Generation; removed Data-Engineering.

Agreed this is likely related to T386255, as all the wikibase related dumps appear to not being able to finish. They would typically take 2-3 days, but they've all been running for much more than that:

xcollazo@snapshot1016:~$  systemctl status *wikidata*.service | grep Active -B 3
● wikidatajson-dump.service - Regular jobs to build json snapshot of wikidata
     Loaded: loaded (/lib/systemd/system/wikidatajson-dump.service; static)
     Active: activating (start) since Tue 2025-02-25 22:49:47 UTC; 6 days ago
--

● wikidatardf-all-dumps.service - Regular jobs to build rdf snapshot of wikidata
     Loaded: loaded (/lib/systemd/system/wikidatardf-all-dumps.service; static)
     Active: activating (start) since Mon 2025-02-17 23:00:00 UTC; 2 weeks 0 days ago
--
Warning: some journal files were not opened due to insufficient permissions.
● wikidatardf-truthy-dumps.service - Regular jobs to build rdf snapshot of wikidata truthy statements
     Loaded: loaded (/lib/systemd/system/wikidatardf-truthy-dumps.service; static)
     Active: activating (start) since Tue 2025-02-25 05:39:12 UTC; 1 weeks 0 days ago


xcollazo@snapshot1016:~$  systemctl status *common*.service | grep Active -B 3
● commonsjson-dump.service - Regular jobs to build json snapshot of commons structured data
     Loaded: loaded (/lib/systemd/system/commonsjson-dump.service; static)
     Active: activating (start) since Thu 2025-02-20 22:25:21 UTC; 1 weeks 4 days ago
--

● commonsrdf-dump.service - Regular jobs to build rdf snapshot of commons structured data
     Loaded: loaded (/lib/systemd/system/commonsrdf-dump.service; static)
     Active: activating (start) since Sat 2025-02-22 15:07:27 UTC; 1 weeks 2 days ago

xcollazo mentioned this in T386255: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20.Mar 4 2025, 2:41 PM

HNordeenWMF moved this task from Needs Triage to Up next on the Wikipedia-iOS-App-Backlog board.Mar 4 2025, 6:34 PM

Seddon moved this task from Up next to Tracking on the Wikipedia-iOS-App-Backlog board.Mar 7 2025, 3:58 AM

• Stevemunene mentioned this in T380618: Migrate the airflow-platform-eng database to Kubernetes.Mar 10 2025, 1:16 PM

• Stevemunene mentioned this in T380624: Migrate the airflow-platform-eng scheduler to Kubernetes.

Still stuck at 2025-01-20

Ahoelzl moved this task from Next Up to In progress on the Data-Engineering (Q3 2025 January 1st - March 31th) board.Mar 17 2025, 2:40 PM

Ahoelzl moved this task from In progress to Blocked/Paused on the Data-Engineering (Q3 2025 January 1st - March 31th) board.

KStoller-WMF moved this task from Inbox to Tracking on the Growth-Team board.Mar 21 2025, 4:07 PM

JAllemandou moved this task from Blocked/Paused to Done on the Data-Engineering (Q3 2025 January 1st - March 31th) board.Mar 24 2025, 3:16 PM

show partitions commons_entity;
OK
partition
snapshot=2025-01-06
snapshot=2025-01-13
snapshot=2025-01-20
snapshot=2025-03-03
snapshot=2025-03-10
snapshot=2025-03-17

Cparle closed this task as Resolved.Mar 31 2025, 4:47 PM

structured_data.commons_entity stuck at 2025-01-20Closed, ResolvedPublicActions

Description

Related Objects

Event Timeline

structured_data.commons_entity stuck at 2025-01-20
Closed, ResolvedPublic
Actions