Page MenuHomePhabricator
Create Task
Maniphest T386098

Run a full data-reload on wdqs-main, wdqs-scholarly and wdqs to capture new blank node labels
Closed, ResolvedPublic
Actions

Description

When T384344 is deployed and one dump is available we should perform a data-reload to capture the changes in how blank nodes are labelled.

Pre-requisites:

  • wmgWikibaseTmpFixRdf is set to true on wikidatawiki (https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1118486)
  • entity & lexeme dumps generated with wmgWikibaseTmpFixRdf=true are available at:
    • [PLACEHOLDER FOR ENTITY DUMP URL]
    • [PLACEHOLDER FOR LEXEME DUMP URL]
    • [PLACEHOLDER FOR FULL DUMP HDFS PATH]
    • [PLACEHOLDER FOR WDQS-MAIN DUMP HDFS PATH]
    • [PLACEHOLDER FOR WDQS-SCHOLARLY DUMP HDFS PATH]

AC:

  • reload all wdqs-main, wdqs-scholarly, wdqs, wdqs-internal-main and wdqs-internal-scholarly hosts

Details

Other Assignee
bking

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Aug 5 2025, 5:02 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:02:06Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

bking added a comment.Aug 5 2025, 5:04 PM

Thanks @dcausse . I've started the data-transfers from wdqs1022 for wdqs-main, and I'm keeping track of our progress in this Etherpad . I'll also get a reload started for wdqs-scholarly.

Stashbot added a comment.Aug 5 2025, 5:14 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:14:05Z] <bking@cumin2002> END (ERROR) - Cookbook sre.wdqs.data-transfer (exit_code=97) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 5:14 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:14:25Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 5:14 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:14:28Z] <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 5:14 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:14:49Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 5:14 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:14:53Z] <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 5:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:15:22Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 5:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:15:25Z] <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 5:16 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T17:16:06Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 6:27 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T18:27:15Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs2007.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 7:22 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T19:22:42Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2008.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 8:20 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T20:20:51Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2008.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 8:46 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T20:46:44Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2010.codfw.wmnet w/ force delete existing files, repooling both afterwards

RKemper added a comment.Aug 5 2025, 9:15 PM
In T386098#11061883, @bking wrote:

Thanks @dcausse . I've started the data-transfers from wdqs1022 for wdqs-main, and I'm keeping track of our progress in this Etherpad . I'll also get a reload started for wdqs-scholarly.

Just following up here, scholarly reload has already been done previously (https://phabricator.wikimedia.org/T386098#10881421) so we just need a data transfer from wdqs1023->wdqs1024

Stashbot added a comment.Aug 5 2025, 9:17 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T21:17:20Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1024.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 9:17 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T21:17:23Z] <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1024.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 9:18 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T21:18:19Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1024.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 9:46 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T21:46:19Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2010.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 10:05 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T22:05:11Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1024.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 10:55 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T22:55:48Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2011.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 5 2025, 11:55 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-05T23:55:22Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2011.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 1:18 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T13:18:28Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2012.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 1:20 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T13:20:37Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1011.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 2:18 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T14:18:03Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2012.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 2:19 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T14:19:05Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1011.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 2:50 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T14:50:10Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2013.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 2:50 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T14:50:39Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1012.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 3:46 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T15:46:41Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2013.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 3:48 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T15:48:45Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1012.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 5:17 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T17:17:23Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2014.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 5:19 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T17:19:34Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1013.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 6:13 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T18:13:49Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2014.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 6:17 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T18:17:54Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1013.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 8:53 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T20:53:51Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2015.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 8:59 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T20:59:23Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1014.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 9:50 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T21:50:55Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2015.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 6 2025, 9:57 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-06T21:57:54Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1014.eqiad.wmnet w/ force delete existing files, repooling both afterwards

RKemper mentioned this in T367409: Measure the time to recovery of WDQS after the graph split.Aug 6 2025, 10:10 PM
Stashbot added a comment.Aug 7 2025, 5:36 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T05:36:15Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1015.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 5:36 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T05:36:21Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2021.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 6:33 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T06:33:08Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2021.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 6:34 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T06:34:56Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1015.eqiad.wmnet w/ force delete existing files, repooling both afterwards

dcausse closed subtask T393713: Regularly reconcile items with delete blank nodes as Resolved.Aug 7 2025, 12:43 PM
Stashbot added a comment.Aug 7 2025, 5:26 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T17:26:03Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1015.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 5:27 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T17:27:18Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2022.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 6:23 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T18:23:24Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2022.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 6:24 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T18:24:23Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1015.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 9:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T21:15:06Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1016.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 9:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T21:15:15Z] <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2018.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 10:09 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T22:09:02Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2018.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 7 2025, 10:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-07T22:15:35Z] <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1022.eqiad.wmnet -> wdqs1016.eqiad.wmnet w/ force delete existing files, repooling both afterwards

dcausse added a comment.Aug 14 2025, 10:32 AM

@RKemper, @bking could you finish the transfer on wdqs-main (wdqs1017 & wdqs1021), these two hosts are returning some inconsistent results (https://www.wikidata.org/wiki/Wikidata:Report_a_technical_problem/WDQS_and_Search#item_returns_2_different_schema:dateModified_values), thanks!

BTullis edited projects, added Data-Platform-SRE (2025.08.16 - 2025.09.05); removed Data-Platform-SRE (2025.07.26 - 2025.08.15).Aug 20 2025, 10:30 AM
BTullis moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.08.16 - 2025.09.05) board.
Stashbot added a comment.Aug 20 2025, 9:23 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:23:15Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 9:23 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:23:19Z] <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet w/ force delete existing files, repooling both afterwards

bking added a comment.EditedAug 20 2025, 9:28 PM

@dcausse Sorry for the delay, we are working through this here . I've responded on the Wikidata page as well.

Stashbot added a comment.Aug 20 2025, 9:30 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:30:09Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 9:39 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:39:04Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1012.eqiad.wmnet -> wdqs1017.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 9:42 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:41:59Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1013.eqiad.wmnet -> wdqs1021.eqiad.wmnet w/ force delete existing files, repooling both afterwards

RKemper added a comment.EditedAug 20 2025, 9:44 PM
In T386098#11104362, @bking wrote:

@dcausse Sorry for the delay, we are working through this here . I've responded on the Wikidata page as well. Is there a test query we can run against each host to verify the blank node-related changes have been applied?

Looks like we'd test with

SELECT DISTINCT ?item ?itemDescription ?modified WHERE {
  VALUES ?item {wd:Q1297941}
  SERVICE wikibase:label {bd:serviceParam wikibase:language "en-gb,mul,en"}
  ?item schema:dateModified ?modified .
  FILTER(BOUND(?modified) && DATATYPE(?modified) = xsd:dateTime).
}
GROUP BY ?item ?itemDescription ?modified``` while tunnelled into a specific host, with `7 March 2025` as the expected result.

Anyway, Brian and I have kicked off the transfers on those 2 remaining hosts so the inconsistency issues should be resolved in ~1h.

Stashbot added a comment.Aug 20 2025, 9:51 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:51:39Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2019.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 9:52 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:52:15Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2008.codfw.wmnet -> wdqs2020.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 9:57 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T21:57:44Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2023.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 10:21 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T22:21:54Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 10:31 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T22:31:55Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1012.eqiad.wmnet -> wdqs1017.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 10:32 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T22:32:00Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1013.eqiad.wmnet -> wdqs1021.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 10:45 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T22:45:41Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2008.codfw.wmnet -> wdqs2020.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 10:47 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T22:47:43Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2007.codfw.wmnet -> wdqs2019.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 20 2025, 10:50 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-20T22:50:08Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2023.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 4:33 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T04:33:44Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 5:24 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T05:24:56Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 5:25 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T05:25:27Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 6:19 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T06:19:20Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 6:22 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T06:22:42Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2026.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 7:13 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T07:13:19Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2026.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 3:25 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T15:25:43Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 3:32 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T15:32:24Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 3:32 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T15:32:29Z] <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 3:33 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T15:33:50Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 3:33 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T15:33:54Z] <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 3:34 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T15:34:16Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 4:16 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T16:16:25Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 4:23 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T16:23:55Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs1023.eqiad.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 8:32 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T20:32:29Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2024.codfw.wmnet -> wdqs2027.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 8:32 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T20:32:34Z] <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2024.codfw.wmnet -> wdqs2027.codfw.wmnet w/ force delete existing files, repooling both afterwards

dseomn unsubscribed.Aug 21 2025, 8:34 PM
Stashbot added a comment.Aug 21 2025, 8:48 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T20:48:28Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2024.codfw.wmnet -> wdqs2027.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 9:22 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T21:22:34Z] <ryankemper> T386098 Depooled eqiad wdqs-internal-scholarly in preparation for data transfer

Stashbot added a comment.Aug 21 2025, 9:22 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T21:22:54Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1027.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 9:23 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T21:23:08Z] <ryankemper@cumin2002> END (ERROR) - Cookbook sre.wdqs.data-transfer (exit_code=97) (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1027.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 9:23 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T21:23:34Z] <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-transfer (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1027.eqiad.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 9:35 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T21:35:29Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer wikidata_main from wdqs2024.codfw.wmnet -> wdqs2027.codfw.wmnet w/ force delete existing files, repooling both afterwards

Stashbot added a comment.Aug 21 2025, 10:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-21T22:15:54Z] <ryankemper@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T386098, transfer newly-reloaded data) xfer scholarly_articles from wdqs1023.eqiad.wmnet -> wdqs1027.eqiad.wmnet w/ force delete existing files, repooling both afterwards

RKemper moved this task from In Progress to Done on the Data-Platform-SRE (2025.08.16 - 2025.09.05) board.Aug 21 2025, 11:44 PM

Last hosts are done

RKemper closed this task as Resolved.Aug 26 2025, 3:05 PM
Gehel moved this task from Done to Reported on the Data-Platform-SRE (2025.08.16 - 2025.09.05) board.Sep 5 2025, 12:46 PM
Gehel added a project: Essential-Work.Sep 5 2025, 3:03 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits