Page MenuHomePhabricator
Create Task
Maniphest T388378

Orchestrate dumps v1 from an airflow instance
Closed, ResolvedPublic
Actions

Description

We would like to orchestrate the dumps v1 jobs from an airflow instance, which would give us observability, retries, etc, for free. For this to happen, we need to write a DAG that would fetch the CronJob spec provisioned in T352650, extract the pod spec from it and start it via KubernetesPodOperator.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
mediawiki-dumps-legacy: deploy the sync toolbox with the sync imageoperations/deployment-chartsmaster+26 -12
Airflow: Add local settings to enable the xcom_sidecar functionalityoperations/deployment-chartsmaster+30 -1
Bump up the CPU and RAM resources for airflow related namespacesoperations/deployment-chartsmaster+17 -9
Reduce the limits on the default kubernetes pod operator tasksoperations/deployment-chartsmaster+3 -3
Bump the resources available to airflow kubernetes pod operator tasksoperations/deployment-chartsmaster+5 -5
mediawiki-dumps-legacy: render a test config fileoperations/deployment-chartsmaster+186 -1
Fix settings deserializing by adjusing the indicesoperations/dumpsmaster+4 -4
Use abspaths when sub-processing dumps commandsoperations/dumpsmaster+10 -3
Query the wiki API through envoy when running in kubernetesoperations/dumpsmaster+21 -2
mediwiki-dumps-legacy: add missing configuration templatesoperations/deployment-chartsmaster+401 -4
mediawiki-dumps-legacy: add missing values files in the helmfile values listoperations/deployment-chartsmaster+2 -0
mediawiki-dumps-legacy: add missing network policiesoperations/deployment-chartsmaster+151 -3
Prevent mysql passwords from being logged to stdoutoperations/dumpsmaster+13 -1
Fix typo in image tagoperations/deployment-chartsmaster+1 -1
Upgrade airflow-providers-cncf-kubernetesoperations/deployment-chartsmaster+1 -1
xmldumps-backup: enable the worker script to be called from any pathoperations/dumpsmaster+5 -5
mediawiki-dumps-legacy: enabled the dumps feature flagoperations/deployment-chartsmaster+13 -155
mediawiki: render configmaps when dumps are enabledoperations/deployment-chartsmaster+5 -5
airflow-analytics-test: bind the airflow-dumps clusterRoleoperations/deployment-chartsmaster+4 -5
airflow: allow binding the airflow-dumps ClusterRole to the airflow SAoperations/deployment-chartsmaster+28 -1
rbac: deploy the airflow-dumps ClusterRole to dse-k8s-eqiadoperations/deployment-chartsmaster+16 -0
global_config: register the analytics wikireplica in external servicesoperations/puppetproduction+67 -0
mediawiki-dumps-legacy: grant the orchetrator SA the ability to read pod logsoperations/deployment-chartsmaster+4 -1
Move sidecar controller and the pspClusteRole to the mediawiki-dumps-legacy nsoperations/deployment-chartsmaster+2 -2
mediawiki-dumps-legacy: deploy the chart with a role allowed to create role(binding)soperations/deployment-chartsmaster+43 -0
mediawiki-dumps-legacy: define a standalone chart for the resources required by the dumpsoperations/deployment-chartsmaster+651 -13
mediawiki-dumps-legacy: restore deployment to the mediawiki-dumps-legacy nsoperations/deployment-chartsmaster+5 -5
airflow-analytics-test: enable sidecar job controller and the mediawiki PSPoperations/deployment-chartsmaster+2 -0
mediawiki-dumps-legacy: add missing cpu limitoperations/deployment-chartsmaster+1 -0
airflow-analytics-test: fix typo in rbacoperations/deployment-chartsmaster+1 -1
mediawiki-dumps-legacy: fix issues preventing to deploy in airflow-analytics-testoperations/deployment-chartsmaster+3 -3
airflow-analyics-test: grant permissions to read Jobs in the namespaceoperations/deployment-chartsmaster+11 -1
mediawiki-dumps-legacy: deploy the cronjob template in airflow-analytics-testoperations/deployment-chartsmaster+2 -2
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT88728 Improve Wikimedia dumping infrastructure
 ResolvedBTullisT352650 WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/25 - Migrate current-generation dumps to run on kubernetes
 ResolvedbrouberolT388378 Orchestrate dumps v1 from an airflow instance
 ResolvedbrouberolT389762 Monitor the free space in the dumps v1 Ceph volume
 ResolvedbrouberolT389770 Adjust the dumps v1 task retry policy
 ResolvedBTullisT389773 Adjust maximum number of mapped tasks in the airflow instance
 ResolvedbrouberolT389777 Monitor the resource usage in the mediawiki-dumps-legacy namespace
 ResolvedBTullisT389778 Monitor the load on the Kubernetes API masters
 ResolvedbrouberolT389782 Adjust dump tasks resources after observing real-life data
 ResolvedBTullisT389784 Synchronize the dumps files to the clouddumps hosts
 ResolvedBTullisT390736 Create a container image containing the necessary sync utilities for publishing dump files
 ResolvedBTullisT390738 [dumps] Configure rsyncd authentication - or a suitable alternative
 ResolvedbrouberolT389786 Integrate mediawiki-dumps-legacy with the regular MW scap deployments
 ResolvedbrouberolT389931 Prototype the airflow DAG responsible for running the xml-sql v1 dumps jobs
 ResolvedBTullisT389962 Differentiate full and partial dumps in the DAGs
 ResolvedbrouberolT389759 Document the dumps v1 on airflow infrastructure
 ResolvedbrouberolT390059 Large wiki dump is getting stuck when running in airflow
 ResolvedbrouberolT390110 Make it possible to run manual dumps command from the toolbox pod
 ResolvedbrouberolT390186 Integrate recent contributions to the KubernetesPodExecutor
 ResolvedbrouberolT390852 Split wiki dump DAG into multiple tasks
 ResolvedbrouberolT390945 Run an experimental dump of 200 regular sized wikis
 ResolvedbrouberolT391332 Create a dashboard displaying airflow pool, scheduler, executor and operator activity
 ResolvedbrouberolT391481 Disable XCOMs for dump tasks
 ResolvedbrouberolT391480 Experiment with absolute priority weights
 ResolvedbrouberolT391466 Add more failure tolerance to the dumps DAGs
 ResolvedbrouberolT391497 Adjust the scheduler liveness checks to account for periods of high load
 ResolvedbrouberolT391510 Tolerate dump task pods being OOM killed
 ResolvedbrouberolT391556 Adjust the scheduler resource requirements
 ResolvedbrouberolT391483 Experiment with disabling dynamic task mapping
 ResolvedbrouberolT391678 Adjust the file processing interval
 ResolvedBTullisT391564 Adjust the database resource requirements
 ResolvedbrouberolT391669 Investigate how to run more than 16 parallel dump task instances
 ResolvedbrouberolT391684 Experiment with running multiple concurrent dump DAGs to keep each graph relatively low in size
 ResolvedbrouberolT391744 Increase file processing timeout
 ResolvedbrouberolT391745 Write a DAG checking that the statically defined list of DAGs matches what NOC returns
 ResolvedBTullisT391791 Adjust database retention settings
 ResolvedBTullisT391837 Investigate running the largest wikis with a higher priority weight
 ResolvedbrouberolT392461 Batch dump jobs within a single airflow task to speed up DAG execution
 ResolvedbrouberolT392470 Increase mediawiki-dumps-legacy namespace quotas to enable running 32 parallel pods
 ResolvedbrouberolT392987 Adjust webserver resources
 ResolvedbrouberolT392995 Completed dump pods take a long time to get terminated
 ResolvedbrouberolT391492 Infer the --date parameter from the DAG scheduling date
 ResolvedBTullisT391087 Investigate an incident where the airflow-test-k8s database was wiped
 ResolvedbrouberolT391348 airflow: Restrict the rights for airflow deployers to destroy postgresql clusters
 ResolvedBTullisT392915 Batch dump jobs in a way that makes business sense
 ResolvedbrouberolT393407 Untangle dump DAG dependencies
 ResolvedBTullisT393687 Skip sync tasks for private wikis, or allow them to fail gracefully
 ResolvedbrouberolT393689 Create a sync-toolbox pod that is similar to the dump-toolbox pod
 ResolvedbrouberolT397039 Set a proper DAG run timeout on the dump DAGs

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
brouberol closed subtask T390059: Large wiki dump is getting stuck when running in airflow as Resolved.Apr 8 2025, 2:58 PM
brouberol added a subtask: T391466: Add more failure tolerance to the dumps DAGs.Apr 9 2025, 12:10 PM
brouberol added a subtask: T391480: Experiment with absolute priority weights.Apr 9 2025, 2:02 PM
brouberol added a subtask: T391481: Disable XCOMs for dump tasks.
brouberol added a subtask: T391483: Experiment with disabling dynamic task mapping.Apr 9 2025, 2:09 PM
brouberol removed a subtask: T391481: Disable XCOMs for dump tasks.Apr 9 2025, 3:24 PM
brouberol removed a subtask: T391480: Experiment with absolute priority weights.
brouberol removed a subtask: T391466: Add more failure tolerance to the dumps DAGs.
brouberol added a subtask: T391492: Infer the --date parameter from the DAG scheduling date.Apr 9 2025, 3:26 PM
brouberol removed a subtask: T391483: Experiment with disabling dynamic task mapping.Apr 10 2025, 7:48 AM
brouberol closed subtask T391492: Infer the --date parameter from the DAG scheduling date as Resolved.Apr 10 2025, 11:59 AM
brouberol added a subtask: T391087: Investigate an incident where the airflow-test-k8s database was wiped.Apr 10 2025, 1:28 PM
Gehel edited projects, added Data-Platform-SRE (2025.04.12 - 2025.05.02); removed Data-Platform-SRE (2025.03.22 - 2025.04.11).Apr 11 2025, 1:14 PM
Gehel moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.04.12 - 2025.05.02) board.
brouberol added a subtask: T391791: Adjust database retention settings.Apr 14 2025, 7:18 AM
brouberol removed a subtask: T391791: Adjust database retention settings.Apr 14 2025, 2:14 PM
brouberol changed the status of subtask T389786: Integrate mediawiki-dumps-legacy with the regular MW scap deployments from Open to In Progress.Apr 16 2025, 2:55 PM
brouberol closed subtask T389770: Adjust the dumps v1 task retry policy as Resolved.Apr 23 2025, 11:21 AM
brouberol changed the status of subtask T389777: Monitor the resource usage in the mediawiki-dumps-legacy namespace from Open to In Progress.Apr 23 2025, 12:56 PM
brouberol closed subtask T389777: Monitor the resource usage in the mediawiki-dumps-legacy namespace as Resolved.Apr 24 2025, 6:53 AM
brouberol closed subtask T389782: Adjust dump tasks resources after observing real-life data as Resolved.Apr 24 2025, 12:37 PM
CodeReviewBot added a comment.Apr 29 2025, 1:42 PM

brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1274

Add new wiki recently introduced in noc

CodeReviewBot added a comment.Apr 29 2025, 1:54 PM

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1274

Add new wiki recently introduced in noc

brouberol added a subtask: T392915: Batch dump jobs in a way that makes business sense.Apr 29 2025, 3:54 PM
brouberol changed the status of subtask T392915: Batch dump jobs in a way that makes business sense from Open to In Progress.
brouberol changed the status of subtask T389759: Document the dumps v1 on airflow infrastructure from Open to In Progress.Apr 30 2025, 12:44 PM
brouberol changed the status of subtask T389784: Synchronize the dumps files to the clouddumps hosts from Open to In Progress.May 5 2025, 9:56 AM
Gehel edited projects, added Data-Platform-SRE (2025.05.02 - 2025.05.23); removed Data-Platform-SRE (2025.04.12 - 2025.05.02).May 5 2025, 12:49 PM
Gehel moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.05.02 - 2025.05.23) board.
brouberol added a subtask: T393407: Untangle dump DAG dependencies.May 5 2025, 6:09 PM
Gehel moved this task from In Progress to Tracking on the Data-Platform-SRE (2025.05.02 - 2025.05.23) board.May 6 2025, 12:32 PM
BTullis removed a subtask: T389779: Enable transparent compression of Airflow task logs in S3.May 7 2025, 2:02 PM
brouberol closed subtask T389784: Synchronize the dumps files to the clouddumps hosts as Resolved.May 7 2025, 2:35 PM
gerritbot added a comment.May 8 2025, 9:16 AM

Change #1143495 had a related patch set uploaded (by Btullis; author: Btullis):

[operations/deployment-charts@master] Bump the resources available to airflow kubernetes pod operator tasks

https://gerrit.wikimedia.org/r/1143495

gerritbot added a comment.May 8 2025, 9:23 AM

Change #1143495 merged by jenkins-bot:

[operations/deployment-charts@master] Bump the resources available to airflow kubernetes pod operator tasks

https://gerrit.wikimedia.org/r/1143495

BTullis reopened subtask T389784: Synchronize the dumps files to the clouddumps hosts as Open.May 8 2025, 11:19 AM
gerritbot added a comment.May 8 2025, 11:23 AM

Change #1143531 had a related patch set uploaded (by Btullis; author: Btullis):

[operations/deployment-charts@master] Reduce the limits on the default kubernetes pod operator tasks

https://gerrit.wikimedia.org/r/1143531

gerritbot added a comment.May 8 2025, 11:41 AM

Change #1143531 merged by jenkins-bot:

[operations/deployment-charts@master] Reduce the limits on the default kubernetes pod operator tasks

https://gerrit.wikimedia.org/r/1143531

BTullis closed subtask T389784: Synchronize the dumps files to the clouddumps hosts as Resolved.May 9 2025, 9:03 AM
BTullis closed subtask T393687: Skip sync tasks for private wikis, or allow them to fail gracefully as Resolved.May 12 2025, 1:11 PM
brouberol closed subtask T392915: Batch dump jobs in a way that makes business sense as Resolved.May 13 2025, 2:39 PM
brouberol reopened subtask T392915: Batch dump jobs in a way that makes business sense as In Progress.
brouberol closed subtask T393407: Untangle dump DAG dependencies as Resolved.
brouberol changed the status of subtask T393689: Create a sync-toolbox pod that is similar to the dump-toolbox pod from Open to In Progress.May 20 2025, 8:10 AM
brouberol closed subtask T393689: Create a sync-toolbox pod that is similar to the dump-toolbox pod as Resolved.May 20 2025, 9:51 AM
Gehel edited projects, added Data-Platform-SRE (2025.05.24 - 2025.06.13); removed Data-Platform-SRE (2025.05.02 - 2025.05.23).May 23 2025, 1:07 PM
Gehel moved this task from Backlog - project to Tracking on the Data-Platform-SRE (2025.05.24 - 2025.06.13) board.
gerritbot added a comment.Jun 6 2025, 9:31 AM

Change #1154248 had a related patch set uploaded (by Btullis; author: Btullis):

[operations/deployment-charts@master] Airflow: Add local settings to enable the xcom_sidecar functionality

https://gerrit.wikimedia.org/r/1154248

BTullis closed subtask T392915: Batch dump jobs in a way that makes business sense as Resolved.Jun 11 2025, 1:54 PM
BTullis closed subtask T390945: Run an experimental dump of 200 regular sized wikis as Resolved.Jun 11 2025, 1:58 PM
gerritbot added a comment.Jun 12 2025, 2:47 PM

Change #1156377 had a related patch set uploaded (by Btullis; author: Btullis):

[operations/deployment-charts@master] Bump up the CPU and RAM resources for airflow related namespaces

https://gerrit.wikimedia.org/r/1156377

gerritbot added a comment.Jun 12 2025, 4:02 PM

Change #1156377 merged by jenkins-bot:

[operations/deployment-charts@master] Bump up the CPU and RAM resources for airflow related namespaces

https://gerrit.wikimedia.org/r/1156377

Gehel edited projects, added Data-Platform-SRE (2025.06.13 - 2025.07.04); removed Data-Platform-SRE (2025.05.24 - 2025.06.13).Jun 13 2025, 8:49 AM
Gehel moved this task from Backlog - project to Tracking on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.
BTullis closed subtask T389962: Differentiate full and partial dumps in the DAGs as Resolved.Jun 13 2025, 2:22 PM
BTullis reopened subtask T389927: Display a link to the Grafana pod usage dashboard in the airflow dump task instance page as Open.Jun 13 2025, 2:51 PM
brouberol added a subtask: T397039: Set a proper DAG run timeout on the dump DAGs.Jun 16 2025, 1:34 PM
brouberol changed the status of subtask T397039: Set a proper DAG run timeout on the dump DAGs from Open to In Progress.
brouberol closed subtask T397039: Set a proper DAG run timeout on the dump DAGs as Resolved.Jun 16 2025, 1:48 PM
brouberol closed subtask T389786: Integrate mediawiki-dumps-legacy with the regular MW scap deployments as Resolved.Jun 16 2025, 5:22 PM
gerritbot added a comment.Jun 18 2025, 4:37 PM

Change #1154248 merged by jenkins-bot:

[operations/deployment-charts@master] Airflow: Add local settings to enable the xcom_sidecar functionality

https://gerrit.wikimedia.org/r/1154248

CodeReviewBot added a comment.Jun 23 2025, 7:52 AM

brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1437

test_k8s/dumps: tag the DAGs with 'partial' or 'full'

CodeReviewBot added a comment.Jun 23 2025, 11:49 AM

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1437

test_k8s/dumps: Adjust the SQL/XML dumps DAGs after their first full scale run

CodeReviewBot added a comment.Jun 23 2025, 12:18 PM

brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1440

(fix) test_k8s/dumps/xml_sql: define both the pod_override and pod_template_file executor configs

CodeReviewBot added a comment.Jun 23 2025, 12:33 PM

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1440

(fix) test_k8s/dumps/xml_sql: define both the pod_override and pod_template_file executor configs

gerritbot added a comment.Jun 23 2025, 3:56 PM

Change #1162954 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] mediawiki-dumps-legacy: deploy the sync toolbox with the sync image

https://gerrit.wikimedia.org/r/1162954

gerritbot added a comment.Jun 23 2025, 4:14 PM

Change #1162954 merged by Brouberol:

[operations/deployment-charts@master] mediawiki-dumps-legacy: deploy the sync toolbox with the sync image

https://gerrit.wikimedia.org/r/1162954

CodeReviewBot added a comment.Jun 24 2025, 10:43 AM

btullis opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1455

Dumps_v1: Configure data-engineering-alerts@w.o for all dump alerts

CodeReviewBot added a comment.Jun 24 2025, 11:05 AM

brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1456

test_k8s/dumps: rely on the dagrun logical date instead of start date to craft folder names

CodeReviewBot added a comment.Jun 24 2025, 11:34 AM

btullis merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1455

Dumps_v1: Configure data-engineering-alerts@w.o for all dump alerts

CodeReviewBot added a comment.Jun 24 2025, 11:36 AM

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1456

test_k8s/dumps: rely on the dagrun data interval end date instead of start date to craft folder names

CodeReviewBot added a comment.Jun 24 2025, 2:18 PM

brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1457

test_k8s/dumps/xml_sql: remove obsolete comment

CodeReviewBot added a comment.Jun 24 2025, 2:23 PM

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1457

test_k8s/dumps/xml_sql: remove obsolete comment

CodeReviewBot added a comment.Jun 24 2025, 2:44 PM

brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1458

test_k8s/dumps/xml_sql: cleanup task definition

CodeReviewBot added a comment.Jun 24 2025, 2:49 PM

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1458

test_k8s/dumps/xml_sql: cleanup task definition

CodeReviewBot added a comment.Jun 25 2025, 11:31 AM

btullis opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1461

Dumps_v1: Tidy and make uniform the fetch_job_pod_spec tasks

CodeReviewBot added a comment.Jun 25 2025, 1:29 PM

btullis merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1461

Dumps_v1: Tidy and make uniform the fetch_job_pod_spec tasks

CodeReviewBot added a comment.Jun 25 2025, 2:09 PM

btullis opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1463

Dumps_v1: DRY up the parallel-rsync default arguments

CodeReviewBot added a comment.Jun 25 2025, 2:19 PM

btullis merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1463

Dumps_v1: DRY up the parallel-rsync default arguments

CodeReviewBot added a comment.Jun 25 2025, 2:43 PM

btullis opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1465

Dumps_v1: Miscellaneous schedule_interval fixes

CodeReviewBot added a comment.Jun 26 2025, 8:32 AM

btullis merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1465

Dumps_v1: Miscellaneous schedule_interval fixes

CodeReviewBot added a comment.Jun 26 2025, 1:26 PM

brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1473

test_k8s/dumps: mark all dumps are active

CodeReviewBot added a comment.Jun 26 2025, 1:37 PM

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1473

test_k8s/dumps: mark all dumps are active

Maintenance_bot removed a project: Patch-For-Review.Jun 26 2025, 2:31 PM
brouberol closed subtask T389759: Document the dumps v1 on airflow infrastructure as Resolved.Jun 27 2025, 8:30 AM
BTullis closed subtask T389778: Monitor the load on the Kubernetes API masters as Resolved.Jul 2 2025, 12:16 PM
BTullis removed a subtask: T389771: Display a link to the dump HTML page in the airflow dump task instance page.Jul 2 2025, 12:26 PM
BTullis removed a subtask: T389774: Automatically create a phabricator ticket when a dump SLA is missed.
BTullis removed a subtask: T389783: Create more sophisticated monitors for the various dump types.Jul 2 2025, 12:32 PM
BTullis removed a subtask: T389785: Adjust the pool parallelism settings after having performed a load test of the dumpsv1 process.
BTullis removed a subtask: T389927: Display a link to the Grafana pod usage dashboard in the airflow dump task instance page.
BTullis closed this task as Resolved.Jul 2 2025, 12:47 PM
BTullis moved this task from Tracking to Done on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.
BTullis subscribed.

I'm calling this done, as we have made the switch from bare-metal to Airflow in T397848: Switch over the Dumps_v1 system to run from Airflow instead of snapshot servers

BTullis moved this task from Done to Reported on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.Jul 4 2025, 3:57 PM
xcollazo mentioned this in T413767: Some wikimedia 20260101 dump files missing.Jan 5 2026, 6:35 PM
mykhal subscribed.Jan 5 2026, 6:56 PM
Restricted Application added a project: Data-Engineering. · View Herald TranscriptJan 5 2026, 6:56 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits