Page MenuHomePhabricator

atsuko (Atsuko Ito)
User

Projects (5)

Today

  • No visible events.

Tomorrow

  • No visible events.

Sunday

  • No visible events.

User Details

User Since
Mar 30 2026, 1:14 PM (5 w, 4 d)
Availability
Available
IRC Nick
atsukoito
LDAP User
Atsuko
MediaWiki User
Atsuko-WMF [ Global Accounts ]

Recent Activity

Today

atsuko added a comment to T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel.

Plan:

  1. Take @JAllemandou diff for httpd_cas modularisation and finish it. For test, applying it and compare with functional deployment.
  2. Adapt httpd_cas for eventstreams chart and deploy next version of chart.
Fri, May 8, 10:06 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering (Q4 FS25/26 April 1st - June 30st), ServiceOps-Services-Oids, ServiceOps new, Data-Engineering-Radar, Event-Platform

Wed, May 6

atsuko added a comment to T425377: Migrate Ttmserver (Translatewiki application) indices from production OpenSearch to OpenSearch on k8s.

To-Do:

  1. Land the connector diff, consensus is that the change won't affect anything,
  2. Add the password to the connection based on @EBernhardson info,
  3. Test if there any other code needed to get write.
Wed, May 6, 3:18 PM · Patch-For-Review, Language and Product Localization, Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko claimed T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel.
Wed, May 6, 2:16 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering (Q4 FS25/26 April 1st - June 30st), ServiceOps-Services-Oids, ServiceOps new, Data-Engineering-Radar, Event-Platform

Tue, May 5

atsuko changed the status of T420587: Create cookbook to reboot zookeeper for DPE SRE from Open to Stalled.
Tue, May 5, 2:17 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15)
atsuko changed the status of T425377: Migrate Ttmserver (Translatewiki application) indices from production OpenSearch to OpenSearch on k8s from Open to In Progress.

opensearch-ttmserver-test is up, now need to figure out how to migrate indices

Tue, May 5, 12:48 PM · Patch-For-Review, Language and Product Localization, Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko changed the status of T425377: Migrate Ttmserver (Translatewiki application) indices from production OpenSearch to OpenSearch on k8s, a subtask of T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️, from Open to In Progress.
Tue, May 5, 12:48 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko added a comment to T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️.

Trying to roll-out opensearch-ttmserver-test

Tue, May 5, 12:32 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko updated the task description for T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️.
Tue, May 5, 10:10 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko updated the task description for T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️.
Tue, May 5, 8:21 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)

Fri, May 1

atsuko added a subtask for T367315: [Epic] Replace Archiva with Gitlab artifact repositories: T367514: archiva1002 has high disk usage.
Fri, May 1, 11:43 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Essential-Work, Data-Engineering, Java-Scala-Standardization, Epic, Discovery-Search
atsuko added a parent task for T367514: archiva1002 has high disk usage: T367315: [Epic] Replace Archiva with Gitlab artifact repositories.
Fri, May 1, 11:43 AM · Data-Platform-SRE (2024.05.27 - 2024.06.16)
atsuko added a subtask for T367315: [Epic] Replace Archiva with Gitlab artifact repositories: T381961: Increase the capacity of /var/lib/archiva on archiva1002.wikimedia.org.
Fri, May 1, 11:42 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Essential-Work, Data-Engineering, Java-Scala-Standardization, Epic, Discovery-Search
atsuko added a parent task for T381961: Increase the capacity of /var/lib/archiva on archiva1002.wikimedia.org: T367315: [Epic] Replace Archiva with Gitlab artifact repositories.
Fri, May 1, 11:42 AM · Data-Platform-SRE (2024.11.30 - 2024.12.20)
atsuko added a parent task for T391904: archiva1002 - disk 98% full: T367315: [Epic] Replace Archiva with Gitlab artifact repositories.
Fri, May 1, 11:42 AM · Data-Platform-SRE (2025.04.12 - 2025.05.02), SRE
atsuko added a subtask for T367315: [Epic] Replace Archiva with Gitlab artifact repositories: T391904: archiva1002 - disk 98% full.
Fri, May 1, 11:42 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Essential-Work, Data-Engineering, Java-Scala-Standardization, Epic, Discovery-Search
atsuko added a subtask for T367315: [Epic] Replace Archiva with Gitlab artifact repositories: T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space.
Fri, May 1, 11:40 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Essential-Work, Data-Engineering, Java-Scala-Standardization, Epic, Discovery-Search
atsuko added a parent task for T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space: T367315: [Epic] Replace Archiva with Gitlab artifact repositories.
Fri, May 1, 11:40 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), SRE
atsuko changed the status of T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space from In Progress to Stalled.

I manually cleaned up /var/cache/archiva more than wanted, so I can't test the cleaning script/behaviour., will check in a week.

Fri, May 1, 10:42 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), SRE
atsuko moved T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space from Quick Wins to Backlog - operations on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Fri, May 1, 10:40 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), SRE
atsuko moved T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space from Backlog - project to Quick Wins on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Fri, May 1, 10:31 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), SRE
atsuko edited projects for T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space, added: Data-Platform-SRE (2026-04-24 - 2026-05-15); removed Data-Platform-SRE.
Fri, May 1, 10:29 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), SRE
atsuko changed the status of T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space from Open to In Progress.
Fri, May 1, 10:28 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), SRE
atsuko created T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space.
Fri, May 1, 10:26 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), SRE

Thu, Apr 30

atsuko updated the task description for T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️.
Thu, Apr 30, 4:37 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko added a comment to T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️.

Added secrets with the dirtiest script.

Thu, Apr 30, 2:14 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko added a comment to T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️.

applying admin_ng for dse-k8s-*

Thu, Apr 30, 10:47 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko closed T422923: New VictorOps user request - atsuko as Resolved.

Thanks

Thu, Apr 30, 9:27 AM · observability
atsuko reopened T422923: New VictorOps user request - atsuko as "Open".

Could you please add me to the team? I don't have an access to change the SRE rotation.

Thu, Apr 30, 8:48 AM · observability
atsuko merged T422186: New VictorOps user request into T422923: New VictorOps user request - atsuko.
Thu, Apr 30, 8:47 AM · observability
atsuko merged task T422186: New VictorOps user request into T422923: New VictorOps user request - atsuko.
Thu, Apr 30, 8:47 AM · observability

Wed, Apr 29

atsuko closed T422947: Requesting Kerberos access for Daniel Kinzler as Resolved.

Marked as resolved as it seems to work.

Wed, Apr 29, 10:11 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko moved T422947: Requesting Kerberos access for Daniel Kinzler from Quick Wins to Done on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Wed, Apr 29, 10:11 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko changed the status of T422947: Requesting Kerberos access for Daniel Kinzler from Open to In Progress.
Wed, Apr 29, 4:54 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko set IRC Nick to atsukoito on atsuko.
Wed, Apr 29, 4:32 PM
atsuko moved T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️ from Backlog - project to In Progress on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Wed, Apr 29, 4:31 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko changed the status of T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️ from Open to In Progress.
Wed, Apr 29, 4:04 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko changed the status of T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️, a subtask of T421757: ☂️ Migrate production OpenSearch clusters from 1.x-2.x ☂️, from Open to In Progress.
Wed, Apr 29, 4:04 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko closed T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009 as Resolved.

Thanks for reporing back, marked as resolved then.

Wed, Apr 29, 4:03 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), OKR-Work, Wikidata Platform Team
atsuko closed T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009, a subtask of T424255: Setup qlever on wdqs2009, as Resolved.
Wed, Apr 29, 4:03 PM · OKR-Work, Wikidata Platform Team
atsuko moved T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009 from In Progress to Done on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Wed, Apr 29, 4:03 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), OKR-Work, Wikidata Platform Team
atsuko moved T422947: Requesting Kerberos access for Daniel Kinzler from Done to Quick Wins on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Wed, Apr 29, 4:02 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko added a comment to T422947: Requesting Kerberos access for Daniel Kinzler.

Lemme see what I can do

Wed, Apr 29, 4:01 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering

Tue, Apr 28

atsuko claimed T424248: ☂️Migrate non-cirrus indices from production OpenSearch to OpenSearch on k8s ☂️.
Tue, Apr 28, 2:29 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Discovery-Search (2026.04.06 - 2026.05.01)
atsuko changed the status of T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009 from In Progress to Stalled.

Transferred

Tue, Apr 28, 1:33 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), OKR-Work, Wikidata Platform Team
atsuko changed the status of T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009, a subtask of T424255: Setup qlever on wdqs2009, from In Progress to Stalled.
Tue, Apr 28, 1:33 PM · OKR-Work, Wikidata Platform Team
atsuko added a comment to T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009.

@gmodena I started a transfer, but you might not have the access for it (at least to remove). Do you want me to chown it to any specific user (qlever maybe)

Tue, Apr 28, 1:11 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), OKR-Work, Wikidata Platform Team
atsuko moved T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009 from Quick Wins to In Progress on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Tue, Apr 28, 1:00 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), OKR-Work, Wikidata Platform Team
atsuko changed the status of T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009, a subtask of T424255: Setup qlever on wdqs2009, from Open to In Progress.
Tue, Apr 28, 1:00 PM · OKR-Work, Wikidata Platform Team
atsuko changed the status of T424256: request: data transfer: wikidata main-20260209 snapshot to wdqs2009 from Open to In Progress.
Tue, Apr 28, 1:00 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), OKR-Work, Wikidata Platform Team
atsuko closed T422947: Requesting Kerberos access for Daniel Kinzler as Resolved.

Merged, principal created.

atsuko@krb1002:~$ sudo manage_principals.py create daniel --email=dkinzler@wikimedia.org
Tue, Apr 28, 12:53 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko moved T422947: Requesting Kerberos access for Daniel Kinzler from In Progress to Done on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Tue, Apr 28, 12:53 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko moved T422947: Requesting Kerberos access for Daniel Kinzler from Quick Wins to In Progress on the Data-Platform-SRE (2026-04-24 - 2026-05-15) board.
Tue, Apr 28, 12:31 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko changed the status of T422947: Requesting Kerberos access for Daniel Kinzler from Open to In Progress.
Tue, Apr 28, 12:30 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15), Data-Engineering
atsuko added a comment to T423078: Track k8s deployments that runs unreleased changes to the charts.

Rolled out the replacement script, thanos helmfile_admin_ng_pending_changes didn't change. Going to roll it out for dse services as well now.

Tue, Apr 28, 10:09 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15)

Fri, Apr 24

atsuko added a comment to T423078: Track k8s deployments that runs unreleased changes to the charts.

Code and history is copied to gitlab/sre/charlie, now there are two commands:

Fri, Apr 24, 1:51 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15)
atsuko removed a project from T422963: Add Jmoore111 to analytics-admins: Patch-For-Review.
Fri, Apr 24, 8:14 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko closed T422963: Add Jmoore111 to analytics-admins as Resolved.

merged, will roll-out within an hour on periodic puppet run

Fri, Apr 24, 8:14 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko moved T422963: Add Jmoore111 to analytics-admins from In Progress to To Be Deployed on the Data-Platform-SRE (2026-03-27 - 2026-04-17) board.
Fri, Apr 24, 8:11 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko claimed T422963: Add Jmoore111 to analytics-admins.
Fri, Apr 24, 8:08 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)

Thu, Apr 23

atsuko added a comment to T423078: Track k8s deployments that runs unreleased changes to the charts.

For all purposes, running charlie --dry_run --services_dir admin_ng diff produces the same information as check_admin_ng_pending_changes.py when invoked for all environments. I'm considering

Thu, Apr 23, 4:09 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15)
atsuko updated the task description for T423078: Track k8s deployments that runs unreleased changes to the charts.
Thu, Apr 23, 10:20 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15)
atsuko moved T423078: Track k8s deployments that runs unreleased changes to the charts from Backlog - operations to In Progress on the Data-Platform-SRE (2026-03-27 - 2026-04-17) board.
Thu, Apr 23, 9:21 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15)
atsuko changed the status of T423078: Track k8s deployments that runs unreleased changes to the charts from Open to In Progress.

Wrapping my head around @RLazarus [charlie.py](https://gerrit.wikimedia.org/g/operations/puppet/+/refs/changes/80/1240780/2/modules/profile/files/kubernetes/deployment_server/charlie.py), as it is "recursively searches out helmfile services in a given repository or subtree, identifies all the environments for each service, and diffs or applies them by shelling out to helmfile". It seems like the helmfile discovery is solved here, and it runs periodically, so it would be useful to make it generate metrics.

Thu, Apr 23, 8:47 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15)

Tue, Apr 21

atsuko updated the task description for T424006: Make /wmf/data/hdfs/usage accessible for non-admins.
Tue, Apr 21, 10:40 AM · Data-Platform-SRE
atsuko moved T422963: Add Jmoore111 to analytics-admins from Untriaged to Awaiting User Input on the SRE-Access-Requests board.
Tue, Apr 21, 10:38 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko updated Other Assignee for T422963: Add Jmoore111 to analytics-admins, added: atsuko; removed; MMiller_WMF.
Tue, Apr 21, 10:37 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko reassigned T422963: Add Jmoore111 to analytics-admins from atsuko to MMiller_WMF.
Tue, Apr 21, 10:37 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko updated Other Assignee for T422963: Add Jmoore111 to analytics-admins, added: MMiller_WMF.
Tue, Apr 21, 10:37 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko created T424006: Make /wmf/data/hdfs/usage accessible for non-admins.
Tue, Apr 21, 10:32 AM · Data-Platform-SRE
atsuko removed a project from T422963: Add Jmoore111 to analytics-admins: SRE.
Tue, Apr 21, 10:28 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko updated the task description for T422963: Add Jmoore111 to analytics-admins.
Tue, Apr 21, 9:58 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko updated subscribers of T422963: Add Jmoore111 to analytics-admins.

Hi @MMiller_WMF, can you please approve the access to restricted HDFS for Justin Moore?

Tue, Apr 21, 9:57 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko updated the task description for T422963: Add Jmoore111 to analytics-admins.
Tue, Apr 21, 9:56 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko added projects to T422963: Add Jmoore111 to analytics-admins: SRE, SRE-Access-Requests.
Tue, Apr 21, 9:38 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko updated the task description for T422963: Add Jmoore111 to analytics-admins.
Tue, Apr 21, 9:33 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko moved T422963: Add Jmoore111 to analytics-admins from Quick Wins to In Progress on the Data-Platform-SRE (2026-03-27 - 2026-04-17) board.
Tue, Apr 21, 9:25 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko changed the status of T422963: Add Jmoore111 to analytics-admins from Open to In Progress.
Tue, Apr 21, 9:25 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko claimed T422963: Add Jmoore111 to analytics-admins.
Tue, Apr 21, 9:24 AM · SRE-Access-Requests, Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko closed T420730: Allow certain DAGs to be ignored when creating an airflow development environment as Resolved.
Tue, Apr 21, 7:59 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko moved T420730: Allow certain DAGs to be ignored when creating an airflow development environment from In Progress to Done on the Data-Platform-SRE (2026-03-27 - 2026-04-17) board.
Tue, Apr 21, 7:58 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko reopened T420730: Allow certain DAGs to be ignored when creating an airflow development environment as "Open".
Tue, Apr 21, 7:57 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko closed T420730: Allow certain DAGs to be ignored when creating an airflow development environment as Resolved.
Tue, Apr 21, 7:54 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)

Mon, Apr 20

atsuko updated the task description for T420730: Allow certain DAGs to be ignored when creating an airflow development environment.
Mon, Apr 20, 3:47 PM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko claimed T420587: Create cookbook to reboot zookeeper for DPE SRE.
Mon, Apr 20, 12:30 PM · Data-Platform-SRE (2026-04-24 - 2026-05-15)
atsuko added a comment to T420730: Allow certain DAGs to be ignored when creating an airflow development environment.

Recorded a demo, gonna present on DPE meetings this and next week

Mon, Apr 20, 10:44 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko added a comment to T420588: Create cookbook to reboot etcd (DPE SRE).

I joined the DPE SRE 3 weeks ago, and if I remember correctly, @Gehel said that the team marked a few tasks like this so I can start with those.

Mon, Apr 20, 8:07 AM · Data-Platform-SRE (2026-04-24 - 2026-05-15)

Fri, Apr 17

atsuko updated the task description for T418525: Flink base image should not install into system python environment.
Fri, Apr 17, 4:22 PM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko closed T418525: Flink base image should not install into system python environment as Resolved.
Fri, Apr 17, 4:22 PM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko updated subscribers of T418525: Flink base image should not install into system python environment.
Fri, Apr 17, 4:06 PM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko added a comment to T418525: Flink base image should not install into system python environment.

To update:

Fri, Apr 17, 3:50 PM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko updated the task description for T420730: Allow certain DAGs to be ignored when creating an airflow development environment.
Fri, Apr 17, 11:48 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko updated the task description for T418525: Flink base image should not install into system python environment.
Fri, Apr 17, 11:46 AM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko added a comment to T420730: Allow certain DAGs to be ignored when creating an airflow development environment.

Update https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide
Fix a quirk here

image.png (95×1 px, 24 KB)

Fri, Apr 17, 10:16 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko added a comment to T418525: Flink base image should not install into system python environment.

Successfully published image docker-registry.discovery.wmnet/flink:1.20.3-wmf1-20260416

Fri, Apr 17, 9:59 AM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko added a comment to T418525: Flink base image should not install into system python environment.

@Ottomata shall we move this step to the base package, since the source file is in the base package as well?

copies:
  - from: docker-registry.wikimedia.org/flink:1.20.3-wmf1-20260416
    source: /opt/flink/opt/flink-s3-fs-presto-1.20.3.jar
    destination: /usr/local/lib/python3.11/dist-packages/pyflink/plugins/s3-fs-presto/flink-s3-fs-presto-1.20.3.jar
Fri, Apr 17, 8:31 AM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform

Thu, Apr 16

atsuko added a comment to T418525: Flink base image should not install into system python environment.

Test plan now contains correct invocations for both builds.

Thu, Apr 16, 4:37 PM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko moved T418525: Flink base image should not install into system python environment from Backlog - operations to In Progress on the Data-Platform-SRE (2026-03-27 - 2026-04-17) board.
Thu, Apr 16, 8:52 AM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform
atsuko changed the status of T418525: Flink base image should not install into system python environment from Open to In Progress.

Looking at docker-pkg

Thu, Apr 16, 8:51 AM · Patch-For-Review, good first task, Data-Platform-SRE (2026-03-27 - 2026-04-17), Data-Engineering, Event-Platform

Tue, Apr 14

atsuko added a comment to T420730: Allow certain DAGs to be ignored when creating an airflow development environment.
atsuko@apt1002:~$ sudo -i reprepro ls airflow-devenv
airflow-devenv | 0.0.20 | bullseye-wikimedia | amd64, i386
airflow-devenv | 0.0.20 | bookworm-wikimedia | amd64, i386
Tue, Apr 14, 2:49 PM · Data-Platform-SRE (2026-03-27 - 2026-04-17)
atsuko added a comment to T420730: Allow certain DAGs to be ignored when creating an airflow development environment.

Todo:

  1. Update docs in README and on wikitech
  2. Release deb
  3. Announce and demo
Tue, Apr 14, 10:29 AM · Data-Platform-SRE (2026-03-27 - 2026-04-17)