Page MenuHomePhabricator

jijiki (effie mouzeli)
is an animal

Projects (11)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Aug 14 2018, 10:50 AM (266 w, 4 d)
Availability
Available
IRC Nick
effie
LDAP User
Effie Mouzeli
MediaWiki User
EMouzeli (WMF) [ Global Accounts ]

Recent Activity

Wed, Sep 20

jijiki renamed T346690: mcrouter daemonset on mw-on-k8s from mcrouter daemonset of mw-on-k8s to mcrouter daemonset on mw-on-k8s.
Wed, Sep 20, 8:59 PM · MediaWiki-Platform-Team, serviceops, MW-on-K8s
jijiki updated the task description for T346690: mcrouter daemonset on mw-on-k8s.
Wed, Sep 20, 1:05 PM · MediaWiki-Platform-Team, serviceops, MW-on-K8s
jijiki added a subtask for T277711: Memcached, mcrouter in MediaWiki on Kubernetes: T346690: mcrouter daemonset on mw-on-k8s.
Wed, Sep 20, 1:03 PM · serviceops, SRE
jijiki added a parent task for T346690: mcrouter daemonset on mw-on-k8s: T277711: Memcached, mcrouter in MediaWiki on Kubernetes.
Wed, Sep 20, 1:03 PM · MediaWiki-Platform-Team, serviceops, MW-on-K8s
jijiki updated the task description for T346690: mcrouter daemonset on mw-on-k8s.
Wed, Sep 20, 1:03 PM · MediaWiki-Platform-Team, serviceops, MW-on-K8s

Mon, Sep 18

jijiki triaged T346690: mcrouter daemonset on mw-on-k8s as Medium priority.
Mon, Sep 18, 8:07 PM · MediaWiki-Platform-Team, serviceops, MW-on-K8s

Mon, Sep 11

jijiki added a comment to T345868: Rename the shellbox service to shellbox-score.

Picking up the task

Mon, Sep 11, 9:25 AM · Shellbox, serviceops
jijiki claimed T345868: Rename the shellbox service to shellbox-score.
Mon, Sep 11, 9:25 AM · Shellbox, serviceops
jijiki added a comment to T345884: mw2444 down.

@Jhancock.wm I am afraid the server is dead again :(

Mon, Sep 11, 9:22 AM · serviceops, SRE, ops-codfw
jijiki edited projects for T345884: mw2444 down, added: serviceops; removed serviceops-radar.
Mon, Sep 11, 9:22 AM · serviceops, SRE, ops-codfw

Thu, Sep 7

jijiki updated subscribers of T345802: hw troubleshooting: DIMM failure for mc2040.codfw.wmnet.

Dear @Jhancock.wm or @Papaul, server can be shutdown and checked at your convenience, this part of the stack has failovers in place. Thank you!

Thu, Sep 7, 11:59 AM · serviceops, SRE, ops-codfw, DC-Ops

Wed, Sep 6

jijiki triaged T345740: Sunset onhost memcached on mediawiki servers and puppet as Low priority.
Wed, Sep 6, 1:45 PM · serviceops
jijiki added a comment to T344110: maps2009 is unreachable.

@jijiki is there a day this week that I can update the firmware on this server?

Wed, Sep 6, 10:27 AM · Content-Transform-Team, Maps (Maps-data), serviceops-radar, ops-codfw

Wed, Aug 30

jijiki added a comment to T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).

Additionally, while the key for both certificates are of the same size, during negotiation, envoy chooses the TLS_AES_256_GCM_SHA384 cipher suite, while previously was choosing TLS_AES_128_GCM_SHA256. We will investigate this further when we pick it up again.

Wed, Aug 30, 12:22 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki updated the task description for T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Wed, Aug 30, 12:18 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki updated the task description for T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Wed, Aug 30, 12:18 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident

Tue, Aug 29

jijiki changed the status of T344147: Puppet broken on mediawiki instances in deployment-prep from Open to In Progress.

@ArielGlenn please mark it as resolved if everything is as expected. (thanks @Urbanecm!)

Tue, Aug 29, 2:41 PM · User-ArielGlenn, Beta-Cluster-Infrastructure
jijiki moved T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023) from Incoming 🐫 to this.quarter 🍕 on the serviceops board.
Tue, Aug 29, 2:27 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki changed the status of T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023), a subtask of T343987: Switch thanos-fe to cfssl, from In Progress to Stalled.
Tue, Aug 29, 2:27 PM · Patch-For-Review, Observability-Metrics
jijiki changed the status of T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023) from In Progress to Stalled.
Tue, Aug 29, 2:27 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki added a comment to T343987: Switch thanos-fe to cfssl.

observability we are still looking into how things could progress here on the Maps side of things. Please let me know if it is alright to stall this roll out for now.

Tue, Aug 29, 1:28 PM · Patch-For-Review, Observability-Metrics

Mon, Aug 28

jijiki added a comment to T344110: maps2009 is unreachable.

Turns out there is one more thing I need to do to. I missed a firmware update. Is it safe for me to reboot at this time?

Mon, Aug 28, 12:43 PM · Content-Transform-Team, Maps (Maps-data), serviceops-radar, ops-codfw
jijiki added a comment to T344998: Wikifunctions functions that require a lookup on wikifunctions.org timing out in the orchestrator, UX instead showing 'http'.

@Jdforrester-WMF it will be extremely useful for the future to improve wikifunction's observability, for instance, there were logs emitted to logstash which logged that specific problem, and would be visible with a better curated dashboard.

Mon, Aug 28, 10:11 AM · Patch-For-Review, serviceops, Wikimedia-production-error, Abstract Wikipedia team, Wikifunctions

Fri, Aug 25

jijiki added a comment to T341320: Wikimedia\RemexHtml\Tokenizer\TokenizerError: Wikimedia\RemexHtml\Tokenizer\Tokenizer: pcre.backtrack_limit exhausted.

Regarding the value "32531" opcache.max_accelerated_files, is that only numbers from a specific set of prime numbers are valid there. Using a different number, will result to the actual value used being the first number in that set, that is greater than or equal to what was configured.

Fri, Aug 25, 11:12 AM · MW-on-K8s, Maintenance-Worktype, RemexHtml, Wikimedia-production-error
jijiki updated the task description for T300033: Use cert-manager for service-proxy certificate creation.
Fri, Aug 25, 10:18 AM · Patch-For-Review, serviceops, Prod-Kubernetes, Kubernetes

Aug 24 2023

jijiki added a comment to T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).

Could we just circumvent the problem by enabling the thanos-swift listener in tegolas service-proxy and configure it to use the plaintext localhost connection instead of connecting directly to thanos-swift?

That's always going to be our last resort, although I fear the s3 sdk will complain about various things and that will need tweaking. We need anyways to understand what's wrong as we might encounter similar issues somewhere else.

So: yes we could, but no we shouldn't.

Aug 24 2023, 3:40 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki added a comment to T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).

Testing procedure:

Aug 24 2023, 3:38 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident

Aug 23 2023

jijiki updated the task description for T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Aug 23 2023, 10:44 AM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident

Aug 22 2023

jijiki changed the status of T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023) from Open to In Progress.
Aug 22 2023, 4:47 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki changed the status of T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023), a subtask of T343987: Switch thanos-fe to cfssl, from Open to In Progress.
Aug 22 2023, 4:47 PM · Patch-For-Review, Observability-Metrics
jijiki added a parent task for T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023): T343987: Switch thanos-fe to cfssl.
Aug 22 2023, 4:47 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki added a subtask for T343987: Switch thanos-fe to cfssl: T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Aug 22 2023, 4:47 PM · Patch-For-Review, Observability-Metrics
jijiki updated the task description for T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Aug 22 2023, 4:46 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki added a comment to T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).

From the 18th Aug rollout, tcpdumps can be found in my home directory on kubernetes2010 and thanos-fe2004. The pod IP on kubernetes2010 is 10.194.150.55 and thano's ip is 10.2.1.54

Aug 22 2023, 4:41 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki renamed T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023) from Maps Unavailability (14 Aug 2023) to Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Aug 22 2023, 4:40 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki updated the task description for T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Aug 22 2023, 2:51 PM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident
jijiki awarded T344110: maps2009 is unreachable a Love token.
Aug 22 2023, 2:46 PM · Content-Transform-Team, Maps (Maps-data), serviceops-radar, ops-codfw

Aug 17 2023

jijiki updated the task description for T300033: Use cert-manager for service-proxy certificate creation.
Aug 17 2023, 10:16 AM · Patch-For-Review, serviceops, Prod-Kubernetes, Kubernetes

Aug 16 2023

jijiki renamed T344110: maps2009 is unreachable from ManagementSSHDown to maps2009 is unreachable.
Aug 16 2023, 10:45 AM · Content-Transform-Team, Maps (Maps-data), serviceops-radar, ops-codfw
jijiki committed rOSTG536d9e3d7035: Dependencies maintenance (authored by Jgiannelos).
Dependencies maintenance
Aug 16 2023, 10:21 AM
jijiki added a comment to T344110: maps2009 is unreachable.

@Jhancock.wm thank you very much for the update!

Aug 16 2023, 9:08 AM · Content-Transform-Team, Maps (Maps-data), serviceops-radar, ops-codfw
jijiki created T344324: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023).
Aug 16 2023, 9:07 AM · serviceops, Maintenance-Worktype, Content-Transform-Team-WIP, Wikimedia-Incident

Aug 10 2023

jijiki added a parent task for T343996: Move codfw thumbor hosts to kubernetes cluster: T334488: Final steps for fully-Kubernetes Thumbor.
Aug 10 2023, 3:36 PM · SRE, serviceops, ops-codfw
jijiki added a subtask for T334488: Final steps for fully-Kubernetes Thumbor: T343996: Move codfw thumbor hosts to kubernetes cluster.
Aug 10 2023, 3:36 PM · Patch-For-Review, Platform Team Workboards (Platform Engineering Reliability), Thumbor Migration, SRE, serviceops, Thumbor
jijiki updated the task description for T343996: Move codfw thumbor hosts to kubernetes cluster.
Aug 10 2023, 3:35 PM · SRE, serviceops, ops-codfw
jijiki created T343996: Move codfw thumbor hosts to kubernetes cluster.
Aug 10 2023, 3:35 PM · SRE, serviceops, ops-codfw
jijiki added a subtask for T334488: Final steps for fully-Kubernetes Thumbor: T343993: Move eqiad thumbor hosts to kubernetes cluster.
Aug 10 2023, 3:30 PM · Patch-For-Review, Platform Team Workboards (Platform Engineering Reliability), Thumbor Migration, SRE, serviceops, Thumbor
jijiki added a parent task for T343993: Move eqiad thumbor hosts to kubernetes cluster: T334488: Final steps for fully-Kubernetes Thumbor.
Aug 10 2023, 3:30 PM · SRE, ops-eqiad, serviceops
jijiki renamed T343993: Move eqiad thumbor hosts to kubernetes cluster from Move eqiad thumbor hosts to kubernetes cluster thumbor1005, thumbor1006 to kubernetes1057 and kubernetes1058 to Move eqiad thumbor hosts to kubernetes cluster.
Aug 10 2023, 3:29 PM · SRE, ops-eqiad, serviceops
jijiki created T343993: Move eqiad thumbor hosts to kubernetes cluster.
Aug 10 2023, 3:29 PM · SRE, ops-eqiad, serviceops
jijiki renamed T342533: Q1:rack/setup/install kubernetes10[27-56] from Q1:rack/setup/install kubernetes10[25-54] to Q1:rack/setup/install kubernetes10[27-56].
Aug 10 2023, 3:22 PM · SRE, serviceops, ops-eqiad, DC-Ops
jijiki updated the task description for T343708: Physical re-labeling of mw1497 and mw1498 to kubernetes1025 and kubernetes1026.
Aug 10 2023, 3:05 PM · SRE, ops-eqiad, DC-Ops, serviceops-radar, MW-on-K8s
jijiki updated the task description for T343708: Physical re-labeling of mw1497 and mw1498 to kubernetes1025 and kubernetes1026.
Aug 10 2023, 3:03 PM · SRE, ops-eqiad, DC-Ops, serviceops-radar, MW-on-K8s
jijiki updated the task description for T334488: Final steps for fully-Kubernetes Thumbor.
Aug 10 2023, 1:58 PM · Patch-For-Review, Platform Team Workboards (Platform Engineering Reliability), Thumbor Migration, SRE, serviceops, Thumbor
jijiki updated the task description for T300033: Use cert-manager for service-proxy certificate creation.
Aug 10 2023, 10:46 AM · Patch-For-Review, serviceops, Prod-Kubernetes, Kubernetes

Aug 9 2023

jijiki updated the task description for T300033: Use cert-manager for service-proxy certificate creation.
Aug 9 2023, 3:58 PM · Patch-For-Review, serviceops, Prod-Kubernetes, Kubernetes

Aug 8 2023

jijiki updated the task description for T334488: Final steps for fully-Kubernetes Thumbor.
Aug 8 2023, 3:35 PM · Patch-For-Review, Platform Team Workboards (Platform Engineering Reliability), Thumbor Migration, SRE, serviceops, Thumbor
jijiki added a comment to T341843: Netbox report test_mgmt_dns_hostname - rq.timeouts.JobTimeoutException.

Not sure i f it's a Netbox or Redis issue :(

Aug 8 2023, 3:34 PM · Infrastructure-Foundations, netbox

Jul 19 2023

Ladsgroup awarded T341560: Migrate mwmaint server functionality to mw-on-k8s a Love token.
Jul 19 2023, 12:59 PM · serviceops, MW-on-K8s

Jul 13 2023

jijiki updated the task description for T318695: Future of Thumbor's memcached backend.
Jul 13 2023, 9:42 PM · Patch-For-Review, Platform Team Workboards (Platform Engineering Reliability), Thumbor Migration, SRE, serviceops, Thumbor
jijiki added a project to T341825: Max upload size on k8s is 2M: serviceops.
Jul 13 2023, 9:41 PM · serviceops, MW-on-K8s

Jul 12 2023

jijiki updated the task description for T318695: Future of Thumbor's memcached backend.
Jul 12 2023, 9:29 AM · Patch-For-Review, Platform Team Workboards (Platform Engineering Reliability), Thumbor Migration, SRE, serviceops, Thumbor

Jul 11 2023

jijiki added a comment to T341122: Implement daily data update routine.

@Tchanders we could potentially provide those resources, as long as they are for a limited amount of time, eg 2hrs.

Jul 11 2023, 2:40 PM · Patch-For-Review, Anti-Harassment (AHaT Sprint 32 - Baseball Cap), iPoid-Service
jijiki updated the task description for T341326: Deploy ipoid to staging on Kuberenetes.
Jul 11 2023, 10:14 AM · serviceops, iPoid-Service
jijiki added a parent task for T341553: Allow running one-off scripts manually: T341560: Migrate mwmaint server functionality to mw-on-k8s.
Jul 11 2023, 9:57 AM · MW-on-K8s, serviceops
jijiki added a parent task for T341555: Allow running periodic jobs for mw on k8s: T341560: Migrate mwmaint server functionality to mw-on-k8s.
Jul 11 2023, 9:57 AM · serviceops, MW-on-K8s
jijiki added subtasks for T341560: Migrate mwmaint server functionality to mw-on-k8s: T341555: Allow running periodic jobs for mw on k8s, T341553: Allow running one-off scripts manually.
Jul 11 2023, 9:57 AM · serviceops, MW-on-K8s
jijiki created T341560: Migrate mwmaint server functionality to mw-on-k8s.
Jul 11 2023, 9:56 AM · serviceops, MW-on-K8s

Jul 7 2023

jijiki added a subtask for T339284: Deploy ipoid: T339331: Prepare for initial data import on production servers.
Jul 7 2023, 4:16 PM · IP Info, Anti-Harassment, iPoid-Service
jijiki added a parent task for T339331: Prepare for initial data import on production servers: T339284: Deploy ipoid.
Jul 7 2023, 4:16 PM · DBA, Anti-Harassment, iPoid-Service
jijiki added a comment to T339331: Prepare for initial data import on production servers.

Given that we have the ability to provide as many resources as the pod needs, in which case, we can make it possible to load the whole dump in memory, if that would help with our current challenges.

@jijiki Does this only apply to the initial import, or could we do something similar for the daily updates - i.e. have the two dumps uncompressed in memory? I'm wondering about faster ways to compare the two dumps without reading from the database. We have a diffing script that works quickly, but uses a lot of storage space, and I'm wondering if it's at all worth pursuing.

Jul 7 2023, 4:14 PM · DBA, Anti-Harassment, iPoid-Service
jijiki added a comment to T339331: Prepare for initial data import on production servers.

@STran answering your questions from the previous thread

Jul 7 2023, 4:11 PM · DBA, Anti-Harassment, iPoid-Service
jijiki updated the task description for T339331: Prepare for initial data import on production servers.
Jul 7 2023, 3:23 PM · DBA, Anti-Harassment, iPoid-Service
jijiki closed T341326: Deploy ipoid to staging on Kuberenetes as Resolved.
Jul 7 2023, 10:19 AM · serviceops, iPoid-Service
jijiki closed T341326: Deploy ipoid to staging on Kuberenetes, a subtask of T339284: Deploy ipoid, as Resolved.
Jul 7 2023, 10:19 AM · IP Info, Anti-Harassment, iPoid-Service
jijiki added a comment to T341326: Deploy ipoid to staging on Kuberenetes.

When the chart was created, it was missing enabling a template, which was not evident until we were able to successfully start ipoid containers in the staging environment.

Jul 7 2023, 10:19 AM · serviceops, iPoid-Service

Jul 4 2023

jijiki claimed T287491: Allow to address Kubernets API servers from NetworkPolicy.
Jul 4 2023, 1:42 PM · Patch-For-Review, serviceops, Prod-Kubernetes, Kubernetes
jijiki created P49502 istio .
Jul 4 2023, 12:53 PM
jijiki updated the task description for T329827: Add a second control-plane to wikikube staging clusters.
Jul 4 2023, 12:34 PM · Kubernetes, serviceops
jijiki closed T329827: Add a second control-plane to wikikube staging clusters as Resolved.
Jul 4 2023, 11:11 AM · Kubernetes, serviceops
jijiki updated the task description for T329827: Add a second control-plane to wikikube staging clusters.
Jul 4 2023, 9:32 AM · Kubernetes, serviceops

Jul 3 2023

jijiki updated the task description for T329827: Add a second control-plane to wikikube staging clusters.
Jul 3 2023, 4:29 PM · Kubernetes, serviceops
jijiki updated the task description for T329827: Add a second control-plane to wikikube staging clusters.
Jul 3 2023, 3:09 PM · Kubernetes, serviceops
jijiki closed T329940: eqiad and codfw: 1 VM each requested for wikikube-staging as Resolved.

Done.

Jul 3 2023, 10:23 AM · SRE, vm-requests
jijiki closed T329940: eqiad and codfw: 1 VM each requested for wikikube-staging, a subtask of T329827: Add a second control-plane to wikikube staging clusters, as Resolved.
Jul 3 2023, 10:23 AM · Kubernetes, serviceops
jijiki updated the task description for T329827: Add a second control-plane to wikikube staging clusters.
Jul 3 2023, 10:22 AM · Kubernetes, serviceops
jijiki moved T329827: Add a second control-plane to wikikube staging clusters from Backlog FY22-23 🚜 to Doing 😎 on the serviceops board.
Jul 3 2023, 10:21 AM · Kubernetes, serviceops
jijiki moved T325147: New Service Request 'iPoid' from Doing 😎 to this.quarter 🍕 on the serviceops board.
Jul 3 2023, 10:21 AM · iPoid-Service, Patch-For-Review, serviceops, Service-deployment-requests

Jun 27 2023

jijiki added a project to T333269: Benchmark baremetal vs k8s mediawiki perf (2023): serviceops.
Jun 27 2023, 8:23 AM · MediaWiki-Platform-Team, serviceops

Jun 26 2023

jijiki added a comment to T333269: Benchmark baremetal vs k8s mediawiki perf (2023).

@Krinkle, since we are approaching the end of Q4, we will discuss internally and schedule this work for Q1.

Jun 26 2023, 8:11 PM · MediaWiki-Platform-Team, serviceops

Jun 20 2023

jijiki added a comment to T325635: Investigate: Alternatives or improvements to data import method.

This ticket was created at a time when the script could not be finished on local instances at all and which has been somewhat resolved (for sufficiently powered computers with bare metal instances) "good enough" for development. It's a little less concerned with being production-ready, which the other ticket very much is and as such the discussion should be centralized there and this ticket closed out. For the questions @jijiki asked, I've moved those to a new ticket specifically focused on if an initial import needs additional development/management.

Jun 20 2023, 1:41 PM · Anti-Harassment (AHaT Sprint 31 - The Fez), iPoid-Service

Jun 14 2023

jijiki closed T336163: Create helm chart for iPoid, a subtask of T325147: New Service Request 'iPoid', as Resolved.
Jun 14 2023, 7:38 PM · iPoid-Service, Patch-For-Review, serviceops, Service-deployment-requests
jijiki closed T336163: Create helm chart for iPoid as Resolved.

Dear Anti-Harassment for the time being, the chart is ready! What now?

Jun 14 2023, 7:37 PM · iPoid-Service, Kubernetes, serviceops
jijiki added a comment to T305724: Investigate database data invalidation questions and chunked/timed API to MySQL/MariaDB ETL.

Uncompressed, the entire daily feed has recently been around 8 Gb.

Jun 14 2023, 2:48 PM · iPoid-Service, SecTeam-Processed, Security
jijiki added a comment to T325147: New Service Request 'iPoid'.

Quick Note: Currently iPoid's database, m5-master.eqiad.wmnet is anchored to eqiad for writes, while in can read from m5-master.codfw.wmnet, that means that, the service will be active/active from the user perspective, but its cronjob, which is the only path where there are writes in the database, will run always from eqiad.

Jun 14 2023, 2:48 PM · iPoid-Service, Patch-For-Review, serviceops, Service-deployment-requests
jijiki added a comment to T325635: Investigate: Alternatives or improvements to data import method.

Since serviceops is done with T336163, we must consider how we are going to do the initial import in production. This is our suggestion:

Jun 14 2023, 2:30 PM · Anti-Harassment (AHaT Sprint 31 - The Fez), iPoid-Service
jijiki added a comment to T305724: Investigate database data invalidation questions and chunked/timed API to MySQL/MariaDB ETL.

Unfortunately, the data missing from the export diff at this time is likely to be the data most relevant and interesting to the Foundation and Community.

Jun 14 2023, 10:00 AM · iPoid-Service, SecTeam-Processed, Security

Jun 13 2023

jijiki added a comment to T305724: Investigate database data invalidation questions and chunked/timed API to MySQL/MariaDB ETL.

@jijiki to clarify, what do you mean by diff, do you mean the https://exports.spur.us/v1/feeds/anonymous?diff=true (docs)? AIUI, that doesn't have the necessary data that we need.

Or by diff do you mean the process I sketched in T305724#8917809?

Jun 13 2023, 7:40 PM · iPoid-Service, SecTeam-Processed, Security
jijiki added a comment to T305724: Investigate database data invalidation questions and chunked/timed API to MySQL/MariaDB ETL.

To my understanding (please correct me if I am wrong) we have some tolerance regarding having stale data. If that statement is true, and give that the offered diff by the provider is missing some groups of data, my suggestion is the following:

Jun 13 2023, 3:26 PM · iPoid-Service, SecTeam-Processed, Security
jijiki added a comment to T336163: Create helm chart for iPoid.

Helm chart is ready. We will be exposing the following environmental variables, some of which will hold sensitive information:

Jun 13 2023, 11:42 AM · iPoid-Service, Kubernetes, serviceops