Page MenuHomePhabricator
Create Task
Maniphest T358575

Kubernetes(k8s) platform for Enterprise Applications
Open, In Progress, MediumPublic
Actions

Description

Run enterprise applications in k8s platform for better scalability, HA, observability and an overall great developer experience.

Related Objects
Search...

StatusSubtypeAssignedTask
 In ProgressRThomas-WMFT358575 Kubernetes(k8s) platform for Enterprise Applications
 ResolvedSpikeRThomas-WMFT358576 Q1 - PoC for running Enterprise Applications in k8s
 ResolvedSpikeRThomas-WMFT359538 Setup the network and vpn endpoint
 ResolvedSpikeRThomas-WMFT359539 Setup dev eks cluster with argocd, istio, prometheus
 ResolvedSpikeRThomas-WMFT359541 Deploy and test enterprise APIs in dev eks
 ResolvedRThomas-WMFT358579 Define the k8s migration strategy for production
DeclinedNoneT363985 Healthcheck endpoints for APIs
 DeclinedNoneT363986 Healthcheck endpoint for kafka consumers and producers
 InvalidNoneT363987 Prometheus metrics
 ResolvedNoneT363988 Configurable LOG_LEVEL
 OpenNoneT363989 Enable Log submodule in on-demand services
 OpenNoneT363990 Realtime IP Allow List
 OpenRThomas-WMFT363991 HA Redis elasticache clusters
 OpenNoneT363993 Base OS Image
 InvalidNoneT363994 GO AWS SDK Authentication
 OpenRThomas-WMFT363997 Service mesh service-entry for all the external wiki apis
 ResolvedRThomas-WMFT363998 Allowlist EKS NAT Gateway IPs
 ResolvedRThomas-WMFT363999 kafka backup and restore
 ResolvedNoneT364002 EKS production validation
 Resolved• REsquito-WMFT384431 Test dev eks setup
 ResolvedprabhatT384432 Test production EKS setup
 OpenRThomas-WMFT364375 MSK: Open monitoring with Prometheus
 OpenRThomas-WMFT364378 WME Log shipping
 ResolvedRThomas-WMFT364380 K8s access
 ResolvedRThomas-WMFT371371 MSK Topic and ACL repository with gitlab
 ResolvedRThomas-WMFT371603 Organize the k8s IaC repos and add gitlab ci
 ResolvedRThomas-WMFT372755 Setup EKS Addons
 ResolvedRThomas-WMFT373305 Deploy wme kafka services and apis in the new cluster
 ResolvedRThomas-WMFT374929 Scheduler with airflow and k8s executor
 ResolvedROdonnell-WMFT380162 on-demand services TOPIC_ARTICLES variable handling
 ResolvedRThomas-WMFT384424 Prometheus metrics - long term storage using thanos and s3
 ResolvedRThomas-WMFT384426 Provision production EKS cluster
 ResolvedRThomas-WMFT384428 Provision all the required scheduler DAGs in EKS Airflow
 ResolvedRThomas-WMFT384430 Commons service migration
 ResolvedRThomas-WMFT384433 Configure all alerting for EKS services
 ResolvedRThomas-WMFT384434 Run bulk-ingestion for EKS production
 ResolvedRThomas-WMFT384436 Cutover to EKS production
 OpenNoneT384574 [APP: Objective 3 Term 3.3. - WME OKR TBD- Q1-Q2 FY 25-26]- Gitlab on k8s
 ResolvedThis.chris.corriereT409724 Provision gitlab runners in dev k8s
 ResolvedThis.chris.corriereT410897 Enable gitlab k8s runner to run docker-compose based tests
 ResolvedThis.chris.corriereT410898 Cdtools Refactoring
 OpenThis.chris.corriereT410900 Enable ephemeral tests setup for MR pipeline
 ResolvedThis.chris.corriereT410901 Finalize the dev and prod k8s gitlab runners configuration
 In ProgressThis.chris.corriereT410902 Semantic Versioning of enterprise images
 ResolvedThis.chris.corriereT410903 Migrate API pipelines to gitlab k8s runners
 ResolvedThis.chris.corriereT410904 Migrate Services pipelines to gitlab k8s runners
 OpenThis.chris.corriereT410905 Add pipeline tests for Enterprise libraries
 OpenNoneT411823 Add S3 cached backend for EKS runners
 ResolvedThis.chris.corriereT414079 Sync non-prod and prod environments
 InvalidRThomas-WMFT388132 Post Cutover: Add Test DNS records for the ECS APIs
 ResolvedRThomas-WMFT393457 Stop ECS services in Dev
 ResolvedRThomas-WMFT393458 Decommision ECS dv cluster

Event Timeline

RThomas-WMF created this task.Feb 27 2024, 12:44 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 27 2024, 12:44 PM
• REsquito-WMF added a project: Epic.Feb 27 2024, 12:53 PM
RThomas-WMF triaged this task as Medium priority.Feb 27 2024, 12:53 PM
RThomas-WMF updated the task description. (Show Details)Feb 27 2024, 2:38 PM
LDlulisa-WMF subscribed.Feb 27 2024, 2:47 PM
JArguello-WMF moved this task from DevOps/Infrastructure to Roadmap (Initiatives Q3-Q4 FY25-26) on the Wikimedia Enterprise board.Apr 3 2024, 4:23 PM
JArguello-WMF renamed this task from Kubernetes(k8s) platform for Enterprise Applications to Q4 Kubernetes(k8s) platform for Enterprise Applications.Apr 9 2024, 2:55 PM
RThomas-WMF closed subtask T363987: Prometheus metrics as Invalid.May 7 2024, 8:24 AM
RThomas-WMF changed the status of subtask T363999: kafka backup and restore from Open to In Progress.Jul 24 2024, 12:20 PM
JArguello-WMF renamed this task from Q4 Kubernetes(k8s) platform for Enterprise Applications to Q1 FY 24-25 Kubernetes(k8s) platform for Enterprise Applications.Jul 24 2024, 2:30 PM
JArguello-WMF closed subtask T358576: Q1 - PoC for running Enterprise Applications in k8s as Resolved.Jul 26 2024, 2:08 PM
RThomas-WMF changed the status of subtask T371371: MSK Topic and ACL repository with gitlab from Open to In Progress.Jul 30 2024, 12:51 PM
JArguello-WMF changed the status of subtask T363999: kafka backup and restore from In Progress to Open.Jul 31 2024, 1:07 PM
RThomas-WMF closed subtask T371371: MSK Topic and ACL repository with gitlab as Resolved.Aug 1 2024, 12:49 PM
RThomas-WMF changed the status of subtask T371603: Organize the k8s IaC repos and add gitlab ci from Open to In Progress.
RThomas-WMF reopened subtask T371371: MSK Topic and ACL repository with gitlab as In Progress.Aug 1 2024, 12:54 PM
JArguello-WMF closed subtask T371371: MSK Topic and ACL repository with gitlab as Resolved.Aug 16 2024, 7:07 PM
JArguello-WMF closed subtask T371603: Organize the k8s IaC repos and add gitlab ci as Resolved.Aug 16 2024, 9:11 PM
RThomas-WMF changed the status of subtask T363998: Allowlist EKS NAT Gateway IPs from Open to In Progress.Aug 19 2024, 12:06 PM
RThomas-WMF closed subtask T363999: kafka backup and restore as Resolved.Aug 19 2024, 12:08 PM
RThomas-WMF changed the status of subtask T372755: Setup EKS Addons from Open to In Progress.Aug 19 2024, 12:11 PM
RThomas-WMF changed the status of subtask T373305: Deploy wme kafka services and apis in the new cluster from Open to In Progress.Aug 26 2024, 9:06 AM
RThomas-WMF closed subtask T372755: Setup EKS Addons as Resolved.Sep 3 2024, 1:05 PM
RThomas-WMF changed the status of subtask T358579: Define the k8s migration strategy for production from Open to In Progress.Sep 3 2024, 1:10 PM
RThomas-WMF closed subtask T358579: Define the k8s migration strategy for production as Resolved.Sep 11 2024, 1:08 PM
RThomas-WMF closed subtask T373305: Deploy wme kafka services and apis in the new cluster as Resolved.Sep 17 2024, 11:12 AM
RThomas-WMF changed the status of subtask T374929: Scheduler with airflow and k8s executor from Open to In Progress.
RThomas-WMF closed subtask T364380: K8s access as Resolved.Oct 24 2024, 1:09 PM
RThomas-WMF closed subtask T374929: Scheduler with airflow and k8s executor as Resolved.Nov 11 2024, 8:23 AM
JArguello-WMF closed subtask T380162: on-demand services TOPIC_ARTICLES variable handling as Resolved.Jan 9 2025, 1:25 PM
JArguello-WMF renamed this task from Q1 FY 24-25 Kubernetes(k8s) platform for Enterprise Applications to Q3 FY 24-25 Kubernetes(k8s) platform for Enterprise Applications.Jan 16 2025, 2:29 PM
LDlulisa-WMF closed subtask T363985: Healthcheck endpoints for APIs as Declined.Jan 22 2025, 1:50 PM
RThomas-WMF closed subtask T384424: Prometheus metrics - long term storage using thanos and s3 as Resolved.Jan 28 2025, 1:34 PM
RThomas-WMF changed the status of subtask T384428: Provision all the required scheduler DAGs in EKS Airflow from Open to In Progress.
RThomas-WMF closed subtask T363988: Configurable LOG_LEVEL as Invalid.Jan 30 2025, 11:25 AM
RThomas-WMF reopened subtask T363988: Configurable LOG_LEVEL as Open.Jan 30 2025, 11:44 AM
RThomas-WMF closed subtask T384428: Provision all the required scheduler DAGs in EKS Airflow as Resolved.Feb 7 2025, 3:54 PM
RThomas-WMF closed subtask T363994: GO AWS SDK Authentication as Invalid.Feb 17 2025, 7:41 PM
RThomas-WMF changed the status of subtask T384434: Run bulk-ingestion for EKS production from Open to In Progress.Mar 26 2025, 12:32 PM
RThomas-WMF closed subtask T384426: Provision production EKS cluster as Resolved.
RThomas-WMF changed the status of subtask T364002: EKS production validation from Open to In Progress.Apr 1 2025, 1:13 PM
RThomas-WMF closed subtask T384434: Run bulk-ingestion for EKS production as Resolved.Apr 1 2025, 1:28 PM
JArguello-WMF changed the task status from Open to In Progress.Apr 8 2025, 3:04 PM
RThomas-WMF closed subtask T384430: Commons service migration as Resolved.Apr 10 2025, 9:10 AM
RThomas-WMF closed subtask T364002: EKS production validation as Resolved.Apr 10 2025, 10:42 AM
RThomas-WMF closed subtask T363998: Allowlist EKS NAT Gateway IPs as Resolved.
RThomas-WMF changed the status of subtask T384436: Cutover to EKS production from Open to In Progress.Apr 10 2025, 10:44 AM
RThomas-WMF closed subtask T384436: Cutover to EKS production as Resolved.May 6 2025, 12:33 PM
RThomas-WMF closed subtask T363988: Configurable LOG_LEVEL as Resolved.
RThomas-WMF closed subtask T393458: Decommision ECS dv cluster as Resolved.Jun 19 2025, 1:46 PM
RThomas-WMF closed subtask T393457: Stop ECS services in Dev as Resolved.
RThomas-WMF closed subtask T384433: Configure all alerting for EKS services as Resolved.
RThomas-WMF closed subtask T388132: Post Cutover: Add Test DNS records for the ECS APIs as Invalid.Jun 19 2025, 1:48 PM
JArguello-WMF renamed this task from Q3 FY 24-25 Kubernetes(k8s) platform for Enterprise Applications to Kubernetes(k8s) platform for Enterprise Applications.Jul 21 2025, 2:54 PM
JArguello-WMF moved this task from Roadmap (Initiatives Q3-Q4 FY25-26) to DevOps/Infrastructure on the Wikimedia Enterprise board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits