Page MenuHomePhabricator
Create Task
Maniphest T236565

"tools" Cloud VPS project jessie deprecation
Closed, ResolvedPublic
Actions

Description

The end of life of Debian Jessie is approaching in 2020 and we need to move to Debian Buster (or Stretch) before that date.

All instances in the tools project need to upgrade as soon as possible. Instances not upgraded by 2019-12-31 may be subject to deletion unless prior arrangements for an extended deadline has been approved by the Cloud VPS administration team.

Remaining Debian Jessie instances (live report):

Listed administrators are:

See also:

More info on current project instances is available via openstack browser

Related Objects
Search...

StatusSubtypeAssignedTask
 Resolved• BstormT236565 "tools" Cloud VPS project jessie deprecation
 Resolved• JHeddenT236606 Rebuild Toolforge elasticsearch cluster with Stretch or Buster
 Resolved• JHeddenT246688 Confirm tools.similarity elasticsearch indexes
 Resolved• JHeddenT247098 tools.bash elasticsearch migration
 ResolvedCirdanT247524 denkmalbot tool elasticsearch migration
 ResolvedLegoktmT247525 flaky-ci tool elasticsearch migration
 ResolvedSurlycyborgT247526 similarity tool elasticsearch migration
 ResolvedHjfocsT247527 strephit tool elasticsearch migration
 DeclinedTarrowT247528 wikifactmine-pipeline tool elasticsearch migration
 ResolvedWMDE-FischT247529 wmde-uca-test tool elasticsearch migration
 ResolvedCyberpower678T247530 refill-api tool elasticsearch migration
 Resolvedbd808T247715 stashbot elasticsearch migration
 Resolved• BstormT214513 Deploy and migrate tools to a Kubernetes v1.15 or newer cluster
 Resolved• BstormT111914 Setup DNS for kubernetes services
 ResolvedaborreroT142862 Setup Kubernetes Masters in a HA setup
 ResolvedaborreroT215663 Stand up upgraded Toolforge etcd clusters
 ResolvedaborreroT215530 Sort out the best method of spinning up multiple toolforge kubernetes masters
 ResolvedaborreroT215679 Sort out and test deploying the worker nodes in a sane fashion
 ResolvedaborreroT215975 Package/copy kubeadm, kubelet, docker-ce and kubectl to Toolforge Aptly or Reprepro
 ResolvedJproramaT172855 Create visual diagram of documented components of Toolforge Kubernetes cluster
 ResolvedaborreroT215531 Deploy upgraded Kubernetes to toolsbeta
 Resolved• BstormT215529 Puppetize/stand up a load balancer for K8s API servers
 ResolvedaborreroT226098 Toolforge: modernize deployment for etcd in k8s
 ResolvedaborreroT228267 Toolforge: iptables flavor for Debian Buster-based k8s cluster
 ResolvedaborreroT228500 Toolforge: evaluate ingress mechanism
 ResolvedaborreroT234032 Toolforge ingress: create a default landing page for unknown/default URLs
 ResolvedaborreroT234037 Toolforge ingress: decide on final layout of north-south proxy setup
 ResolvedaborreroT235059 Toolforge: refresh puppet code for proxy (dynamicproxy) to support Debian Buster
 Resolved• BstormT234231 Toolforge ingress: decide on how ingress configuration objects will be managed
 ResolveddduvallT236203 Add CI checks for golang admission controllers
 Resolved• BstormT254293 Change to admission controller readme.md failed to pass gate-and-submit jobs
 ResolvedaborreroT228660 Toolforge: new k8s: issues with the initial coredns setup
 Resolved• BstormT228887 Update pause container in our internal registry
 Resolved• BstormT229009 Proposal: ditching the master name in kubernetes servers
 Resolved• BstormT234702 Review and establish configurable quotas for users in the new Kubernetes cluster
 ResolvedaborreroT236074 Toolforge: rebuild the new k8s toolsbeta deployment and write final docs
 ResolvedaborreroT236249 Toolforge: new k8s: upload internal docker images to our registry
 ResolvedaborreroT236824 Toolforge: new k8s: get new deb packages for 1.15.4 or 1.15.5
 ResolvedaborreroT237443 toolsbeta: new k8s: deploy a front proxy (dynamicproxy)
 Resolved• BstormT237541 CoreDNS in the new k8s cluster cannot talk to the Cloud recursors
 DeclinedNoneT238641 toolforge: some additional testing before final migration
 ResolvedaborreroT239403 toolforge: new k8s: scale up a bit the cluster before final tests and initial migrations
 OpenNoneT239404 [k8s,infra] evaluate DNS (coredns) autoscale options
 ResolvedaborreroT239405 toolforge: new k8s: evaluate ingress controller reload behaviour
 StalledNoneT239406 toolforge: new k8s: evalute and test firewalling via calico
 ResolvedaborreroT238655 toolforge: new k8s: issues with the apiserver and etcd
 Resolved• BstormT215553 Figure out cert management for Toolforge kubernetes and make it clear in documents, etc. for the upgrade
 Resolved• BstormT169287 etcd config depends on puppet certs, but puppet doesn't know
 ResolvedyuvipandaT119814 Figure out how to deal with SSL cert issues for kubernetes masters
 DuplicateNoneT144153 Move kubernetes authentication to using X.509 client certs
 Resolved• BstormT215678 Replace each of the custom controllers with something in a new Toolforge Kubernetes setup
 Resolved• BstormT227290 Design and document how to integrate the new Toolforge k8s cluster with PodSecurityPolicy
 Resolved• BstormT238162 Establish a process for renewing TLS certs for the 2 webhook controllers
 DuplicateNoneT224273 Toolforge: develop new k8s cluster in toolsbeta
 Resolved• BstormT233372 Create a "novaobserver" equivalent for Toolforge Kubernetes cluster inspection
 ResolvedSecurityaborreroT346313 toolforge: k8s-status: prevent it from accessing some information
 ResolvedaborreroT235627 Toolforge: upgrade main proxy servers to Debian Buster
 DuplicateNoneT235756 Toolforge: webservice utility: add support for thew new k8s setup
 Resolved• BstormT236202 Modify webservice and maintain-kubeusers to allow switching to the new cluster
 Resolved• BstormT228499 Toolforge: changes to maintain-kubeusers
 Resolved• BstormT229058 Replace the nslcd mount in containers from the old Toolforge cluster with something that will work with sssd in the new one
 Resolved• BstormT237836 `webservice restart` regression with backend=kubernetes in webservice 0.51
 ResolvedaborreroT236826 Toolforge: new k8s: initial build of the new kubernetes cluster
 ResolvedaborreroT237633 Request increased quota for tools Cloud VPS project
 ResolvedaborreroT237643 toolforge: new k8s: figure out metrics / observability
 ResolvedaborreroT237557 new proxy and etcd nodes unreachable by ssh for tools-prometheus
 ResolvedaborreroT238058 toolforge: prometheus-node-exporter not working on tools-proxy-06
 ResolvedaborreroT238096 Toolforge: prometheus: refresh setup
 ResolvedaborreroT245180 Document and test failing over prometheus
 ResolvedaborreroT240402 Deploy or consciously decide not to deploy metrics-server in toolforge kubernetes
 ResolvedaborreroT241853 Move metrics-server and kube-state-metrics into the new metrics namespace
 Resolved• BstormT237784 Document migration plans and timelines
 Resolved• BstormT237789 Document (and execute) the upgrade process for the new Toolforge K8s cluster
 Resolved• BstormT238654 toolforge: new k8s: issues with routing interfering with DNS in the cluster as well as the webhook controllers
 DuplicateNoneT239407 toolforge: new k8s: package newer/more convenient python3 k8s client libs
 ResolvedaborreroT239409 toolforge: new k8s: introduce more robust controls for deb pkg versions
Restricted Task
 OpenNoneT272905 Reduce privs of metrics pods where we can
 Resolved• BstormT240922 Change name of commons_describer tool or provide some workaround for Kubernetes/DNS
 Resolvedbd808T240923 Fix toolschecker's insistence that a kubeconfig is json
 InvalidaborreroT240925 `kubectl get pods` fails after switching to new k8s cluster
 Resolvedbd808T241008 New k8s cluster routing behaving strangely for bd808-test tool
 Resolvedbd808T241310 Kubernetes ingress passes it's port & proto to apps rather than the port & proto from the front proxy
Restricted Task
 ResolvedSecurity• BstormT242067 Error joining new worker node to Toolforge Kubernetes cluster
 ResolvedaborreroT242719 https://tools.wmflabs.org/{toolname} no longer redirects to https://tools.wmflabs.org/{toolname}/ on new k8s cluster
 Resolvedbd808T242824 Tool account cannot list all namespaced objects in its Kubernetes namespace
 DuplicateNoneT243468 Add smarter resourcing logic to kubernetes backend of webservice
 Resolved• BstormT244289 Improve limit range management in webservice for Kubernetes
 Resolvedbd808T244293 Add a function to webservice called "migrate" that will push a tool from the old cluster on Kubernetes to the new one
 Resolvedbd808T244791 Scale up 2020 Kubernetes cluster for final migration of legacy cluster workloads
 ResolvedKrenairT245365 Replace tools-puppetmaster-01 (jessie) with a buster puppetmaster
 Resolved• BstormT246689 Toolforge: cleanup legacy kubernetes cluster
 Resolved• BstormT248703 Rebuild the docker builder for Toolforge
 Resolved• BstormT248929 Rebuild tools-redis servers as stretch

Event Timeline

StrikerBot triaged this task as Medium priority.Oct 26 2019, 12:32 AM
StrikerBot created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 26 2019, 12:32 AM
Dzahn unsubscribed.Oct 26 2019, 5:41 PM
Dzahn added a comment.Oct 26 2019, 5:50 PM

Could you please remove me from admins in this project? Currently it fails to load the member screen in Horizon. "upstream request timeout" so i can't do it myself.

bd808 added projects: Toolforge, cloud-services-team (Kanban).Oct 27 2019, 5:09 AM
bd808 moved this task from VPS Projects to WMCS infrastructure on the Cloud-VPS (Debian Jessie Deprecation) board.Oct 27 2019, 5:21 AM
bd808 added a subtask: T235627: Toolforge: upgrade main proxy servers to Debian Buster.Oct 28 2019, 4:08 PM
bd808 updated the task description. (Show Details)
bd808 moved this task from Backlog to Tracking on the Toolforge board.
bd808 added a subscriber: Dzahn.
bd808 added a subtask: T214513: Deploy and migrate tools to a Kubernetes v1.15 or newer cluster.Oct 28 2019, 4:15 PM
bd808 updated the task description. (Show Details)Oct 28 2019, 4:23 PM
• Bstorm reopened subtask T235627: Toolforge: upgrade main proxy servers to Debian Buster as Open.Oct 28 2019, 9:55 PM
aborrero closed subtask T235627: Toolforge: upgrade main proxy servers to Debian Buster as Resolved.Oct 29 2019, 10:08 AM
aborrero moved this task from Inbox to Soon! on the cloud-services-team (Kanban) board.Nov 27 2019, 4:23 PM
Dzahn unsubscribed.Dec 3 2019, 1:50 AM
Krenair mentioned this in T245365: Replace tools-puppetmaster-01 (jessie) with a buster puppetmaster.Feb 16 2020, 6:10 PM
Krenair added a subtask: T245365: Replace tools-puppetmaster-01 (jessie) with a buster puppetmaster.
Krenair updated the task description. (Show Details)
Krenair added a subscriber: Dzahn.
aborrero updated the task description. (Show Details)Feb 17 2020, 9:35 AM
Krenair closed subtask T245365: Replace tools-puppetmaster-01 (jessie) with a buster puppetmaster as Resolved.Feb 28 2020, 10:27 PM
Krenair updated the task description. (Show Details)
aborrero updated the task description. (Show Details)Mar 3 2020, 10:58 AM
Dzahn unsubscribed.Mar 3 2020, 2:13 PM
bd808 updated the task description. (Show Details)Mar 30 2020, 10:02 PM
bd808 added a subscriber: Dzahn.
• Bstorm closed subtask T248929: Rebuild tools-redis servers as stretch as Resolved.Apr 6 2020, 7:16 PM
• Bstorm updated the task description. (Show Details)
Dzahn mentioned this in T249807: Weekly phabricator-reports mail: List open tasks with a Due Date in the past.Apr 10 2020, 1:08 PM
bd808 closed subtask T214513: Deploy and migrate tools to a Kubernetes v1.15 or newer cluster as Resolved.Apr 11 2020, 8:47 PM
Dzahn updated the task description. (Show Details)Apr 29 2020, 2:02 PM
Dzahn unsubscribed.
Dzahn added a comment.Apr 29 2020, 2:05 PM

I have been re-subscribed 3 times but i am not sure why, i am not a user of tools and not an admin of the project anymore.

Aklapper added a comment.May 3 2020, 3:53 PM

Is this task still valid and should stay open? Asking as the Due Date on this task says December 2019. If this task is done, please resolve it (via Add Action... → Change Status in the dropdown menu). If it is not done, please remove or reset the Due Date (via Edit Task). Thanks!

• Bstorm removed Due Date.May 4 2020, 9:22 PM
RhinosF1 subscribed.May 4 2020, 9:25 PM
• Bstorm closed this task as Resolved.May 4 2020, 10:10 PM
• Bstorm claimed this task.
• Bstorm closed subtask T236606: Rebuild Toolforge elasticsearch cluster with Stretch or Buster as Resolved.
• Bstorm updated the task description. (Show Details)
bd808 closed subtask T246689: Toolforge: cleanup legacy kubernetes cluster as Resolved.Sep 23 2020, 7:48 PM
• Bstorm mentioned this in T286798: Remove jessie + stretch containers from Toolforge.Jul 16 2021, 4:25 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits