Page MenuHomePhabricator
Create Task
Maniphest T101651

Set up toolsbeta more fully to help make testing easier
Closed, ResolvedPublic
Actions

Description

Currently toolsbeta is only partially set up, and testing some types of puppet patches are harder. It should mirror production tools.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedaborreroT101651 Set up toolsbeta more fully to help make testing easier
 Resolved• BstormT214513 Deploy and migrate tools to a Kubernetes v1.15 or newer cluster
 Resolved• BstormT111914 Setup DNS for kubernetes services
 ResolvedaborreroT142862 Setup Kubernetes Masters in a HA setup
 ResolvedaborreroT215663 Stand up upgraded Toolforge etcd clusters
 ResolvedaborreroT215530 Sort out the best method of spinning up multiple toolforge kubernetes masters
 ResolvedaborreroT215679 Sort out and test deploying the worker nodes in a sane fashion
 ResolvedaborreroT215975 Package/copy kubeadm, kubelet, docker-ce and kubectl to Toolforge Aptly or Reprepro
 ResolvedJproramaT172855 Create visual diagram of documented components of Toolforge Kubernetes cluster
 ResolvedaborreroT215531 Deploy upgraded Kubernetes to toolsbeta
 Resolved• BstormT215529 Puppetize/stand up a load balancer for K8s API servers
 ResolvedaborreroT226098 Toolforge: modernize deployment for etcd in k8s
 ResolvedaborreroT228267 Toolforge: iptables flavor for Debian Buster-based k8s cluster
 ResolvedaborreroT228500 Toolforge: evaluate ingress mechanism
 ResolvedaborreroT234032 Toolforge ingress: create a default landing page for unknown/default URLs
 ResolvedaborreroT234037 Toolforge ingress: decide on final layout of north-south proxy setup
 ResolvedaborreroT235059 Toolforge: refresh puppet code for proxy (dynamicproxy) to support Debian Buster
 Resolved• BstormT234231 Toolforge ingress: decide on how ingress configuration objects will be managed
 Resolved• dduvallT236203 Add CI checks for golang admission controllers
 Resolved• BstormT254293 Change to admission controller readme.md failed to pass gate-and-submit jobs
 ResolvedaborreroT228660 Toolforge: new k8s: issues with the initial coredns setup
 Resolved• BstormT228887 Update pause container in our internal registry
 Resolved• BstormT229009 Proposal: ditching the master name in kubernetes servers
 Resolved• BstormT234702 Review and establish configurable quotas for users in the new Kubernetes cluster
 ResolvedaborreroT236074 Toolforge: rebuild the new k8s toolsbeta deployment and write final docs
 ResolvedaborreroT236249 Toolforge: new k8s: upload internal docker images to our registry
 ResolvedaborreroT236824 Toolforge: new k8s: get new deb packages for 1.15.4 or 1.15.5
 ResolvedaborreroT237443 toolsbeta: new k8s: deploy a front proxy (dynamicproxy)
 Resolved• BstormT237541 CoreDNS in the new k8s cluster cannot talk to the Cloud recursors
 DeclinedNoneT238641 toolforge: some additional testing before final migration
 ResolvedaborreroT239403 toolforge: new k8s: scale up a bit the cluster before final tests and initial migrations
 OpenNoneT239404 toolforge: new k8s: evaluate DNS (coredns) autoscale options
 ResolvedaborreroT239405 toolforge: new k8s: evaluate ingress controller reload behaviour
 StalledNoneT239406 toolforge: new k8s: evalute and test firewalling via calico
 ResolvedaborreroT238655 toolforge: new k8s: issues with the apiserver and etcd
 Resolved• BstormT215553 Figure out cert management for Toolforge kubernetes and make it clear in documents, etc. for the upgrade
 Resolved• BstormT169287 etcd config depends on puppet certs, but puppet doesn't know
 ResolvedyuvipandaT119814 Figure out how to deal with SSL cert issues for kubernetes masters
 DuplicateNoneT144153 Move kubernetes authentication to using X.509 client certs
 Resolved• BstormT215678 Replace each of the custom controllers with something in a new Toolforge Kubernetes setup
 Resolved• BstormT227290 Design and document how to integrate the new Toolforge k8s cluster with PodSecurityPolicy
 Resolved• BstormT238162 Establish a process for renewing TLS certs for the 2 webhook controllers
 DuplicateNoneT224273 Toolforge: develop new k8s cluster in toolsbeta
 Resolved• BstormT233372 Create a "novaobserver" equivalent for Toolforge Kubernetes cluster inspection
Restricted Task
 ResolvedaborreroT235627 Toolforge: upgrade main proxy servers to Debian Buster
 DuplicateNoneT235756 Toolforge: webservice utility: add support for thew new k8s setup
 Resolved• BstormT236202 Modify webservice and maintain-kubeusers to allow switching to the new cluster
 Resolved• BstormT228499 Toolforge: changes to maintain-kubeusers
 Resolved• BstormT229058 Replace the nslcd mount in containers from the old Toolforge cluster with something that will work with sssd in the new one
 Resolved• BstormT237836 `webservice restart` regression with backend=kubernetes in webservice 0.51
 ResolvedaborreroT236826 Toolforge: new k8s: initial build of the new kubernetes cluster
 ResolvedaborreroT237633 Request increased quota for tools Cloud VPS project
 ResolvedaborreroT237643 toolforge: new k8s: figure out metrics / observability
 ResolvedaborreroT237557 new proxy and etcd nodes unreachable by ssh for tools-prometheus
 ResolvedaborreroT238058 toolforge: prometheus-node-exporter not working on tools-proxy-06
 ResolvedaborreroT238096 Toolforge: prometheus: refresh setup
 ResolvedaborreroT245180 Document and test failing over prometheus
 ResolvedaborreroT240402 Deploy or consciously decide not to deploy metrics-server in toolforge kubernetes
 ResolvedaborreroT241853 Move metrics-server and kube-state-metrics into the new metrics namespace
 Resolved• BstormT237784 Document migration plans and timelines
 Resolved• BstormT237789 Document (and execute) the upgrade process for the new Toolforge K8s cluster
 Resolved• BstormT238654 toolforge: new k8s: issues with routing interfering with DNS in the cluster as well as the webhook controllers
 DuplicateNoneT239407 toolforge: new k8s: package newer/more convenient python3 k8s client libs
 ResolvedaborreroT239409 toolforge: new k8s: introduce more robust controls for deb pkg versions
Restricted Task
 OpenNoneT272905 Reduce privs of metrics pods where we can
 Resolved• BstormT240922 Change name of commons_describer tool or provide some workaround for Kubernetes/DNS
 Resolvedbd808T240923 Fix toolschecker's insistence that a kubeconfig is json
 InvalidaborreroT240925 `kubectl get pods` fails after switching to new k8s cluster
 Resolvedbd808T241008 New k8s cluster routing behaving strangely for bd808-test tool
 Resolvedbd808T241310 Kubernetes ingress passes it's port & proto to apps rather than the port & proto from the front proxy
Restricted Task
 ResolvedSecurity• BstormT242067 Error joining new worker node to Toolforge Kubernetes cluster
 ResolvedaborreroT242719 https://tools.wmflabs.org/{toolname} no longer redirects to https://tools.wmflabs.org/{toolname}/ on new k8s cluster
 Resolvedbd808T242824 Tool account cannot list all namespaced objects in its Kubernetes namespace
 DuplicateNoneT243468 Add smarter resourcing logic to kubernetes backend of webservice
 Resolved• BstormT244289 Improve limit range management in webservice for Kubernetes
 Resolvedbd808T244293 Add a function to webservice called "migrate" that will push a tool from the old cluster on Kubernetes to the new one
 Resolvedbd808T244791 Scale up 2020 Kubernetes cluster for final migration of legacy cluster workloads

Event Timeline

yuvipanda created this task.Jun 7 2015, 4:19 PM
yuvipanda raised the priority of this task from to Needs Triage.
yuvipanda updated the task description. (Show Details)
yuvipanda added a project: Toolforge.
yuvipanda added subscribers: yuvipanda, scfc.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 7 2015, 4:19 PM
valhallasw triaged this task as Medium priority.Jul 2 2015, 7:42 PM
valhallasw subscribed.
Restricted Application added a project: Cloud-Services. · View Herald TranscriptJul 2 2015, 7:42 PM
valhallasw moved this task from Backlog to Ready to be worked on on the Toolforge board.Jul 2 2015, 7:46 PM
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:50 PM
• Bstorm mentioned this in T221721: Puppet broken on several vms in toolsbeta.Jun 14 2019, 3:54 PM
bd808 removed a project: Cloud-Services.Jan 4 2020, 9:16 PM
bd808 added a subtask: T214513: Deploy and migrate tools to a Kubernetes v1.15 or newer cluster.
aborrero closed this task as Resolved.Mar 2 2020, 5:25 PM
aborrero claimed this task.
aborrero subscribed.

Toolsbeta setup is 99% same as the setup in the Tools project now, including a front proxy for webservices.

There is some stuff that is not very easy to test in Toolsbeta, but for the majority of cases, the setup suffices I think!

bd808 closed subtask T214513: Deploy and migrate tools to a Kubernetes v1.15 or newer cluster as Resolved.Apr 11 2020, 8:47 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL