Page MenuHomePhabricator
Create Task
Maniphest T282975

Create Kubernetes ingress for tools running on the grid engine to remove dynamicproxy
Closed, ResolvedPublic
Actions

Description

To get rid of dynamicproxy (which is currently a SPOF) before the grid is fully shut down, we could route traffic to tools running on the grid via the kubernetes ingress. We can have webservice-runner create a manual Service object with its endpoint configured and and Ingress object to route the traffic to it like we do for tools running in Kubernetes. After that we should be able to remove dynamicproxy by either removing the lua routing from nginx or by moving TLS termination to the haproxy nodes and skipping the proxy nodes entirely.

Details

SubjectRepoBranchLines +/-
Route Grid engine web requests via Kubernetesoperations/software/tools-webservicemaster+234 -75
Customize query in gerrit

Related Objects
Search...

Event Timeline

taavi created this task.May 16 2021, 3:38 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 16 2021, 3:38 PM
taavi updated the task description. (Show Details)May 16 2021, 4:04 PM
taavi mentioned this in T283948: Eliminate single point of failure from Toolforge front proxy.May 28 2021, 6:28 PM
taavi added a parent task: T283948: Eliminate single point of failure from Toolforge front proxy.
taavi updated the task description. (Show Details)May 29 2021, 8:01 AM
taavi claimed this task.May 29 2021, 8:47 AM
taavi triaged this task as Medium priority.
Restricted Application added a project: User-Majavah. · View Herald TranscriptMay 29 2021, 8:47 AM
gerritbot added a comment.May 29 2021, 9:03 AM

Change 697096 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/software/tools-webservice@master] Route Grid engine web requests via Kubernetes

https://gerrit.wikimedia.org/r/697096

gerritbot added a project: Patch-For-Review.May 29 2021, 9:03 AM
taavi moved this task from Backlog to Waiting for code review on the Toolforge board.Jun 1 2021, 7:01 AM
taavi moved this task from Unsorted to Pending review on the User-Majavah board.Jun 8 2021, 6:30 PM
Stashbot added a comment.Jun 14 2021, 9:29 PM

Mentioned in SAL (#wikimedia-cloud) [2021-06-14T21:29:19Z] <bstorm> deploy package with the staged patch to switch away from os.execv to QA in toolsbeta as toollabs-webservice version 0.75 T282975

Stashbot added a comment.Jun 14 2021, 10:21 PM

Mentioned in SAL (#wikimedia-cloud) [2021-06-14T22:21:28Z] <bstorm> push docker-registry.tools.wmflabs.org/toolforge-python37-sssd-web:testing to test staged os.execv (and other patches) using toolsbeta toollabs-webservice version 0.75 T282975

• Bstorm mentioned this in T292105: Remove deprecated ingress objects from existing web services.Sep 29 2021, 6:52 PM
gerritbot added a comment.Oct 1 2021, 8:33 AM

Change 697096 merged by jenkins-bot:

[operations/software/tools-webservice@master] Route Grid engine web requests via Kubernetes

https://gerrit.wikimedia.org/r/697096

Maintenance_bot removed a project: Patch-For-Review.Oct 1 2021, 9:10 AM
Stashbot mentioned this in T292706: tools-webservice should use ingress v1.Oct 20 2021, 12:51 PM
Stashbot mentioned this in T276626: Toolforge: Automatically identify when people are trying to launch a Python webservice with a venv created using the wrong Python version.

Mentioned in SAL (#wikimedia-cloud) [2021-10-20T12:51:18Z] <majavah> rolling out toolforge-webservice 0.78 T292706 T282975 T276626

bd808 mentioned this in T301015: Tools with invalid/missing Kubernetes credentials cannot start gridengine webservices.Feb 4 2022, 10:23 PM
taavi closed this task as Resolved.Jul 2 2022, 2:13 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits