Page MenuHomePhabricator
Create Task
Maniphest T418145

Configure ATS to allow fractional routing for api.wikimedia.org
Closed, ResolvedPublic
Actions

Description

In order to migrate different routes at different times from the API gateway to the REST gateway, we need to change the ATS configuration for api.wikimedia.org from a simple map to api-gateway.discovery.wmnet to use gateway-check.lua and multi-dc.lua

gateway-check.lua will handle fractionally routing to rest-gateway.discovery.wmnet based on URL patterns
multi-dc.lua support is needed to route to the correct instance of the rest-gateway.

  • Add api-gateway-ro discovery service to support multi-dc.lua (cheat by just doing a CNAME from api-gateway-ro to api-gateway as it's already an A/A discovery service and we only need it temporarily)
  • Change ATS config for api.wikimedia.org from map to the same lua param chain as the REST gateway reroutes, defaulting to api-gateway.discovery.wmnet

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
trafficserver: Add api.w.o to gateway-check.lua.confoperations/puppetproduction+6 -0
trafficserver: Add api.w.o to gateway-check.lua.confoperations/puppetproduction+6 -0
trafficserver: Support fractional routing for api.w.ooperations/puppetproduction+77 -3
api-gateway: Add api-gateway-ro to certificateoperations/deployment-chartsmaster+3 -0
wmnet: Add api-gateway-ro recordoperations/dnsmaster+4 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Clement_Goubert created this task.Feb 23 2026, 3:23 PM
Clement_Goubert triaged this task as High priority.
Clement_Goubert moved this task from Inbox to Scheduled (this Q) on the ServiceOps new board.
Clement_Goubert mentioned this in T418146: Reroute Core APIs through the REST gateway.
Clement_Goubert added a subscriber: hnowlan.
Clement_Goubert mentioned this in T418147: Reroute Device Analytics APIs through the REST gateway.Feb 23 2026, 3:25 PM
Clement_Goubert mentioned this in T418148: Reroute Link Recommendation APIs through the REST gateway.Feb 23 2026, 3:28 PM
Clement_Goubert updated the task description. (Show Details)Feb 26 2026, 3:22 PM
gerritbot added a comment.Feb 26 2026, 3:26 PM

Change #1244697 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/dns@master] wmnet: Add rest-gateway-ro record

https://gerrit.wikimedia.org/r/1244697

gerritbot added a project: Patch-For-Review.Feb 26 2026, 3:26 PM
gerritbot added a comment.Feb 26 2026, 3:34 PM

Change #1244700 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/deployment-charts@master] api-gateway: Add api-gateway-ro to certificate

https://gerrit.wikimedia.org/r/1244700

gerritbot added a comment.Feb 27 2026, 3:44 PM

Change #1245389 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] trafficserver: Support fractional routing for api.w.o

https://gerrit.wikimedia.org/r/1245389

Clement_Goubert moved this task from Scheduled (this Q) to In Progress on the ServiceOps new board.Mar 3 2026, 12:12 PM
HCoplin-WMF edited projects, added MW-Interfaces-Team; removed [MWI] FY2025-26 Q3, MW-Interfaces-Team (MWI-Roadmap).Mar 3 2026, 5:15 PM
HCoplin-WMF moved this task from Incoming (Needs Triage) to Radar (other teams work) on the MW-Interfaces-Team board.
gerritbot added a comment.Mar 11 2026, 11:28 AM

Change #1244697 merged by Clément Goubert:

[operations/dns@master] wmnet: Add api-gateway-ro record

https://gerrit.wikimedia.org/r/1244697

gerritbot added a comment.Mar 11 2026, 11:32 AM

Change #1244700 merged by jenkins-bot:

[operations/deployment-charts@master] api-gateway: Add api-gateway-ro to certificate

https://gerrit.wikimedia.org/r/1244700

gerritbot added a comment.Mar 16 2026, 12:04 PM

Change #1245389 merged by Clément Goubert:

[operations/puppet@production] trafficserver: Support fractional routing for api.w.o

https://gerrit.wikimedia.org/r/1245389

Clement_Goubert updated the task description. (Show Details)Mar 16 2026, 12:12 PM
Clement_Goubert closed this task as Resolved.Mar 16 2026, 12:15 PM

This is now merged.

  • "standard" rest API paths under api.wikimedia.org -> rest-gateway
  • Browsing api.wikimedia.org wiki -> mw-web
  • API portal APIs -> api-gateway

This merge also removes the AQS1 style paths for device-analytics that were deprecated with the migration to AQS2.

Maintenance_bot removed a project: Patch-For-Review.Mar 16 2026, 12:32 PM
gerritbot added a comment.Mar 23 2026, 12:45 PM

Change #1259067 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] trafficserver: Add api.w.o to gateway-check.lua.conf

https://gerrit.wikimedia.org/r/1259067

gerritbot added a project: Patch-For-Review.Mar 23 2026, 12:45 PM
gerritbot added a comment.Tue, Mar 24, 4:09 PM

Change #1259067 merged by Clément Goubert:

[operations/puppet@production] trafficserver: Add api.w.o to gateway-check.lua.conf

https://gerrit.wikimedia.org/r/1259067

Maintenance_bot removed a project: Patch-For-Review.Tue, Mar 24, 4:31 PM
JMeybohm subscribed.EditedWed, Mar 25, 8:48 AM
In T418145#11744882, @gerritbot wrote:

Change #1259067 merged by Clément Goubert:

[operations/puppet@production] trafficserver: Add api.w.o to gateway-check.lua.conf

https://gerrit.wikimedia.org/r/1259067

That change got reverted this morning (T421203: Bad ATS config led to large volume of 5xx from RESTBase, https://gerrit.wikimedia.org/r/c/operations/puppet/+/1260559). Due to a syntax error we did not catch the config was never loaded until ATS got restarted for a different change and hard-failed to load it.

JMeybohm reopened this task as Open.Wed, Mar 25, 8:52 AM
gerritbot added a comment.Wed, Mar 25, 9:20 AM

Change #1260624 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] trafficserver: Add api.w.o to gateway-check.lua.conf

https://gerrit.wikimedia.org/r/1260624

gerritbot added a project: Patch-For-Review.Wed, Mar 25, 9:20 AM
gerritbot added a comment.Wed, Mar 25, 11:02 AM

Change #1260624 merged by Clément Goubert:

[operations/puppet@production] trafficserver: Add api.w.o to gateway-check.lua.conf

https://gerrit.wikimedia.org/r/1260624

Clement_Goubert closed this task as Resolved.Wed, Mar 25, 11:21 AM

New patch with fixed syntax merged, resolving

Maintenance_bot removed a project: Patch-For-Review.Wed, Mar 25, 11:31 AM
Clement_Goubert mentioned this in T422804: Reroute LiftWing endpoints.Thu, Apr 9, 10:33 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits