Page MenuHomePhabricator
Create Task
Maniphest T207048

ATS production-ready as a backend cache layer
Closed, ResolvedPublic
Actions

Description

Q2 TEC1 Goal!

  • Purging: T204208 [DONE]
  • Logging T204225 [DONE]
  • Monitoring / Alerting T204209 [DONE]
  • Multi-DC Routing [DONE]
  • Backend-side request-mangling T209021
  • Audit all Varnish-fronted services for lack of TLS, ping owners ahead of needs in FQ3/4 and beyond T210411

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

BBlack triaged this task as Medium priority.Oct 15 2018, 4:14 PM
BBlack created this task.
Restricted Application added a project: SRE. · View Herald TranscriptOct 15 2018, 4:14 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
BBlack added a subtask: T204208: puppetize http purging for ATS backends.Oct 15 2018, 4:15 PM
Paladox subscribed.Oct 15 2018, 4:19 PM
• ema moved this task from Backlog to Caching on the Traffic board.Oct 22 2018, 8:36 AM
• ema added a subtask: T204209: Define and deploy Icinga checks for ATS backends.Oct 22 2018, 9:22 AM
• ema added a subtask: T204232: Package and deploy ATS v8.x.
• ema added a subtask: T204225: ATS: log inspection at runtime.Oct 22 2018, 9:24 AM
• ema closed subtask T204232: Package and deploy ATS v8.x as Resolved.Oct 24 2018, 12:52 PM
• ema changed the status of subtask T204209: Define and deploy Icinga checks for ATS backends from Open to Stalled.Nov 6 2018, 4:51 PM
• ema updated the task description. (Show Details)Nov 8 2018, 8:16 AM
• ema added a subtask: T209021: ATS backend-side request-mangling.
• ema updated the task description. (Show Details)Nov 8 2018, 8:47 AM
CDanis subscribed.Nov 9 2018, 8:04 PM
• ema closed subtask T204225: ATS: log inspection at runtime as Resolved.Nov 15 2018, 10:07 AM
• ema updated the task description. (Show Details)
• ema changed the status of subtask T204209: Define and deploy Icinga checks for ATS backends from Stalled to Open.Nov 16 2018, 4:32 PM
• ema closed subtask T204209: Define and deploy Icinga checks for ATS backends as Resolved.Nov 19 2018, 4:47 PM
• ema updated the task description. (Show Details)
• ema reopened subtask T204225: ATS: log inspection at runtime as Open.Nov 19 2018, 5:23 PM
Ladsgroup subscribed.Nov 21 2018, 2:18 PM
• ema closed subtask T204225: ATS: log inspection at runtime as Resolved.Nov 26 2018, 2:55 PM
• ema updated the task description. (Show Details)Nov 26 2018, 4:03 PM
gerritbot subscribed.Nov 27 2018, 11:34 AM

Change 475992 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] cp1008: point varnish-fe to ATS host

https://gerrit.wikimedia.org/r/475992

gerritbot added a project: Patch-For-Review.Nov 27 2018, 11:34 AM
gerritbot added a comment.Nov 27 2018, 11:37 AM

Change 475992 merged by Ema:
[operations/puppet@production] cp1008: point varnish-fe to ATS host

https://gerrit.wikimedia.org/r/475992

gerritbot added a comment.Nov 28 2018, 5:06 PM

Change 476311 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] cache: stop using nhw admission policy

https://gerrit.wikimedia.org/r/476311

gerritbot added a comment.Nov 29 2018, 9:32 AM

Change 476311 merged by Ema:
[operations/puppet@production] cache: stop using nhw admission policy

https://gerrit.wikimedia.org/r/476311

gerritbot added a comment.Nov 30 2018, 8:13 AM

Change 476810 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: enable XDebug plugin

https://gerrit.wikimedia.org/r/476810

gerritbot added a comment.Nov 30 2018, 8:53 AM

Change 476810 merged by Ema:
[operations/puppet@production] ATS: XDebug plugin support

https://gerrit.wikimedia.org/r/476810

gerritbot added a comment.Nov 30 2018, 9:18 AM

Change 476814 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] varnish: do not allow X-ATS-Debug to be set from the outside

https://gerrit.wikimedia.org/r/476814

gerritbot added a comment.Nov 30 2018, 9:55 AM

Change 476820 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: add SystemTap probe for uncacheable responses

https://gerrit.wikimedia.org/r/476820

gerritbot added a comment.Nov 30 2018, 10:51 AM

Change 476828 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: do not add X-Forwarded-For

https://gerrit.wikimedia.org/r/476828

gerritbot added a comment.Dec 3 2018, 7:50 AM

Change 476828 merged by Ema:
[operations/puppet@production] ATS: do not add X-Forwarded-For

https://gerrit.wikimedia.org/r/476828

gerritbot added a comment.Dec 3 2018, 7:52 AM

Change 476814 merged by Ema:
[operations/puppet@production] varnish: do not allow X-ATS-Debug to be set from the outside

https://gerrit.wikimedia.org/r/476814

gerritbot added a comment.Dec 3 2018, 7:54 AM

Change 476820 merged by Ema:
[operations/puppet@production] ATS: add SystemTap probe for uncacheable responses

https://gerrit.wikimedia.org/r/476820

• ema updated the task description. (Show Details)Dec 3 2018, 2:57 PM
gerritbot added a comment.Dec 3 2018, 11:08 PM

Change 477424 had a related patch set uploaded (by BBlack; owner: BBlack):
[operations/puppet@production] Revert "cache: stop using nhw admission policy"

https://gerrit.wikimedia.org/r/477424

gerritbot added a comment.Dec 3 2018, 11:09 PM

Change 477424 merged by BBlack:
[operations/puppet@production] Revert "cache: stop using nhw admission policy"

https://gerrit.wikimedia.org/r/477424

gerritbot added a comment.Dec 4 2018, 4:01 PM

Change 477573 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] cache_upload: hfp on frontends for large objects except for exp

https://gerrit.wikimedia.org/r/477573

gerritbot added a comment.Dec 4 2018, 4:01 PM

Change 477574 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] cache: stop using nhw admission policy

https://gerrit.wikimedia.org/r/477574

gerritbot added a comment.Dec 5 2018, 10:28 AM

Change 477573 merged by Ema:
[operations/puppet@production] cache_upload: hfp on frontends for large objects except for exp

https://gerrit.wikimedia.org/r/477573

gerritbot added a comment.Dec 5 2018, 10:30 AM

Change 477574 merged by Ema:
[operations/puppet@production] cache: stop using nhw admission policy

https://gerrit.wikimedia.org/r/477574

gerritbot added a comment.Dec 5 2018, 11:25 AM

Change 477763 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: do not add Client-IP and Via to request headers

https://gerrit.wikimedia.org/r/477763

gerritbot added a comment.Dec 5 2018, 11:52 AM

Change 477767 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: add settings for RAM Cache

https://gerrit.wikimedia.org/r/477767

gerritbot added a comment.Dec 5 2018, 11:56 AM

Change 477763 merged by Ema:
[operations/puppet@production] ATS: do not add Client-IP and Via to request headers

https://gerrit.wikimedia.org/r/477763

gerritbot added a comment.Dec 5 2018, 11:57 AM

Change 477767 merged by Ema:
[operations/puppet@production] ATS: add settings for RAM Cache

https://gerrit.wikimedia.org/r/477767

gerritbot added a comment.Dec 6 2018, 9:39 AM

Change 477974 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: define global Lua scripts in plugin.config

https://gerrit.wikimedia.org/r/477974

gerritbot added a comment.Dec 6 2018, 10:01 AM

Change 477974 merged by Ema:
[operations/puppet@production] ATS: define global Lua scripts in plugin.config

https://gerrit.wikimedia.org/r/477974

gerritbot added a comment.Dec 6 2018, 11:36 AM

Change 477990 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: define one single global Lua script

https://gerrit.wikimedia.org/r/477990

gerritbot added a comment.Dec 6 2018, 12:07 PM

Change 477990 merged by Ema:
[operations/puppet@production] ATS: define one single global Lua script

https://gerrit.wikimedia.org/r/477990

• ema closed subtask T209021: ATS backend-side request-mangling as Resolved.Dec 6 2018, 12:40 PM
gerritbot added a comment.Dec 6 2018, 1:38 PM

Change 478003 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: support Collapsed Forwarding

https://gerrit.wikimedia.org/r/478003

gerritbot added a comment.Dec 7 2018, 9:04 AM

Change 478003 merged by Ema:
[operations/puppet@production] ATS: Collapsed Forwarding support

https://gerrit.wikimedia.org/r/478003

gerritbot added a comment.Dec 7 2018, 9:12 AM

Change 478155 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: set http.wait_for_cache

https://gerrit.wikimedia.org/r/478155

gerritbot added a comment.Dec 7 2018, 10:47 AM

Change 478155 merged by Ema:
[operations/puppet@production] ATS: set http.wait_for_cache

https://gerrit.wikimedia.org/r/478155

gerritbot added a comment.Dec 10 2018, 11:23 AM

Change 478640 had a related patch set uploaded (by Ema; owner: Ema):
[operations/debs/trafficserver@master] trafficserver (8.0.1-1wm1) stretch-wikimedia; urgency=medium

https://gerrit.wikimedia.org/r/478640

gerritbot added a comment.Dec 10 2018, 12:42 PM

Change 478640 merged by Ema:
[operations/debs/trafficserver@master] trafficserver (8.0.1-1wm1) stretch-wikimedia; urgency=medium

https://gerrit.wikimedia.org/r/478640

Stashbot subscribed.Dec 10 2018, 1:34 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-10T13:34:17Z] <ema> trafficserver 8.0.1-1wm1 uploaded to stretch-wikimedia T207048

gerritbot added a comment.Dec 11 2018, 9:21 AM

Change 478774 had a related patch set uploaded (by Ema; owner: Cwhite):
[operations/puppet@production] hiera: add trafficserver cluster definition

https://gerrit.wikimedia.org/r/478774

gerritbot added a comment.Dec 12 2018, 4:04 PM

Change 478774 merged by Cwhite:
[operations/puppet@production] hiera: add cache_ats cluster definition

https://gerrit.wikimedia.org/r/478774

gerritbot added a comment.Dec 14 2018, 4:41 PM

Change 479720 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: origin server certificate validation settings

https://gerrit.wikimedia.org/r/479720

gerritbot added a comment.Dec 14 2018, 4:51 PM

Change 479720 merged by Ema:
[operations/puppet@production] ATS: origin server certificate validation settings

https://gerrit.wikimedia.org/r/479720

gerritbot added a comment.Dec 17 2018, 2:18 PM

Change 480083 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] ATS: use TLS to access kartotherian

https://gerrit.wikimedia.org/r/480083

gerritbot added a comment.Dec 17 2018, 2:22 PM

Change 480083 merged by Ema:
[operations/puppet@production] ATS: use TLS to access kartotherian

https://gerrit.wikimedia.org/r/480083

• ema closed subtask T212215: Update Subject Alternative Name field in TLS certificates for swift as Resolved.Jan 2 2019, 12:02 PM
• ema closed this task as Resolved.Jan 9 2019, 9:50 AM

We've added TLS support for maps and fixed the SAN list on swift to ensure proper TLS connections with upload origin servers. This is thus done.

• ema mentioned this in T213263: Partial cache_upload traffic switchover to ATS and switchback to Varnish.Jan 9 2019, 11:10 AM
• ema changed the status of subtask T210411: Applayer services without TLS from Open to Stalled.Jul 22 2020, 2:49 PM
• ema closed subtask T210411: Applayer services without TLS as Resolved.Dec 8 2021, 8:22 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits