⚓ T110472 Decom parsoidcache cluster

Subject	Repo	Branch	Lines +/-
decom cache_parsoid	operations/puppet	production	+7 -242
parsoidcache: remove from LVS	operations/puppet	production	+0 -53
codfw: move cache_parsoid nodes to cache_upload	operations/puppet	production	+7 -24
MW parsoid URLs: s/parsoidcache/parsoid/	operations/mediawiki-config	master	+2 -2
Remove the Parsoid cache from beta	mediawiki/services/parsoid/deploy	master	+0 -2

Status	Assigned	Task
Resolved	Cmjohnson	T125486 eqiad cache cluster re-arrangements
Resolved	None	T110472 Decom parsoidcache cluster
Resolved	None	T110474 Decom parsoid-lb.eqiad.wikimedia.org entrypoint
Resolved	ssastry	T110714 Community should be notified of parsoid-lb decommissioning.
Resolved	• Pchelolo	T110711 RESTBase test suite can't use parsoid-lb endpoint
Resolved	• GWicke	T110712 RESTBase should offer a "friendly" wt2html form for VE developers
Resolved	ssastry	T110715 Visual diff testing should not use parsoid-lb.eqiad
Resolved	cscott	T110713 OCG should default to using RESTBase
Resolved	santhosh	T111562 CX should default to using restbase, not parsoid-lb
Resolved	KartikMistry	T127308 Decom parsoid-lb.eqiad.wikimedia.org entrypoint in cxserver
Resolved	BBlack	T110475 Remove restbase from parsoidcache
Resolved	BBlack	T110476 Remove citoid from parsoidcache
Resolved	BBlack	T110477 Remove graphoid from parsoidcache
Resolved	BBlack	T110478 Remove cxserver from parsoidcache cluster

BBlack created this task.Aug 27 2015, 2:44 AM

BBlack raised the priority of this task from to Medium.

BBlack updated the task description. (Show Details)

BBlack added a project: Traffic.

BBlack added a subscriber: BBlack.

Restricted Application added a project: acl*sre-team. · View Herald TranscriptAug 27 2015, 2:44 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

BBlack added subscribers: akosiaris, • GWicke, • mobrovac.Aug 27 2015, 2:54 AM

Restricted Application added a subscriber: Matanya. · View Herald TranscriptAug 27 2015, 2:54 AM

• mobrovac added a project: Services.Aug 27 2015, 4:54 PM

BBlack updated the task description. (Show Details)Aug 27 2015, 5:13 PM

BBlack set Security to None.

BBlack mentioned this in T110717: Declarative configuration for varnish services and backends.Aug 28 2015, 6:55 PM

BBlack closed subtask T110477: Remove graphoid from parsoidcache as Resolved.Jan 28 2016, 2:37 AM

BBlack closed subtask T110475: Remove restbase from parsoidcache as Resolved.Jan 29 2016, 10:46 AM

BBlack closed subtask T110476: Remove citoid from parsoidcache as Resolved.

BBlack closed subtask T110478: Remove cxserver from parsoidcache cluster as Resolved.

Change 267234 had a related patch set uploaded (by BBlack):
MW parsoid URLs: s/parsoidcache/parsoid/

https://gerrit.wikimedia.org/r/267234

gerritbot added a project: Patch-For-Review.Jan 29 2016, 11:10 AM

FWIW, in a 1 hour snapshot of all traffic to parsoidcache (regardless of internal vs external IPs), when varnish/pybal monitoring checks are excluded, we're left with 405 legit requests (or about 1 every 8.9s on average). All of these have the common attributes:

Host: 10.2.2.29 (internal traffic to parsoidcache.svc.eqiad.wmnet IP)
User-Agent: wikimedia/multi-http-client v1.0
RxURL of the form /SITE/v3/transform/(wikitext/to/html|html/to/wikitext)/...

None of the legit requests were through the public IP/hostname (parsoid-lb.eqiad.wikimedia.org) during this particular 1-hour window.

BBlack added a parent task: T125486: eqiad cache cluster re-arrangements.Feb 2 2016, 3:57 AM

Change 267865 had a related patch set uploaded (by BBlack):
Remove the Parsoid cache from beta

https://gerrit.wikimedia.org/r/267865

Change 267865 merged by jenkins-bot:
Remove the Parsoid cache from beta

https://gerrit.wikimedia.org/r/267865

BBlack changed the status of subtask T110474: Decom parsoid-lb.eqiad.wikimedia.org entrypoint from Open to Stalled.Feb 3 2016, 3:25 AM

Change 267234 merged by jenkins-bot:
MW parsoid URLs: s/parsoidcache/parsoid/

https://gerrit.wikimedia.org/r/267234

Arlolra mentioned this in T59265: Set up better monitoring / alerts for Parsoid varnishes.Feb 5 2016, 5:58 AM

Change 272318 had a related patch set uploaded (by BBlack):
codfw: move cache_parsoid nodes to cache_upload

https://gerrit.wikimedia.org/r/272318