DB hardware for Reading Lists
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	Tgr
	Oct 5 2017, 8:51 AM

Description

Per the discussion in T164990, the x1 database cluster is close enough to full that a new service does not comfortably fit there. Reading Lists can temporarily live there with some restrictions but should eventually go to the to-be-established new cluster x2. That means new hardware needs to be procured - per T164990#3264314, probably 4 DB servers. This should be coordinated with the other would-be tenants of the new cluster.

(Not adding SRE hardware-requests yet as this is just a tracking task and not actionable right now; will probably happen in next annual budget planning.)

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T199451 Revisit limits on reading lists and increase them if possible
		Declined		None	T177462 DB hardware for Reading Lists

Event Timeline

Tgr created this task.Oct 5 2017, 8:51 AM

Restricted Application added a project: Product-Infrastructure-Team-Backlog-Deprecated. · View Herald TranscriptOct 5 2017, 8:51 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Tgr mentioned this in T168984: Create and enforce a limit for number of Reading Lists and Reading Lists entries for each user.Oct 5 2017, 8:55 AM

• Fjalapeno moved this task from Needs triage to Backlog on the Product-Infrastructure-Team-Backlog-Deprecated board.Oct 24 2017, 9:28 PM

• Mholloway subscribed.Dec 7 2017, 12:40 AM

Tgr mentioned this in rERLS8ec7242f5c09: Track reading list size.Feb 15 2018, 7:31 AM

Tgr mentioned this in rERLS5bd648a1d184: Track reading list size.

Tgr mentioned this in rERLS7021e534eec3: Track reading list size.Feb 18 2018, 9:16 AM

Tgr mentioned this in rERLS27a9b033b189: Track reading list size.Feb 23 2018, 1:16 AM

• Mholloway mentioned this in rERLSff5c38403e6e: Track reading list size.Mar 5 2018, 7:32 PM

Tgr mentioned this in rERLS0758ac79b2a0: Track reading list size.Mar 6 2018, 12:29 AM

Tgr updated the task description. (Show Details)Jun 30 2018, 11:41 AM

Tgr updated the task description. (Show Details)Jun 30 2018, 11:50 AM

I'll be checking in to see how we can make this actionable.

new cluster x2

When budgeting this year's resources, SRE decision (not only mine, Mark signed it off) was to budget to increase x1 servers rather than setting up a separate, dedicated cluster. That is coming for codfw on Q1 and for eqiad in Q3.

There was already a small increase of resources in late Q4.

@Tgr Can you specify the needs of the service to @jcrespo to see if they can be met with the planned increase?

@jcrespo where can we see the planned increase in detail? Thanks for chiming in!

I don't really have anything beyond what was projected in T164990. (The current load is around 1 read/sec an 0.1 write/sec, but the feature is not used on the web which would be the overwhelming majority of the load. OTOH there are some temporary limitations in place: no more than 10 lists or 100 list entries read in a single request - those would presumably be lifted if the DB permits.)