Setup redis clusters in codfw
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Joe
	Jan 15 2015, 9:56 AM

Description

In order to create a mediawiki stack in codfw, we need to set up the redis clusters there. We actually have two kind-of separate clusters in eqiad, rdb* and rbf*

Details

	Subject	Repo	Branch	Lines +/-
	fix rdb codfw hostnames in netboot.cfg	operations/puppet	production	+1 -1

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	Joe	T86894 Set up the mediawiki application layer in codfw
Resolved	Joe	T86887 Setup redis clusters in codfw
Resolved	Dzahn	T86898 Check that the redis roles can be applied in codfw, set up puppet.
Resolved	Dzahn	T86897 Procure and setup rbf2001-2002
Resolved	Papaul	T86940 label & setup drac/basic setings for rbf2001 & rbf2002
Resolved	Papaul	T88380 reclaim rbf2002/WMF5833 back to spare, allocate WMF5845 as rbf2002
Resolved	RobH	T86896 Procure rdb2001-2004 - onsite pending racking

Event Timeline

Joe created this task.Jan 15 2015, 9:56 AM

Joe raised the priority of this task from to Needs Triage.

Joe updated the task description. (Show Details)

Joe subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 15 2015, 9:56 AM

Joe added projects: acl*sre-team, ops-core.Jan 15 2015, 10:01 AM

Joe set Security to None.

Joe added a parent task: T86894: Set up the mediawiki application layer in codfw.Jan 15 2015, 10:20 AM

Joe added subtasks: T86898: Check that the redis roles can be applied in codfw, set up puppet., T86897: Procure and setup rbf2001-2002, T86896: Procure rdb2001-2004 - onsite pending racking.Jan 15 2015, 10:42 AM

Joe added a project: codfw-rollout-Apr-Jun-2015.Jan 20 2015, 7:52 PM

ArielGlenn subscribed.Jan 20 2015, 8:01 PM

Dzahn triaged this task as Medium priority.Jan 28 2015, 5:54 PM

Dzahn subscribed.

Change 188227 had a related patch set uploaded (by Dzahn):
add rbf2001/2002 to site.pp

https://gerrit.wikimedia.org/r/188227

Patch-For-Review

@Joe was the plan to install these on Debian already? or still Ubuntu?

@Joe how about master-slave replication of redis servers? i see the "# slaveof <masterip> <masterport>" construct in the config template. Is the goal to just replicate within a datacenter? so this should be an exact copy of eqiad but we never want to replicate cross datacenters?

Dzahn mentioned this in rOPUPf455a70782c8: add rbf2001/2002 to site.pp.Feb 3 2015, 9:34 PM

At the moment we don't plan to replicate between datacenters. Maybe just the sessions data, in case, but multi-dc replication with redis is not an easy task for sure.

RobH closed subtask T86897: Procure and setup rbf2001-2002 as Resolved.Feb 4 2015, 11:51 PM

Joe closed subtask T86898: Check that the redis roles can be applied in codfw, set up puppet. as Resolved.Feb 5 2015, 4:32 PM

We are going with jessie.

< _joe_> so yes, let's go with jessie
< _joe_> we sould also look at changes in redis between the version we have and the one on jessie

Dzahn mentioned this in rOPUP410c300c0676: use jessie for redis hosts in codfw.Feb 6 2015, 1:47 AM

Dzahn reopened subtask T86897: Procure and setup rbf2001-2002 as Open.Feb 6 2015, 1:52 AM

RobH changed the status of subtask T86896: Procure rdb2001-2004 - onsite pending racking from Open to Stalled.Feb 13 2015, 7:53 PM

ArielGlenn removed a project: Patch-For-Review.Feb 23 2015, 12:41 PM

RobH closed subtask T86896: Procure rdb2001-2004 - onsite pending racking as Resolved.Mar 10 2015, 7:57 PM

Change 196104 had a related patch set uploaded (by Dzahn):
fix rdb codfw hostnames in netboot.cfg

https://gerrit.wikimedia.org/r/196104

Change 196104 merged by Dzahn:
fix rdb codfw hostnames in netboot.cfg