Document wiki-replicas architecture for future automation
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	aborrero
	Nov 14 2017, 6:48 PM

Description

We would like to implement automation (i.e. puppet) in the future for wiki-replicas, which is managed using several scripts and manual actions:

manual user grants
maintain-views
maintain-meta_p
wikireplica_dns

To better understand the project, we need to collect and document all the knowledge we have regarding wiki-replicas, how they are deployed, common problems (and how to solve them) and how they are effectively manager (including workflow). This includes searching for related task/bugs/issues related to maintain-views and friends.

We would like to improve the workflow shown in T173647.

Proposed destination wikitech pages:

End user docs: https://wikitech.wikimedia.org/wiki/Wiki_Replicas
Our admin docs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas

Related docs:

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Declined		None	T177880 Automatically run maintain-views and and maintain-meta_p when config changes on cloud replicas
		Resolved		• Bstorm	T180513 Document wiki-replicas architecture for future automation

Event Timeline

aborrero created this task.Nov 14 2017, 6:48 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 14 2017, 6:48 PM

https://wikitech.wikimedia.org/wiki/Wiki_Replicas would be potentially pointed to from https://wikitech.wikimedia.org/wiki/Portal:Data_Services#Wiki_Replicas as user documentation. One of the issues we have had over time w/ wikitech is the intermingling of purely administrative (us) docs and end consumer docs. I would shy away from putting management of underlying features on that main page and put the admin/orchestration docs on a page under https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin

bd808 edited projects, added cloud-services-team (Kanban); removed cloud-services-team.Nov 14 2017, 9:05 PM

bd808 moved this task from Inbox to Soon! on the cloud-services-team (Kanban) board.

aborrero updated the task description. (Show Details)Nov 15 2017, 1:00 PM

aborrero updated the task description. (Show Details)Nov 15 2017, 1:06 PM

Pending to meet with DBAs, for them to provide additional information and discuss improvements in our side.

bd808 triaged this task as Medium priority.Nov 29 2017, 8:52 PM

bd808 added a parent task: T177880: Automatically run maintain-views and and maintain-meta_p when config changes on cloud replicas.

bd808 added a project: Data-Services.

bd808 moved this task from Backlog to Wiki replicas on the Data-Services board.

Quiddity added a parent task: T101659: Run a documentation sprint for Cloud VPS and Toolforge.Apr 13 2018, 10:59 PM

Lately @Bstorm is working on this stuff. We could perhaps reassign the task to her :-P

It may be that this will be closed soon. The documentation we have is not bad, however, a bug in MariaDB prevents additional automation (and even easy use of the script for new wikis).

Krenair subscribed.Aug 31 2018, 11:22 PM

Quiddity added a project: Documentation.Sep 20 2018, 7:16 PM

The bug in mariadb is fixed in a future version of mariadb we don't have. I'm going to shuffle this to the graveyard for now. Overall, there isn't much interest in additional automation, yet, because the manual checks are still considered essential for now.

• Bstorm moved this task from Soon! to Graveyard on the cloud-services-team (Kanban) board.Jun 24 2019, 3:54 PM

I think this is largely done. I think to be done it needs better documentation about maintain-dbusers.