Page MenuHomePhabricator
Create Task
Maniphest T433814

New DB request: etherpad
Closed, ResolvedPublic
Actions

Description

QPS: similar to the existing etherpad-lite database
Size: Small, data will expire after 90 days
DB Name: etherpad
User: etherpad
Accessed from server (s): TBD
Backup Policy: daily backups if possible, data will expire after 90 days, can we account for that?
Grants needed:

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
dbbackups: Add backups for new m1 database: etherpadJcrespooperations/puppetproduction+8 -0
production-m1.sql.erb: Add codfw etherpad new grantsMarosteguioperations/puppetproduction+8 -1
production-m1.sql.erb: Fix usernameMarosteguioperations/puppetproduction+1 -1
production-m1.sql.erb: Add new grants for etherpadMarosteguioperations/puppetproduction+18 -2
Customize query in gerrit

Related Objects

Event Timeline

LSobanski created this task.Mon, Aug 3, 7:30 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMon, Aug 3, 7:30 AM
Bugreporter mentioned this in T415237: etherpad table size is 233GB / plan to delete all etherpads.Mon, Aug 3, 7:33 AM
Marostegui added subscribers: jcrespo, Marostegui.Mon, Aug 3, 7:36 AM

@jcrespo CC for the backup part.

Marostegui triaged this task as Medium priority.Mon, Aug 3, 7:36 AM
Marostegui moved this task from Triage to In progress on the DBA board.

@LSobanski what is the plan with the old etherpad DB?

gerritbot added a comment.Mon, Aug 3, 7:42 AM

Change #1319969 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m1.sql.erb: Add new grants for etherpad

https://gerrit.wikimedia.org/r/1319969

gerritbot added a project: Patch-For-Review.Mon, Aug 3, 7:42 AM
ZauberViolino subscribed.Mon, Aug 3, 7:43 AM
gerritbot added a comment.Mon, Aug 3, 7:53 AM

Change #1319969 merged by Marostegui:

[operations/puppet@production] production-m1.sql.erb: Add new grants for etherpad

https://gerrit.wikimedia.org/r/1319969

gerritbot added a comment.Mon, Aug 3, 7:58 AM

Change #1319972 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m1.sql.erb: Fix username

https://gerrit.wikimedia.org/r/1319972

Marostegui added a comment.Mon, Aug 3, 8:06 AM

@LSobanski I assume the grants are exactly the same as the current etherpadlite ones.
And the servers that will access them must go through the proxies anyway.

gerritbot added a comment.Mon, Aug 3, 8:08 AM

Change #1319974 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m1.sql.erb: Add codfw etherpad new grants

https://gerrit.wikimedia.org/r/1319974

gerritbot added a comment.Mon, Aug 3, 8:15 AM

Change #1319972 merged by Marostegui:

[operations/puppet@production] production-m1.sql.erb: Fix username

https://gerrit.wikimedia.org/r/1319972

gerritbot added a comment.Mon, Aug 3, 8:15 AM

Change #1319974 merged by Marostegui:

[operations/puppet@production] production-m1.sql.erb: Add codfw etherpad new grants

https://gerrit.wikimedia.org/r/1319974

Maintenance_bot removed a project: Patch-For-Review.Mon, Aug 3, 8:30 AM
jcrespo added a comment.Mon, Aug 3, 9:18 AM

DBAs: I see from the patches that the new db will be just called "etherpad", correct?

@LSobanski:

daily backups if possible, data will expire after 90 days, can we account for that?

That's our most standard policy (daily incrementals, fortnite differentials, monthly fulls). Do you mean that data will be fully deleted every 90 days? It shouldn't affect backup policy a lot, although it would help if they are aligned with natural months (e.g. deletions happen on the first of each month), as full backups happen on the first week of the month.

gerritbot added a comment.Mon, Aug 3, 9:22 AM

Change #1320105 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Add backups for new m1 database: etherpad

https://gerrit.wikimedia.org/r/1320105

gerritbot added a project: Patch-For-Review.Mon, Aug 3, 9:22 AM
Marostegui added a comment.Mon, Aug 3, 9:25 AM
In T433814#12177975, @jcrespo wrote:

DBAs: I see from the patches that the new db will be just called "etherpad", correct?

Yes, as requested on the original task description.

jcrespo added a comment.Mon, Aug 3, 9:26 AM
In T433814#12178001, @Marostegui wrote:
In T433814#12177975, @jcrespo wrote:

DBAs: I see from the patches that the new db will be just called "etherpad", correct?

Yes, as requested on the original task description.

Silly me, I didn't notice that.

Marostegui closed this task as Resolved.Mon, Aug 3, 9:48 AM
Marostegui claimed this task.

@LSobanski the DB has been created (empty, if you'd need me to create the single table, just let me know).
user: etherpad
password: same as the previous user.

Access has been deployed with the the same (via the proxies) grants.
Please reopen should you need something else.
Jaime is working on the backups side already too.

gerritbot added a comment.Mon, Aug 3, 9:49 AM

Change #1320105 merged by Jcrespo:

[operations/puppet@production] dbbackups: Add backups for new m1 database: etherpad

https://gerrit.wikimedia.org/r/1320105

jcrespo added a comment.Mon, Aug 3, 9:51 AM

Backup config deployed, I will check at least an empty db is backed up tonight.

Maintenance_bot moved this task from In progress to Done on the DBA board.Mon, Aug 3, 10:29 AM
Maintenance_bot removed a project: Patch-For-Review.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits