Page MenuHomePhabricator

Introduce sign up rate metrics
Closed, ResolvedPublic3 Estimated Story Points

Description

When we remove the prerequisite of the invite code, there's a risk we might get spammed with new accounts or have a large amount of signups, that our service cannot yet handle. We need to prepare for these. Note: This concerns account creation, not Wikibase creation, there already exists a limit of 6 for that. Current sign up rate is max. 4ish new Wikibases created per week. No metrics on accounts.

Based on the outcome of https://phabricator.wikimedia.org/T335960, we want to introduce alerting on our sign up rate, so that we know when we might run into a potential issue and act.

AC:

Event Timeline

Evelien_WMDE set the point value for this task to 3.May 4 2023, 2:08 PM

Did we discuss the relative risk / reward trade off of having no limit? To me it seems that merely alerting after this limit is reached leaves a long time for bad things to happen if the alerts fires at an inconvenient time like the start of a long weekend.

Fring removed Fring as the assignee of this task.Jun 28 2023, 1:08 PM
Fring moved this task from Doing to In Review on the Wikibase Cloud (Kanban board Q2 2023) board.
Fring subscribed.

I'm still fighting unexpected statefulness in the test suite for this, so I will leave this in To Do and will revisit next Monday.

Fring removed Fring as the assignee of this task.Jul 3 2023, 12:43 PM
Fring moved this task from Doing to In Review on the Wikibase Cloud (Kanban board Q3 2023) board.
Deniz_WMDE subscribed.

Reviewed and approved these PRs.

As discussed in the daily today, we probably should either change the ACs of this ticket or break it further down

Fring renamed this task from Introduce sign up rate alerting to Introduce sign up rate metrics.Jul 5 2023, 8:11 AM
Fring updated the task description. (Show Details)

I updated the ACs. Alerts themselves should be a subtask of https://phabricator.wikimedia.org/T335963

Tarrow claimed this task.