Change Details

The #AICaptcha project involves various changes to the registration page (initially a popup, as shown in T183991#3904344, also a size increase of ~50K gzipped due to OOUI being pulled in; later the captcha mechanism itself might be changed). We want to make sure that does not have a significant negative effect to new user registrations. Things to watch: * registration numbers: [[https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?orgId=1&var-schema=ServerSideAccountCreation&from=now-2d&to=now|ServerSideAccountCreation stats]] -*- [[https://grafana.wikimedia.org/dashboard/db/authentication-metrics?panelId=9&fullscreen&orgId=1&var-entrypoint=web&from=now-2d&to=now|authevent stats]] -*- [[https://graphite.wikimedia.org/render/?width=800&height=400&_salt=1517510244.692&from=now-2d&until=now&target=alias(MediaWiki.authmanager.accountcreation.web.success.count%2C%22successful%20registrations%20(web)%22)&target=alias(movingAverage(MediaWiki.authmanager.accountcreation.web.success.count%2C100)%2C%22moving%20average%22)&target=alias(movingAverage(timeShift(MediaWiki.authmanager.accountcreation.web.success.count%2C%221d%22)%2C100)%2C%22moving%20average%2C%20shifted%20one%20day%22)|successul web registrations with moving averages via authevent]] * captcha success rate: [[https://grafana.wikimedia.org/dashboard/db/authentication-metrics?panelId=7&fullscreen&orgId=1&var-entrypoint=web&from=now-2d&to=now|total numbers]] -*- [[https://grafana.wikimedia.org/dashboard/db/authentication-metrics?panelId=14&fullscreen&orgId=1&var-entrypoint=web&from=now-2d&to=now|error rates]] * performance - seems like there isn't really any way to measure this directly? * spambot stats - TBD For T186244, we don't want registration numbers to be significantly negatively impacted (people getting scared of the warning? some kind of JS error in the collection? some small effect due to the extra page size is probably unavoidable), and it would be nice to get more information about the performance impact (will be useful for T85853). Later, we might experiment with modified captcha behavior, and want to track captcha and spambot stats.

The #AICaptcha project involves various changes to the registration page (initially a popup, as shown in T183991#3904344, also a size increase of ~50K gzipped due to OOUI being pulled in; later the captcha mechanism itself might be changed). We want to make sure that does not have a significant negative effect to new user registrations. Things to watch: * registration numbers: [[https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?orgId=1&var-schema=ServerSideAccountCreation&from=now-2d&to=now|ServerSideAccountCreation stats]] -*- [[https://grafana.wikimedia.org/dashboard/db/authentication-metrics?panelId=9&fullscreen&orgId=1&var-entrypoint=web&from=now-2d&to=now|authevent stats]] -*- [[https://graphite.wikimedia.org/render/?width=800&height=400&_salt=1517510244.692&from=now-2d&until=now&target=alias(MediaWiki.authmanager.accountcreation.web.success.count%2C%22successful%20registrations%20(web)%22)&target=alias(movingAverage(MediaWiki.authmanager.accountcreation.web.success.count%2C100)%2C%22moving%20average%22)&target=alias(movingAverage(timeShift(MediaWiki.authmanager.accountcreation.web.success.count%2C%221d%22)%2C100)%2C%22moving%20average%2C%20shifted%20one%20day%22)|successul web registrations with moving averages via authevent]] * captcha success rate: [[https://grafana.wikimedia.org/dashboard/db/authentication-metrics?panelId=7&fullscreen&orgId=1&var-entrypoint=web&from=now-2d&to=now|total numbers]] -*- [[https://grafana.wikimedia.org/dashboard/db/authentication-metrics?panelId=14&fullscreen&orgId=1&var-entrypoint=web&from=now-2d&to=now|error rates]] * performance - seems like there isn't really any way to measure this directly? (cf T186253) * spambot stats - TBD For T186244, we don't want registration numbers to be significantly negatively impacted (people getting scared of the warning? some kind of JS error in the collection? some small effect due to the extra page size is probably unavoidable), and it would be nice to get more information about the performance impact (will be useful for T85853). Later, we might experiment with modified captcha behavior, and want to track captcha and spambot stats.