Background
We would like to measure skin status of new comers after the Vector 2022 skin deployment on enwiki.
Goal
To measure number of new comers who created account after deployment using each available skin on English Wikipedia
jwang | |
Feb 1 2023, 10:06 PM |
F36687673: image.png | |
Feb 2 2023, 8:08 PM |
F36683603: image.png | |
Feb 2 2023, 5:11 PM |
We would like to measure skin status of new comers after the Vector 2022 skin deployment on enwiki.
To measure number of new comers who created account after deployment using each available skin on English Wikipedia
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | jwang | T327440 Post-deployment Vector 2022 metrics analysis on English Wikipedia | |||
Resolved | jwang | T328609 Analyze number of newcomers who created account after deployment using each available skin on English Wikipedia |
The Vector-2022 was deployed on English Wikipedia at 15:30 on 2023-01-18 (UTC). Below analysis focused on the new users who have created accounts on English Wikipedia after the deployment.
There was a spike of newcomers after the deployment. It has fallen close to the pre-deployment level 10 days after deployment.
Below table summarizes the skin status on 2023-02-01 in percentage of the users who created accounts on English Wikipedia after the deployment. The new accounts data is pulled from schema event.ServerSideAccountCreation, only including self-made creations and excluding creations via api and bot user agent.
Skin Name | Number of new comers | Percentage of newcomers |
---|---|---|
vector-2022 | 50426 | 78.24% |
vector | 13081 | 20.30% |
monobook | 519 | 0.81% |
timeless | 321 | 0.50% |
minerva | 99 | 0.15% |
cologneblue | 1 | 0.00% |
modern | 1 | 0.00% |
Below table summarizes the number of newcomers using each skin on 2023-02-02 by users registration cohort
Registration cohort | cologneblue | minerva | modern | monobook | timeless | vector | vector2022 | total_newcomers |
---|---|---|---|---|---|---|---|---|
2023-01-19 | 1 | 13 | 1 | 102 | 51 | 2248 | 4719 | 7135 |
2023-01-20 | 0 | 11 | 0 | 99 | 30 | 2645 | 4168 | 6953 |
2023-01-21 | 0 | 8 | 0 | 59 | 38 | 1757 | 3397 | 5259 |
2023-01-22 | 0 | 7 | 0 | 53 | 30 | 1180 | 3216 | 4486 |
2023-01-23 | 0 | 8 | 0 | 33 | 25 | 1000 | 3689 | 4755 |
2023-01-24 | 0 | 7 | 0 | 22 | 19 | 740 | 3725 | 4513 |
2023-01-25 | 0 | 3 | 0 | 18 | 17 | 576 | 3656 | 4270 |
2023-01-26 | 0 | 6 | 0 | 23 | 15 | 453 | 3490 | 3987 |
2023-01-27 | 0 | 5 | 0 | 11 | 10 | 382 | 3213 | 3621 |
2023-01-28 | 0 | 7 | 0 | 16 | 11 | 309 | 2804 | 3147 |
2023-01-29 | 0 | 5 | 0 | 13 | 11 | 291 | 2930 | 3250 |
2023-01-30 | 0 | 3 | 0 | 15 | 20 | 265 | 3508 | 3811 |
2023-01-31 | 0 | 7 | 0 | 7 | 11 | 221 | 3510 | 3756 |
2023-02-01 | 0 | 5 | 0 | 9 | 11 | 203 | 3234 | 3462 |
Below table summarizes the skin percentage on 2023-02-02 by user's registration cohort
Registration cohort | cologneblue | minerva | modern | monobook | timeless | vector | vector2022 | total_newcomers |
---|---|---|---|---|---|---|---|---|
2023-01-19 | 0.01% | 0.18% | 0.01% | 1.43% | 0.71% | 31.51% | 66.14% | 100.00% |
2023-01-20 | 0.00% | 0.16% | 0.00% | 1.42% | 0.43% | 38.04% | 59.95% | 100.00% |
2023-01-21 | 0.00% | 0.15% | 0.00% | 1.12% | 0.72% | 33.41% | 64.59% | 100.00% |
2023-01-22 | 0.00% | 0.16% | 0.00% | 1.18% | 0.67% | 26.30% | 71.69% | 100.00% |
2023-01-23 | 0.00% | 0.17% | 0.00% | 0.69% | 0.53% | 21.03% | 77.58% | 100.00% |
2023-01-24 | 0.00% | 0.16% | 0.00% | 0.49% | 0.42% | 16.40% | 82.54% | 100.00% |
2023-01-25 | 0.00% | 0.07% | 0.00% | 0.42% | 0.40% | 13.49% | 85.62% | 100.00% |
2023-01-26 | 0.00% | 0.15% | 0.00% | 0.58% | 0.38% | 11.36% | 87.53% | 100.00% |
2023-01-27 | 0.00% | 0.14% | 0.00% | 0.30% | 0.28% | 10.55% | 88.73% | 100.00% |
2023-01-28 | 0.00% | 0.22% | 0.00% | 0.51% | 0.35% | 9.82% | 89.10% | 100.00% |
2023-01-29 | 0.00% | 0.15% | 0.00% | 0.40% | 0.34% | 8.95% | 90.15% | 100.00% |
2023-01-30 | 0.00% | 0.08% | 0.00% | 0.39% | 0.52% | 6.95% | 92.05% | 100.00% |
2023-01-31 | 0.00% | 0.19% | 0.00% | 0.19% | 0.29% | 5.88% | 93.45% | 100.00% |
2023-02-01 | 0.00% | 0.14% | 0.00% | 0.26% | 0.32% | 5.86% | 93.41% | 100.00% |
Graph of percentage of newcomers using each skin by registration cohort on English Wikipedia
Metrics we measured:
Account creation events between 2023-01-15 and 2023-02-07 are pulled from event.ServerSideAccountCreation schema, only include self-made creation, exclude auto creation and creations by bot users and API.
Skin preference updates between 2023-01-15 and 2023-02-07 are pulled from event.prefupdate schema. Analysis reviewed the last skin user selected in 24 hours of registration, and after 7 days of registration.
registration cohort date | cologneblue | minerva | modern | monobook | timeless | vector-2022 | vector | Number of users who updated skin preference in 24 hours of registration | Number of newcomers | opt rate in 24 hours of registration |
---|---|---|---|---|---|---|---|---|---|---|
2023-01-18 | 0 | 6 | 0 | 44 | 27 | 60 | 710 | 847 | 2818 | 30.06% |
2023-01-19 | 1 | 13 | 1 | 100 | 49 | 134 | 2215 | 2513 | 7135 | 35.22% |
2023-01-20 | 0 | 11 | 0 | 91 | 34 | 114 | 2622 | 2872 | 6953 | 41.31% |
2023-01-21 | 0 | 9 | 0 | 57 | 39 | 67 | 1729 | 1901 | 5259 | 36.15% |
2023-01-22 | 0 | 6 | 0 | 54 | 34 | 46 | 1156 | 1296 | 4486 | 28.89% |
2023-01-23 | 0 | 8 | 0 | 32 | 26 | 43 | 992 | 1101 | 4755 | 23.15% |
2023-01-24 | 0 | 7 | 0 | 23 | 18 | 37 | 742 | 827 | 4513 | 18.32% |
2023-01-25 | 0 | 3 | 0 | 18 | 18 | 33 | 566 | 638 | 4270 | 14.94% |
2023-01-26 | 0 | 6 | 0 | 22 | 15 | 31 | 448 | 522 | 3987 | 13.09% |
2023-01-27 | 0 | 6 | 0 | 11 | 10 | 14 | 378 | 419 | 3621 | 11.57% |
2023-01-28 | 0 | 8 | 0 | 16 | 10 | 14 | 309 | 357 | 3147 | 11.34% |
2023-01-29 | 0 | 6 | 0 | 12 | 11 | 18 | 290 | 337 | 3250 | 10.37% |
2023-01-30 | 0 | 3 | 0 | 15 | 18 | 10 | 260 | 306 | 3811 | 8.03% |
2023-01-31 | 0 | 7 | 0 | 7 | 9 | 20 | 219 | 262 | 3756 | 6.98% |
2023-02-01 | 0 | 5 | 0 | 8 | 11 | 15 | 204 | 243 | 3462 | 7.02% |
2023-02-02 | 0 | 2 | 0 | 14 | 9 | 14 | 192 | 231 | 3436 | 6.72% |
2023-02-03 | 0 | 4 | 0 | 11 | 11 | 18 | 155 | 199 | 3263 | 6.10% |
2023-02-04 | 0 | 3 | 0 | 7 | 12 | 16 | 162 | 200 | 2972 | 6.73% |
2023-02-05 | 0 | 1 | 0 | 11 | 7 | 24 | 145 | 188 | 2892 | 6.50% |
2023-02-06 | 0 | 4 | 0 | 13 | 7 | 23 | 145 | 192 | 3560 | 5.39% |
2023-02-07 | 0 | 5 | 0 | 9 | 7 | 15 | 150 | 186 | 3761 | 4.95% |
Only 0.25% of newcomers changed skin preference 7 days after registration.
registration cohort date | cologneblue | minerva | modern | monobook | timeless | vector-2022 | vector | Number of users who updated skin preference after 7 days of registration | Number of newcomers | opt rate after 7 days of registration |
---|---|---|---|---|---|---|---|---|---|---|
2023-01-18 | 0 | 2 | 0 | 0 | 3 | 4 | 9 | 18 | 2818 | 0.64% |
2023-01-19 | 1 | 0 | 0 | 5 | 5 | 10 | 23 | 44 | 7135 | 0.62% |
2023-01-20 | 0 | 0 | 1 | 2 | 1 | 6 | 17 | 27 | 6953 | 0.39% |
2023-01-21 | 0 | 0 | 0 | 3 | 2 | 4 | 15 | 24 | 5259 | 0.46% |
2023-01-22 | 0 | 0 | 0 | 2 | 0 | 0 | 12 | 14 | 4486 | 0.31% |
2023-01-23 | 0 | 0 | 0 | 0 | 0 | 5 | 7 | 12 | 4755 | 0.25% |
2023-01-24 | 0 | 1 | 0 | 0 | 3 | 3 | 7 | 14 | 4513 | 0.31% |
2023-01-25 | 0 | 0 | 0 | 1 | 0 | 2 | 3 | 6 | 4270 | 0.14% |
2023-01-26 | 0 | 0 | 0 | 0 | 0 | 1 | 2 | 3 | 3987 | 0.08% |
2023-01-27 | 0 | 1 | 0 | 0 | 0 | 1 | 3 | 5 | 3621 | 0.14% |
2023-01-28 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 3147 | 0.03% |
2023-01-29 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 3250 | 0.03% |
2023-01-30 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 2 | 3811 | 0.05% |
2023-01-31 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 3756 | 0.03% |