Define a specific set of metrics (3-5 total) that we're tracking., publicize what those metrics are, and start reporting on them with a regular cadence.
This is one of the goals for Q3. From our team offsite we added:
Save timing, SpeedIndex, firstVisualChange, ttfb, loadEventEnd?
Metrics to consider:
| Metric | Source (sampling) | Filter | Aggregation | Definition
|--|--|--|--|--
| Frontend Save Timing | RUM (sampled via navtiming) | None? | median? p75? | Time to first byte of navigation that started with submitting the edit (form)
| Backend Save Timing | RUM (unsampled, WikimediaEvents PHP) | only humans/index.php? | median? p99? | Total process time within PHP
| SpeedIndex | Synthetic (WebPageTest) | | |
| firstVisualChange | Synthetic (WebPageTest) | | |
| TTFB | RUM (sampled via navtiming) | | |
| loadEventEnd | RUM (sampled via navtiming) | | |
| .. | .. | | |
I think it would be good if we discuss them here.