Background
While investigating T427092: Run and synthetic A/A test that captures UA to investigate hoisting errors, I discovered that Bingbot accounts for a significant proportion of subject ID hoisting errors:
+-------+-----+------+-----------+-------------+ | month | day | n | n_bingbot | pct_bingbot | +-------+-----+------+-----------+-------------+ | 5 | 27 | 28 | 12 | 42.86 | | 5 | 28 | 1089 | 513 | 47.11 | | 5 | 29 | 2906 | 2155 | 74.16 | | 5 | 30 | 1819 | 890 | 48.93 | | 5 | 31 | 1664 | 721 | 43.33 | | 6 | 1 | 3489 | 2679 | 76.78 | | 6 | 2 | 3012 | 2145 | 71.22 | | 6 | 3 | 2086 | 1506 | 72.2 | +-------+-----+------+-----------+-------------+
I presented the results to Experiment Platform and we agreed that we would like to be able to configure EventGate to quietly reject events from certain UAs.
AC
- Add a UA denylist which causes EventGate to quietly reject events from certain UAs
Questions
- Should the UA denylist be configurable per-stream or global? If it was configurable per-stream, then we could use the $wgEventStreamsDefaultSettings to make a global one with per-stream overrides (maybe?)