To facilitate investigations of automated traffic that pose a risk to WMF infrastructure, we aim to to build a system that enables searching and clustering of similar traffic patterns.
- time series dataset: a pipeline that transforms the raw webrequest logs into a time series dataset that streamlines analysis, reduces computational cost, and provides consistent cost metrics. That datasets provides value for related projects (bot detection/pageview metric quality, combat scraping, content reuse, user segmentation)
- similarity-search service that identifies actors with matching traffic patterns, using compact frequency-domain embeddings generated from the time series dataset, to support investigations of automated behavior that causes issues for WMF infrastructure