This is the top-level ticket tracking the development of a new set of heuristics and tables for bot detection in the Data Platform, codenamed KAPOW (Knowledge on Automata Platformized and Operationalized as a Warehouse).

We want to modernize the bot detection system in the Data Platform such that it:

• Incorporates additional signals developed in SDS1.3 and SDS1.5.
• Enables bot detection for use cases beyond the pageviews metric, notably:
  • Traffic management by SRE at the edge.
  • Analysis of API traffic for responsible reuse.
  • Product experimentation via Test Kitchen.
• Simplifies data incident response and analysis in the Data Platform.

I'll add child tickets to track the main milestones of this work.