Note that I added counts for namespace and tag filter usage and limited the reporting period to 30 days to keep performance happy.

In T397779#10992881, @jsn.sherman wrote:

Noting that the currently the script includes the total pageview count for each hostname, with the idea that we can consolidate wikis with low counts; the question is: do we want to do this in the script or just as a post processing step with the csv data in google sheets?

IMO, we should handle as much of this as possible in the script now that the requirements are better nailed down; dumping out the raw counts could still be useful for now while we iterate on this and get feedback.

Regarding those requirements, I had a followup conversation with @JWheeler-WMF about updating the script to answer the following questions:

on a per wiki basis, "what % of queries are default, AKA do not add any custom filters? (without knowing or caring which filters are in the default)

to answer, we'll need to map out the default filters for each wiki to make sure we understand what the "baseline" combination is for web requests; then we'd keep counters for default and non-default requests. I started out attempting to do this, but it's going to take careful work to avoid mistakes and was premature when it wasn't clear exactly what questions we were trying to answer. We don't need to output the counts of individual filters to answer this question.

on a per wiki basis, how many queries have run with this [custom] filter active?

So this one takes a little bit of untangling. When we encounter a "non-default" query as defined in the previous question, we can increment a counter for it similar to the way we do now. We would output counts for "non-default" filter parameter usage only for each wiki, and not output counts for the "default" filter parameters. A question I have is how we want to represent the removal of a default filter; eg. on enwiki hidebots=1 is there by default. If you clear "Human (not bot)" in the interface, then the parameter is not present. Perhaps we have additional counters/columns for things like "hidebots=1 removed"? That's only if we care about people messing with the default filters. We could potentially save some work by not caring. Do we care @JWheeler-WMF @Samwalton9-WMF @OTichonova?