HomePhabricator

Update bot filtering for webrequests.

Description

Update bot filtering for webrequests.

Rename is_crawler to isSpider to more coherent with data tagging.
Update spiders matching function with better regexp and WikimediaBot removal.
Add a function matching WikimediaBot and associated UDF.
Update and add tests.

Bug: T108598
Change-Id: I3b468050b613c1e97d87b782cbfd90c9fdc433b8

Details

Provenance
JAllemandouAuthored on
OttomataCommitted on Sep 11 2015, 4:37 PM
Parents
rANRS346bd5dd7633: Revert "[WIP] Make pageview definition aware of preview parameter"
Branches
Unknown
Tags
Unknown
ChangeId
I3b468050b613c1e97d87b782cbfd90c9fdc433b8