Map different types of measurement for T115119 's schema
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Sadads
	Nov 6 2015, 10:29 PM

Description

We are suggesting the following measures of events following T115119 's schema, include:

Δ links to domain (or specific subdomain) over time with a measure (avg. slope? or % growth) of change - The main use case is TWL/GLAM partnerships
Comparison of change over time, between windows of time (Month to month change via # growth and % growth) - this is particularly important for the business case for TWL in new partnerships -something in the nature of Magnus's Baglama 2 https://tools.wmflabs.org/glamtools/baglama2/
Comparison of Δ unique domains/subdomains -- The main use case would be to discover new links/sources being used on Wikipedia.
Attribution of who is adding links, in particular time window - concatenate links by - The main use cases: identify spammers/COI issues, identify GLAM/TWL participants for encouragement support, identify potential recipients of TWL sources, or someone to engage in outreach. Also a good way to identify people to encourage linking best practices (if we could do high frequency adders of ".org" or journal namespaces).
Identification of "most frequently added/changed" urls overall and within a domain - looks for urls that are controversial, or are under a lot of scrutiny. Use cases: It would also be interesting to see this at a global level, and use for vandalism tools/ratings. It might be worth giving urls a "controversy factor", or researching these behaviours for AI.

Related Objects
Search...

Status	Assigned	Task
Resolved	Samwalton9-WMF	T102064 Create a tool to display and filter data from Schema:ExternalLinksChange
Resolved	Samwalton9-WMF	T118042 Map different types of measurement for T115119 's schema
Resolved	Samwalton9-WMF	T102855 Figure out relative impact of links on pages with page views

Event Timeline

Sadads created this task.Nov 6 2015, 10:29 PM

Sadads raised the priority of this task from to Medium.

Sadads updated the task description. (Show Details)

Sadads added projects: Possible-Tech-Projects, Research, The-Wikipedia-Library.

Sadads added a subtask: T115119: Create a feed or log of changed links on Wikimedia projects.

Sadads added subscribers: Milimetric, Shrutika719, Daniel_Mietchen and 9 others.

For anti-spam we also need the following to be at feature parity with COIBot:

A special page that gives the list of editors who have added a particular domain on demand with the number of links each editor has added to that domain. Must be able to fetch diffs in a separate query.
A special page that gives the list of domains that a particular user has edited on demand with the number of links added by that editor to each domain. Must be able to fetch diffs in a separate query.
Cross-wiki statistics (difficult, we might be able to work around this).

We don't mind if we don't get an answer if there are more than 1000 records for a particular domain or editor.

Contact Beetstra if you want to know about our existing link addition database.

Sadads added a subtask: T102855: Figure out relative impact of links on pages with page views.Nov 12 2015, 8:55 PM

• DarTar moved this task from Backlog to Radar on the Research board.Nov 12 2015, 11:17 PM

Beetstra subscribed.Dec 14 2015, 9:01 AM

It would be great if this could be a real-time IRC feed as well - as then http://en.wikipedia.org/wiki/User:XLinkBot can hook live into the feed and revert when conditions are met.

@Beetstra: we'd have to be pretty sure we're properly sanitizing this feed then, because it falls in that uncomfortable position of exposing vandal text and other types of stuff that we normally delete from our history but serve in our real-time streams.

• ggellerman edited projects, added Research-Freezer; removed Research.Mar 17 2016, 10:26 PM

• ggellerman moved this task from Backlog to Radar on the Research-Freezer board.Mar 17 2016, 10:28 PM