Page MenuHomePhabricator

[MirrorTools] Write a script to import the data from user creation events in "Log events to all pages and users" (enwiki-yyyymmdd-pages-logging.xml.gz) dump into the local user table and local logging table
Closed, ResolvedPublic

Description

Write a script to import the data from user creation events in "Log events to all pages and users" (enwiki-yyyymmdd-pages-logging.xml.gz) dump into the local user table and local logging table. The user_id from enwiki and other data should be preserved. Perhaps practice on, e.g., https://simple.wikipedia.org/ (simplewiki) rather than enwiki since it's a smaller wiki.

The first priority is to mirror user data from user creation events (log_type = newusers) in the local user table; the second priority is to mirror user data from user renaming events (log_type = renameuser) in the local user table; the third priority is to mirror data from these log events in the local logging table. The lack of user table functionality is a potential blocker for bug 59618; the logging table does not appear to be a blocker for anything.

Useful links:
*[[mw:API:Database field and API property associations]]
*[[mw:Manual:User table]]
*[[mw:Manual:Logging table]]


Version: unspecified
Severity: enhancement

Details

Reference
bz64485

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 3:25 AM
bzimport set Reference to bz64485.

See also [[mw:Manual:Parsing XML files]].

(In reply to Nathan Larson from comment #0)

Write a script to import the data from user creation events in "Log events
to all pages and users" (enwiki-yyyymmdd-pages-logging.xml.gz) dump into the
local user table and local logging table.

Sounds kind of gross. Why not resolve bug 49134 instead?

(In reply to MZMcBride from comment #5)

Sounds kind of gross. Why not resolve bug 49134 instead?

That would be preferable. Can it/will it be resolved?

Fixed. The current implementation doesn't actually populate the user table, since that was deemed to perhaps cause problematic conflicts in some situations. That decision might be revisited later ([[mw:Extension:MirrorTools/User table]]); we'll see.