Page MenuHomePhabricator

improve sync process to wikitech-static
Open, MediumPublic0 Estimated Story Points

Description

There are several things we can improve/clean up.

  • set up log rotation
  • don't reimport images that are already present (Modification to MW scripts needed)
  • don't export all revisions/pages but only those from the past few days. (Modification to MW scripts needed, standalone script for handling deletions/moves needed, see T128548)
  • find out why the log is flooded with 'XMLReader::open(): Unable to open source data" for image imports: T206013
  • don't rebuildImages ever, just let importDump take care of it

There are likely other things too but this will do. I'm looking into the 'Unable to open source data' error message. The rest are up for grabs for now.

Event Timeline

Bryan says " if you end up bored ... it looks like wikitech-static has some drift from wikitech again. https://wikitech-static.wikimedia.org/wiki/Reporting_a_connectivity_issue is many revisions behind https://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue"

Bryan says " if you end up bored ... it looks like wikitech-static has some drift from wikitech again. https://wikitech-static.wikimedia.org/wiki/Reporting_a_connectivity_issue is many revisions behind https://wikitech.wikimedia.org/wiki/Reporting_a_connectivity_issue"

I think I was actually fooled about that because of differences in skins and custom css. When I checked back on this today the revisions for that page were up to date.

JHedden lowered the priority of this task from High to Medium.May 5 2020, 4:28 PM