Page MenuHomePhabricator
Create Task
Maniphest T246539

Dry-run, then actually run updateVarDumps
Closed, ResolvedPublic
Actions

Assigned To
Urbanecm
Authored By
Daimona
Feb 29 2020, 4:52 PM
Tags
Referenced Files
F32399013: group2-small.tar.gz
Oct 19 2020, 1:39 PM
Subscribers
Aklapper
Daimona
daniel
DannyS712
• eprodromou
Huji
Jdforrester-WMF
View All 11 Subscribers
Tokens
"Love" token, awarded by Daimona."Barnstar" token, awarded by Jdforrester-WMF.

Description

What: Dry-run, audit results, then run for real the updateVarDumps.php script for AbuseFilter
When: Whenever this patch reaches production.
Why: To kill many layers of back-compat and a lot of tech debt (see parent task).
Where: All wikis - beta cluster first, then production.
Who: Whoever wants to do that. (@Daimona can do the Beta Cluster part).

How:

  1. First of all, run updateVarDumps.php --dry-run and post the results.
  2. @Daimona will audit the results
  3. If necessary, we may have to re-run the script with --dry-run-verbose for selected wikis, then repeat (2.)
  4. Find a DateTime suitable for both of us
  5. Time to run it for real. The ideal steps are:
    1. Measure the size of the abuse_filter_log table (on enwiki?); measure the size of the ExternalStore (I don't know whether it's feasible)
    2. Run the script!
    3. Measure the sizes again and check how much space was saved.
  6. Done!

Command to run

mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --print-orphaned-records --progress-markers [ --dry-run ] > foobar.log

Note: Make sure to redirect the output to a file! The script will print thousands of orphaned records, up to 22 millions for enwiki. You can tee the output for small wikis if you wish.

  • Beta Cluster
  • Closed wikis
  • Test wikis
  • Group0 wikis
  • Group1 wikis except commonswiki
  • Group2 wikis except wikis that are in large.dblist
  • Large wikis
    • svwiki
    • kowiki
    • trwiki
    • cswiki
    • jawiki
    • itwiki
    • nlwiki
    • frwiki
    • ruwiki
    • fawiki
    • zhwiki
    • arwiki
    • ptwiki
    • commonswiki
    • eswiki
    • enwiki

Details

SubjectRepoBranchLines +/-
Add BC hack for some 2009 AbuseLog entries causing a fatal errormediawiki/extensions/AbuseFiltermaster+5 -0
updateVarDumps: Add more options, aesthetic changesmediawiki/extensions/AbuseFiltermaster+37 -11
updateVarDumps: Print orphaned ES records, don't try updating ES recordsmediawiki/extensions/AbuseFiltermaster+21 -2
updateVarDumps: Use new ExternalStore method for updating recordsmediawiki/extensions/AbuseFiltermaster+6 -2
Minor fixes for the updateVarDumps scriptmediawiki/extensions/AbuseFilterwmf/1.35.0-wmf.22+41 -30
Minor fixes for the updateVarDumps scriptmediawiki/extensions/AbuseFiltermaster+41 -30
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT254646 Reconsidering how we name things
 OpenNoneT281536 Schema:EditAttemptStep uses non-inclusive language.
 OpenNoneT279275 Move all the functionality of {Spam,Title}Blacklist extensions into AbuseFilter and retire them
 ResolvedNoneT290934 Expand the set of bundled extensions and skins in MediaWiki 1.38
 ResolvedDaimonaT191740 Bundle AbuseFilter extension with MediaWiki
 ResolvedPRODUCTION ERRORDaimonaT259179 Use of Article::getContentModel was deprecated in MediaWiki 1.35. [Called from AFComputedVariable::compute]
 ResolvedPRODUCTION ERRORDaimonaT187153 Special:Abuselog throws when viewing details or examining (BadMethodCallException: Call get getId() on null)
 StalledNoneT106386 Compress data at external storage
 StalledNoneT106388 Audit all existing code to ensure that any extension currently or previously adding blobs to ExternalStore has been registering a reference in the text table (and fix up if wrong)
 ResolvedDaimonaT34478 AbuseFilter not setting utf-8 flag
 OpenNoneT216827 page_restrictions_edit empty in AbuseFilter when page protection is inherited from a cascade
 ResolvedDaimonaT261069 Decouple AbuseFilterVariableHolder and AFComputedVariable
 ResolvedDaimonaT213006 Create a script to update afl_var_dump, drop back-compat code
 ResolvedPRODUCTION ERRORDaimonaT214196 BadMethodCallException: Call to a member function dumpAllVars() on a non-object (boolean)
 ResolvedPRODUCTION ERRORDaimonaT259180 Use of Article::prepareContentForEdit was deprecated in MediaWiki 1.35. [Called from AFComputedVariable::compute]
Restricted Task
 ResolvedDaimonaT110854 Blank afl_var_dump on 9 testwiki abuse_filter_log entries from July 2012 causes exceptions
 ResolvedDaimonaT204236 Old variables are computed wrongly for old entries
 ResolvedPRODUCTION ERRORDaimonaT214193 PHP Notice: Unable to unserialize in AbuseFilter.php
 ResolvedUrbanecmT246539 Dry-run, then actually run updateVarDumps
 DeclinedDaimonaT246938 How to update/delete ExternalStore entries?
 ResolvedDaimonaT252696 Find a good way to run the updateVarDumps script on large wikis

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Daimona added a comment.Sep 7 2020, 10:30 AM
In T246539#6440295, @daniel wrote:
In T246539#6440198, @Daimona wrote:
In T246539#6440193, @daniel wrote:

Is the problem that the data actually contains serialized WikiPage objects?

More generally, the data contains serialized objects of many different types. WikiPage is the main problem, but we also have Article, Revision and whatnot, especially if we consider the class properties of these objects (e.g. T187731).

Can you past an example blob or two somewhere?

I can't, because I do not have prod access, and the Beta Cluster was cleaned up a few months ago. With shell access, you can easily retrieve blobs by following the process described in T187731, i.e.

  • Pick any AbuseLog entry from a group2 wiki older than 28/02/2013 (when rEABF42bd0d84f4244ca2304c6d161f71d90a6a53030c was merged), note its ID
  • Run the following SELECT afl_var_dump FROM abuse_filter_log WHERE afl_id = <your ID>
  • Feed the numeric value you got from that query to maintenance/fetchText.php

Very old entries (2008 or before, I think) might not work, because they didn't use the text table.

• eprodromou moved this task from Inbox to Later on the Platform Team Workboards (Clinic Duty Team) board.Sep 8 2020, 8:15 PM
• eprodromou subscribed.

OK, looks like we'll pick this up in Clinic Duty.

Daimona added a comment.Sep 17 2020, 10:03 PM

Could someone please restart this script? It's blocking a lot of work in the AbuseFilter codebase, because we cannot touch any of the affected classes (most notably AbuseFilterVariableHolder). Trying to do so would result in all old entries being lost. Also, might this be run with a lower sleep between batches so that it completes in a shorter time? Thanks!

Daimona added a parent task: T259180: Use of Article::prepareContentForEdit was deprecated in MediaWiki 1.35. [Called from AFComputedVariable::compute].Sep 30 2020, 6:44 PM
DannyS712 added a comment.Oct 16 2020, 6:01 PM
In T246539#6444318, @eprodromou wrote:

OK, looks like we'll pick this up in Clinic Duty.

In T246539#6472846, @Daimona wrote:

Could someone please restart this script? It's blocking a lot of work in the AbuseFilter codebase, because we cannot touch any of the affected classes (most notably AbuseFilterVariableHolder). Trying to do so would result in all old entries being lost. Also, might this be run with a lower sleep between batches so that it completes in a shorter time? Thanks!

{{ping}} any updates from clinic duty?

Ladsgroup subscribed.Oct 18 2020, 10:57 AM

Martin and I will run it (I'll be there mostly for emotional support though)

Urbanecm subscribed.EditedOct 18 2020, 11:57 AM

As a preparation for the running, I ran foreachwikiindblist group0 mysql.php -- -e 'select DATABASE(), count(*) from updatelog where ul_key="UpdateVarDumps"' for group0, group1 and group2, to figure out where the script was (not) run.

That leaves us with the following group0 and group1 wikis:

[urbanecm@mwmaint2001 ~/updateVarDumps]$ grep --no-filename '   0' group0-parsed.log group1-parsed.log
apiportalwiki   0
commonswiki     0
enwikisource    0
jawikivoyage    0
thankyouwiki    0
[urbanecm@mwmaint2001 ~/updateVarDumps]$

plus all the group2 wikis.

Stashbot added a comment.Oct 19 2020, 10:53 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-19T10:53:45Z] <Urbanecm> [urbanecm@mwmaint2001 ~/updateVarDumps/script]$ mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=jawikivoyage --print-orphaned-records-to=- --progress-markers # T246539

Stashbot added a comment.Oct 19 2020, 10:57 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-19T10:57:23Z] <Urbanecm> Start mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=enwikisource --print-orphaned-records-to=/tmp/urbanecm/enwikisource-orphaned.log --progress-markers in a tmux session named updateVarDumps at mwmaint2001 (T246539)

Stashbot added a comment.Oct 19 2020, 11:13 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-19T11:13:12Z] <Urbanecm> Manually run mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log for several small group2 wikis (T246539)

Stashbot added a comment.Oct 19 2020, 11:40 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-19T11:40:41Z] <Urbanecm> [urbanecm@mwmaint2001 ~/updateVarDumps/script]$ while read wiki; do echo "Processing $wiki"; mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log; done < ../small-group2.dblist # T246539 # small-group2.dblist is wikis from small.dblist that are also in group2.dblist

Stashbot added a comment.Oct 19 2020, 11:42 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-19T11:42:00Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=enwikisource --print-orphaned-records-to=/tmp/urbanecm/enwikisource-orphaned.log --progress-markers (T246539)

Stashbot added a comment.Oct 19 2020, 11:43 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-19T11:43:34Z] <Urbanecm> End of [urbanecm@mwmaint2001 ~/updateVarDumps/script]$ while read wiki; do echo "Processing $wiki"; mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log; done < ../small-group2.dblist # T246539 # small-group2.dblist is wikis from small.dblist that are also in group2.dblist

Stashbot added a comment.Oct 19 2020, 1:34 PM

Mentioned in SAL (#wikimedia-operations) [2020-10-19T13:34:31Z] <Urbanecm> Start of [urbanecm@mwmaint2001 ~/updateVarDumps/output/group2-medium]$ while read wiki; do echo "Processing $wiki"; mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > output/$wiki.log; done < wikis.dblist (T246539; wikis.dblist is medium wikis from group2.dblist)

Urbanecm added a comment.Oct 19 2020, 1:39 PM
In T246539#6559959, @Stashbot wrote:

Mentioned in SAL (#wikimedia-operations) [2020-10-19T11:43:34Z] <Urbanecm> End of [urbanecm@mwmaint2001 ~/updateVarDumps/script]$ while read wiki; do echo "Processing $wiki"; mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log; done < ../small-group2.dblist # T246539 # small-group2.dblist is wikis from small.dblist that are also in group2.dblist

Outputs are below (two files per wiki):

group2-small.tar.gz395 KBDownload

Daimona added a comment.Oct 19 2020, 2:42 PM
In T246539#6560384, @Urbanecm wrote:
In T246539#6559959, @Stashbot wrote:

Mentioned in SAL (#wikimedia-operations) [2020-10-19T11:43:34Z] <Urbanecm> End of [urbanecm@mwmaint2001 ~/updateVarDumps/script]$ while read wiki; do echo "Processing $wiki"; mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log; done < ../small-group2.dblist # T246539 # small-group2.dblist is wikis from small.dblist that are also in group2.dblist

Outputs are below (two files per wiki):

group2-small.tar.gz395 KBDownload

Checked, nothing special happened here (i.e. steps 1 and 2 didn't find any row)

Urbanecm added a comment.Oct 19 2020, 2:52 PM

Thanks @Daimona.

Stashbot added a comment.Oct 21 2020, 8:46 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T08:46:36Z] <Urbanecm> [urbanecm@mwmaint2001 ~/updateVarDumps/output/group2-medium/output]$ mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=apiportalwiki # T246539

Urbanecm claimed this task.Oct 21 2020, 8:46 AM
Restricted Application added a project: User-Urbanecm. · View Herald TranscriptOct 21 2020, 8:46 AM
Urbanecm updated the task description. (Show Details)Oct 21 2020, 8:48 AM
Stashbot added a comment.Oct 21 2020, 8:50 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T08:50:06Z] <Urbanecm> mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log # wiki=cebwiki; T246539

Stashbot added a comment.Oct 21 2020, 8:52 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T08:51:59Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=viwiki; T246539)

Stashbot added a comment.Oct 21 2020, 9:30 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T09:30:31Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=viwiki; T246539)

Stashbot added a comment.Oct 21 2020, 9:37 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T09:37:32Z] <Urbanecm> mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log # wiki=warwiki; T246539

Stashbot added a comment.Oct 21 2020, 9:38 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T09:38:18Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=shwiki; T246539)

Stashbot added a comment.Oct 21 2020, 9:42 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T09:42:17Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=shwiki; T246539)

Stashbot added a comment.Oct 21 2020, 9:42 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T09:42:40Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=nowiki; T246539)

Urbanecm added a comment.Oct 21 2020, 9:49 AM
In T246539#6560355, @Stashbot wrote:

Mentioned in SAL (#wikimedia-operations) [2020-10-19T13:34:31Z] <Urbanecm> Start of [urbanecm@mwmaint2001 ~/updateVarDumps/output/group2-medium]$ while read wiki; do echo "Processing $wiki"; mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > output/$wiki.log; done < wikis.dblist (T246539; wikis.dblist is medium wikis from group2.dblist)

Output is at https://usercontent.irccloud-cdn.com/file/ScOyahmg/group2-medium.tar.bz2 (sorry for not using Phab's filestorage, apparently I can't upload ~7 MB file there).

Stashbot added a comment.Oct 21 2020, 10:00 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T10:00:29Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=nowiki; T246539)

Stashbot added a comment.Oct 21 2020, 10:01 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T10:01:47Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=srwiki; T246539)

Stashbot added a comment.Oct 21 2020, 10:37 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T10:37:41Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=srwiki; T246539)

Stashbot added a comment.Oct 21 2020, 10:38 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-21T10:38:27Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log (wiki=rowiki; T246539)

Stashbot added a comment.Oct 22 2020, 11:54 AM

Mentioned in SAL (#wikimedia-operations) [2020-10-22T11:54:19Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session updateVarDumps at mwmaint2001 (wiki=huwiki; T246539)

Urbanecm moved this task from Backlog to Working on on the User-Urbanecm board.Oct 24 2020, 8:00 PM
Stashbot added a comment.Oct 29 2020, 1:23 PM

Mentioned in SAL (#wikimedia-operations) [2020-10-29T13:23:14Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session updateVarDumps at mwmaint2001 (wiki=idwiki; T246539)

Stashbot added a comment.Oct 29 2020, 1:25 PM

Mentioned in SAL (#wikimedia-operations) [2020-10-29T13:25:20Z] <Urbanecm> Correction: Obviously 1002 (T246539)

Stashbot added a comment.Oct 29 2020, 7:22 PM

Mentioned in SAL (#wikimedia-operations) [2020-10-29T19:22:29Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session on mwmaint1002 (wiki=ukwiki; T246539)

Stashbot added a comment.Nov 4 2020, 10:23 AM

Mentioned in SAL (#wikimedia-operations) [2020-11-04T10:23:28Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session updateVarDumps at mwmaint1002 (wiki=fiwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 4 2020, 10:24 AM
Stashbot added a comment.Nov 5 2020, 11:05 AM

Mentioned in SAL (#wikimedia-operations) [2020-11-05T11:05:37Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session updateVarDumps at mwmaint1002 (wiki=dewiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 8 2020, 12:00 AM
Restricted Application added subscribers: Huji, Stang, revi. · View Herald TranscriptNov 8 2020, 12:00 AM
Stashbot added a comment.Nov 9 2020, 9:54 AM

Mentioned in SAL (#wikimedia-operations) [2020-11-09T09:54:33Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session at mwmaint1002 (wiki=svwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 9 2020, 9:55 AM
Stashbot added a comment.Nov 9 2020, 2:03 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-09T14:03:12Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session at mwmaint1002 (wiki=kowiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 9 2020, 2:05 PM
Stashbot added a comment.Nov 9 2020, 4:34 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-09T16:34:19Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session at mwmaint1002 (wiki=kowiki; T246539)

Stashbot added a comment.Nov 9 2020, 4:34 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-09T16:34:45Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session at mwmaint1002 (wiki=trwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 9 2020, 4:38 PM
Stashbot added a comment.Nov 12 2020, 1:38 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-12T13:38:01Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session updateVarDumps at mwmaint1002 (wiki=cswiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 12 2020, 1:39 PM
Stashbot added a comment.Nov 12 2020, 4:11 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-12T16:11:53Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux session updateVarDumps at mwmaint1002 (wiki=cswiki; T246539)

Stashbot added a comment.Nov 12 2020, 4:12 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-12T16:12:23Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=jawiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 12 2020, 4:15 PM
Stashbot added a comment.Nov 17 2020, 2:37 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-17T14:37:10Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=itwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 17 2020, 2:37 PM
Stashbot added a comment.Nov 17 2020, 8:43 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-17T20:42:59Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=itwiki; T246539)

Stashbot added a comment.Nov 18 2020, 7:28 AM

Mentioned in SAL (#wikimedia-operations) [2020-11-18T07:28:33Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=nlwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 18 2020, 7:29 AM
Stashbot added a comment.Nov 18 2020, 11:56 AM

Mentioned in SAL (#wikimedia-operations) [2020-11-18T11:56:17Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=nlwiki; T246539)

Stashbot added a comment.Nov 18 2020, 11:56 AM

Mentioned in SAL (#wikimedia-operations) [2020-11-18T11:56:29Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=frwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 18 2020, 12:16 PM
Jdforrester-WMF updated the task description. (Show Details)Nov 18 2020, 7:34 PM
Jdforrester-WMF mentioned this in T187153: Special:Abuselog throws when viewing details or examining (BadMethodCallException: Call get getId() on null).Nov 18 2020, 7:51 PM
Daimona added a parent task: T34478: AbuseFilter not setting utf-8 flag.Nov 18 2020, 10:18 PM
Daimona added a parent task: Restricted Task.
Daimona added a parent task: T110854: Blank afl_var_dump on 9 testwiki abuse_filter_log entries from July 2012 causes exceptions.Nov 18 2020, 10:20 PM
Daimona added a parent task: T204236: Old variables are computed wrongly for old entries.
Daimona added a parent task: T214193: PHP Notice: Unable to unserialize in AbuseFilter.php.
Stashbot added a comment.Nov 19 2020, 11:00 AM

Mentioned in SAL (#wikimedia-operations) [2020-11-19T11:00:12Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=ruwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 19 2020, 11:03 AM
Stashbot added a comment.Nov 20 2020, 12:11 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-20T12:11:01Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=fawiki; T246539)

Stashbot added a comment.Nov 23 2020, 12:01 PM

Mentioned in SAL (#wikimedia-operations) [2020-11-23T12:01:32Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=zhwiki; T246539)

Urbanecm updated the task description. (Show Details)Nov 23 2020, 12:03 PM
Stashbot added a comment.Dec 1 2020, 10:41 PM

Mentioned in SAL (#wikimedia-operations) [2020-12-01T22:41:27Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=arwiki; T246539)

Urbanecm updated the task description. (Show Details)Dec 1 2020, 10:42 PM
Stashbot added a comment.Dec 2 2020, 2:10 PM

Mentioned in SAL (#wikimedia-operations) [2020-12-02T14:10:22Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=ptwiki; T246539)

Urbanecm updated the task description. (Show Details)Dec 2 2020, 2:10 PM
Stashbot added a comment.Dec 2 2020, 2:12 PM

Mentioned in SAL (#wikimedia-operations) [2020-12-02T14:12:01Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=commonswiki; T246539)

Urbanecm updated the task description. (Show Details)Dec 2 2020, 2:13 PM
Stashbot added a comment.Dec 3 2020, 11:52 AM

Mentioned in SAL (#wikimedia-operations) [2020-12-03T11:52:17Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=eswiki; T246539)

Stashbot added a comment.Dec 3 2020, 11:57 AM

Mentioned in SAL (#wikimedia-operations) [2020-12-03T11:57:24Z] <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=enwiki; T246539)

Urbanecm added a comment.Dec 3 2020, 11:58 AM

@Daimona I just started the two remaining wikis. Once they finish, this can be finally closed \o/

Jdforrester-WMF awarded a token.Dec 3 2020, 4:22 PM
Stashbot added a comment.Dec 5 2020, 12:40 AM

Mentioned in SAL (#wikimedia-operations) [2020-12-05T00:40:33Z] <Urbanecm> End of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=eswiki; T246539)

Urbanecm updated the task description. (Show Details)Dec 5 2020, 12:42 AM
Urbanecm updated the task description. (Show Details)Dec 8 2020, 4:51 PM
Urbanecm closed this task as Resolved.Dec 8 2020, 5:12 PM

Enwiki just finished a few hours ago, so I officially declare this done!

Daimona added a comment.Dec 8 2020, 5:13 PM

YAY!

Daimona awarded a token.Dec 8 2020, 5:13 PM
Daimona mentioned this in T276351: Requesting access to restricted for Daimona.Mar 3 2021, 4:19 PM
Stang unsubscribed.Nov 13 2021, 8:42 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL