Change 442777 had a related patch set uploaded (by Samwilson; owner: Samwilson):
[mediawiki/extensions/PageTriage@master] Add maintenance script to backfull Draft NS pages in the triage queue

https://gerrit.wikimedia.org/r/442777

The first iteration of this is ready for review. We'll probably want to change it later to be able to rebuilt tags for Draft pages that are already in the triage queue (when next a new tag is introduced, I mean). But for the current purposes, I think including just the missing Drafts is the way to go.

This is ready for review.

Change 442777 merged by jenkins-bot:
[mediawiki/extensions/PageTriage@master] Add maintenance script to backfill Draft NS pages into the triage queue

https://gerrit.wikimedia.org/r/442777

I believe we still need to run this in enwiki, do we keep this task open until that's relevant, or do we want to have a reminder to run the script in the deployment ticket for Growth team when they enable it there? @Catrope what do you think about this? You guys will likely have to run/deal with this when the features are rolled out to enwiki.

@Mooeypoo -- has the script been run on any wikis at this point, such that we could test out whether it adds everything?

It hasn't yet. It's ready to, but it needs a place where you had drafts before afc. From our investigation, that's true for one page on beta, and I'm not sure if there are such pages on test.

We can try and set up a specific test on our standalone wiki, if needed.

There's plenty of drafts on testwiki that aren't in the feed. Here's a few - 1, 2, 3.

Thanks, @Niharika. @Mooeypoo -- could you run this on testwiki? Then when you've done that, @Etonkovidova can check that all the drafts made it into the feed.

Moving to "In Development" so that the script can be run.

The script's been run -

The drafts I linked to earlier now appear in the feed.

@Etonkovidova can look this over now.

Thanks @Niharika.

So @Etonkovidova, I think the thing to check is that every draft page in the Test wiki should now be in the feed, regardless of how long ago it was created.

A bit of manual work, but here's the list of draft pages: https://test.wikipedia.org/wiki/Special:PrefixIndex?prefix=&namespace=118

We can also confirm all drafts are known to PageTriage with:

mysql:research@analytics-store.eqiad.wmnet [testwiki]> SELECT COUNT(page_id)
    -> FROM page
    -> WHERE page_namespace = 118
    -> AND NOT EXISTS(
    ->   SELECT 1
    ->   FROM pagetriage_page
    ->   WHERE ptrp_page_id = page_id
    -> );
+----------------+
| COUNT(page_id) |
+----------------+
|              0 |
+----------------+
1 row in set (0.00 sec)

though that just tells us the data is there, not if tags are correct, etc.

@SBisson @Niharika @MusikAnimal -- I am checking things out in testwiki now, and it looks like not all drafts are there. Leon's link says that there should be 19 drafts in the list, but I am only seeing 12. Niharika's example drafts are not there. Is it because a new deploy happened or something, and so now we would need to re-run the script?

@MMiller_WMF That's odd. The drafts were indeed not there. I re-ran the script and they're back in now but we should keep an eye on it for a bit. I see 37 pages in my list when I use AfC and filter by All.

There is currently 37 unreviewed drafts on testwiki. That's consistent with what we see in the UI.

mysql:research@s3-analytics-slave [testwiki]> select count(page_id) from pagetriage_page join page on ptrp_page_id=page_id where page_namespace =118 and page_is_redirect=0 and ptrp_reviewed=0;
+----------------+
| count(page_id) |
+----------------+
|             37 |
+----------------+
1 row in set (0.00 sec)

Out of those, 6 don't have the afc_state tag.

mysql:research@s3-analytics-slave [testwiki]> select page_id, page_title, page_touched from pagetriage_page join page on ptrp_page_id=page_id where page_namespace =118 and page_is_redirect=0 and ptrp_reviewed=0 and page_id not in ( select page_id from pagetriage_page join page on ptrp_page_id=page_id join pagetriage_page_tags on ptrpt_page_id=page_id where page_namespace=118 and ptrpt_tag_id=18 ) order by page_title;
+---------+-----------------+----------------+
| page_id | page_title      | page_touched   |
+---------+-----------------+----------------+
|  100315 | Foo_bar_12345   | 20180712191237 |
|  100293 | Foo_bar_foo_bar | 20180711212842 |
|  100301 | Test_Draft_001  | 20180711221858 |
|  100302 | Test_Draft_002  | 20180712082949 |
|  100303 | Test_Draft_003  | 20180712183204 |
|  100304 | Test_Draft_004  | 20180712183143 |
+---------+-----------------+----------------+
6 rows in set (0.00 sec)

I've edited Draft:Foo_bar_12345. It forced recompilation and initialization of the afc_state tag. It now shows up in Unsubmitted.

The backfill maintenance script is not designed to detect that some drafts are in the PageTriage queue but don't have the tag initialized. On testwiki we can just edit those 6 (now 5) pages to force recompilation but on enwiki production we'll have to make sure steps are executed in the right order so that all drafts get correctly initialized with the tag. Those steps are:

1. Make sure NO drafts are in the queue to start with
2. Create the afc_state tag by running PageTriage/sql/PageTriageTagsPatch-AfC.sql (does it need to be done by a dba?)
3. Run maintenance/populateDraftQueue.php
4. Make sure ALL drafts in the queue have the sfc_state tag

I've edited the following pages manually (to force recompilation) and they seem to show up correctly based on their state.

Draft:Foo_bar_12345
Draft:Foo_bar_foo_bar
Draft:Test_Draft_001
Draft:Test_Draft_002
Draft:Test_Draft_003
Draft:Test_Draft_004

In T196181#4472185, @SBisson wrote:

There is currently 37 unreviewed drafts on testwiki. That's consistent with what we see in the UI.

And they all are shown on Special:NewPagesFeed.

Everything else seems fine too.

The feed is down to 33 articles now and the examples I linked to are no longer in the feed. I think Elena found the bug: T201098#4477072.

EDIT: No, the database is consistent with the UI:

wikiadmin@10.64.32.136(testwiki)> select count(page_id) from pagetriage_page join page on ptrp_page_id=page_id where page_namespace =118 and page_is_redirect=0 and ptrp_reviewed=0;
+----------------+
| count(page_id) |
+----------------+
|             33 |
+----------------+

That bug might be separate.

@Niharika -- but there are definitely drafts missing from the feed. @MusikAnimal's search of all Draft pages (https://test.wikipedia.org/wiki/Special:PrefixIndex?prefix=&namespace=118&hideredirects=1) shows 42 drafts in test wiki, and there are only 32 in the feed. For instance, this one is missing: https://test.wikipedia.org/wiki/Draft:David_Putman

Why do you think they keep disappearing?

@MMiller_WMF Probably T201098#4477072.

@Niharika -- are you saying that those 10 drafts have been patrolled, so every time we run the script they briefly appear in the feed, but then disappear again?

In T196181#4478052, @MMiller_WMF wrote:

@Niharika -- are you saying that those 10 drafts have been patrolled, so every time we run the script they briefly appear in the feed, but then disappear again?

That seems to be the likely explanation. I don't know where the bug lies but it's not with the backfill script.