Page MenuHomePhabricator

Wbm1058
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
May 17 2015, 1:19 PM (466 w, 1 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Wbm1058 [ Global Accounts ]

Recent Activity

Yesterday

Wbm1058 added a comment to T363077: High replication lag for enwiki (db1154 s1 replication crashed).

Sorry to butt in, but, my understanding from the above is that the corrupted table coincidentally happens to be the same table which was just recently "normalized", correct?

Mon, Apr 22, 11:06 AM · DBA, Data-Services

Jan 25 2024

Wbm1058 added a comment to T351729: Bot1058 is unable to perform a link update using the API.

Sorry, I have found one more scenario where "Bot1058 is unable to perform a link update using the API" where it was previously able to, before August/September 2023. I'm still not totally up to speed on Phabricator etiquette, so will let y'all who are still subscribed to this decide whether it is appropriate to reopen this Phab, open a new one, or just comment here on this closed Phab without reopening it.

Jan 25 2024, 3:24 PM · MW-1.42-notes (1.42.0-wmf.13; 2024-01-09 ), MediaWiki-Page-derived-data, MediaWiki-Platform-Team

Jan 13 2024

Wbm1058 added a comment to T351729: Bot1058 is unable to perform a link update using the API.

I've finished three 10,000 page runs. They still have the X-Wikimedia-Debug. Yes, the new deployment helped. At least some of the pages are now purged.

Jan 13 2024, 3:05 AM · MW-1.42-notes (1.42.0-wmf.13; 2024-01-09 ), MediaWiki-Page-derived-data, MediaWiki-Platform-Team

Dec 20 2023

Wbm1058 added a comment to T351729: Bot1058 is unable to perform a link update using the API.

OK, I turned X-Wikimedia-Debug back on, and ran a one-off test that attempted to refresh 10,000 links. Hopefully that's given you the data you need to track it down. Let me know if you want me to run more tests.

Dec 20 2023, 2:49 AM · MW-1.42-notes (1.42.0-wmf.13; 2024-01-09 ), MediaWiki-Page-derived-data, MediaWiki-Platform-Team

Dec 4 2023

Wbm1058 added a comment to T352628: Fatal exception of type "Wikimedia\Rdbms\DBTransactionSizeError".

I've gotten this error twice, when trying to make the same simple edit to a page

Dec 4 2023, 2:36 PM · MediaWiki-Categories, Patch-For-Review, MW-1.42-notes (1.42.0-wmf.7; 2023-11-28), DBA, Wikimedia-production-error

Nov 27 2023

Wbm1058 added a comment to T351729: Bot1058 is unable to perform a link update using the API.

I ran a quick bot test on Toolforge Kuberbetes to purge 80 pages. It finished in 14 seconds. Alas, it too failed. My Quarry query of two pages that the bot attempted to purge shows their page_links_updated dates to still be August 20, 2023. That's 25 days before September 14. This bot was endeavoring to keep pages refreshed every 30 days or so, and would have been running really well if it had actually worked it down to just 25. Those pages likely would have been purged around September 15 or 16 if the issue hadn't cropped up, give or take a day or few.

Nov 27 2023, 11:47 PM · MW-1.42-notes (1.42.0-wmf.13; 2024-01-09 ), MediaWiki-Page-derived-data, MediaWiki-Platform-Team
Wbm1058 added a comment to T351729: Bot1058 is unable to perform a link update using the API.

It seems like we started inserting refreshLinksPrioritized jobs on Sept. 14 (the group 2 train day for 1.41.0-wmf.26):

Screenshot Capture - 2023-11-27 - 12-54-59.png (369×2 px, 112 KB)

(although there are later periods where they aren't inserted, maybe that's when the bot didn't run?)
So maybe the job just doesn't work for some reason, this wasn't an issue before because we didn't use the job queue (although there are jobs before that date, just much fewer), and the issue doesn't occur in manual tests because the 100+ deferred limit for converting deferreds into jobs isn't hit? How many articles does the bot purge in a single request?

Nov 27 2023, 11:13 PM · MW-1.42-notes (1.42.0-wmf.13; 2024-01-09 ), MediaWiki-Page-derived-data, MediaWiki-Platform-Team
Wbm1058 added a comment to T351729: Bot1058 is unable to perform a link update using the API.

The odds of losing updates due to an error increases when executing long queues
and when large amounts of time pass while tasks are queued. Mitigate this by
trying to eagerly move updates to the JobQueue when possible.

Nov 27 2023, 7:04 PM · MW-1.42-notes (1.42.0-wmf.13; 2024-01-09 ), MediaWiki-Page-derived-data, MediaWiki-Platform-Team
Wbm1058 added a comment to T351729: Bot1058 is unable to perform a link update using the API.

I suspect that changes related to Phabricator T265749 broke my bot's purging. Right about the time when this was marked as closed and resolved (~September 10-11) is when my bot stopped working.

Nov 27 2023, 6:25 PM · MW-1.42-notes (1.42.0-wmf.13; 2024-01-09 ), MediaWiki-Page-derived-data, MediaWiki-Platform-Team

Oct 19 2023

Wbm1058 added a comment to T182867: BotPasswords + Toolforge combination causing daily "login from new device" warning emails.

I got a boatload of these "login from a device you haven't recently used" messages on October 14 (and a few before that), but couldn't be bothered to report the problem. I assumed that it was a system problem and not someone actually hacking my password. Glad to see that someone else reported it.

Oct 19 2023, 10:37 PM · MediaWiki-extensions-LoginNotify, User-notice, MediaWiki-Email, MediaWiki-User-login-and-signup, Toolforge

Sep 11 2023

Wbm1058 reopened T340829: stewardbot k8s pod fails to restart due to an internal server error as "Open".

Sorry, it's too much trouble for me to spend an hour trying to figure out how to open a new Phab, so I'm just gonna reuse this one.

Sep 11 2023, 1:25 PM · User-aborrero, Toolforge Jobs framework

Sep 8 2023

Wbm1058 added a comment to T327165: toolforge-jobs: add logrotate.

OK, I've successfully set up log rotation for a couple of my Toolforge jobs, and have documented how I did it.

Sep 8 2023, 10:01 PM · Kubernetes, Toolforge (Software install/update)

Aug 27 2023

Wbm1058 added a comment to T327165: toolforge-jobs: add logrotate.

I found this helpful documentation:
A Complete Guide to Managing Log Files with Logrotate

Aug 27 2023, 12:46 AM · Kubernetes, Toolforge (Software install/update)

Aug 19 2023

Wbm1058 added a comment to T327165: toolforge-jobs: add logrotate.

Oh, I see (lightbulb turning on):

Aug 19 2023, 2:14 PM · Kubernetes, Toolforge (Software install/update)

Aug 18 2023

Wbm1058 added a comment to T319590: Migrate billsbots from Toolforge GridEngine to Toolforge Kubernetes.

My only remaining issue with running on Toolforge Kubernetes is controlling the log size of my continuous jobs. I will consider creating a new Phabricator task requesting some log rotation functionality in the Toolforge Kubernetes system. In the meantime my solution is to rename my billsbots log files and periodically restart my continuous jobs.

Aug 18 2023, 5:26 PM · Grid-Engine-to-K8s-Migration
Wbm1058 updated subscribers of T327165: toolforge-jobs: add logrotate.

logrotate is available in the mariadb image created for T254636: mysqldump is not present in Kubernetes container images (along with mariadb cli clients and our local sql wrapper).

How/where should we document that? It would be neat to figure out how to manage an automated inventory of what packages are available in which images.

Aug 18 2023, 5:14 PM · Kubernetes, Toolforge (Software install/update)

Aug 16 2023

Wbm1058 added a comment to T135964: Force pages to be fully re-parsed occasionally.

Well now I see the status is "Open, In Progress, Needs Triage" but I'm at a loss for how to remove "Needs Triage". A member of the Triagers project needs to do that?

Aug 16 2023, 11:24 AM · MediaWiki-Core-HTTP-Cache, MediaWiki-Parser
Wbm1058 changed the status of T135964: Force pages to be fully re-parsed occasionally from Open to In Progress.

I've noted that for a long time the status of this task has been "Open, Needs Triage".

Aug 16 2023, 11:18 AM · MediaWiki-Core-HTTP-Cache, MediaWiki-Parser
Wbm1058 changed the status of T135964: Force pages to be fully re-parsed occasionally, a subtask of T157670: Periodically run refreshLinks.php on production sites., from Open to In Progress.
Aug 16 2023, 11:18 AM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED
Wbm1058 updated subscribers of T319590: Migrate billsbots from Toolforge GridEngine to Toolforge Kubernetes.

I am struggling to find an image containing logrotate (or its alternative). I have been using /usr/sbin/logrotate to rotate log files daily.

EDIT: I brute-forced and found that mariadb contains it.

Hmm...

Aug 16 2023, 3:50 AM · Grid-Engine-to-K8s-Migration
Wbm1058 closed T319590: Migrate billsbots from Toolforge GridEngine to Toolforge Kubernetes as Resolved.

Per the task description which says "If you have already migrated this tool, kindly mark this as resolved." I am marking this as resolved.

Aug 16 2023, 3:24 AM · Grid-Engine-to-K8s-Migration

Jun 30 2023

Wbm1058 added a comment to T340829: stewardbot k8s pod fails to restart due to an internal server error.

ERROR: Please report this issue to the Toolforge admins

Jun 30 2023, 2:31 PM · User-aborrero, Toolforge Jobs framework
Wbm1058 added a comment to T340829: stewardbot k8s pod fails to restart due to an internal server error.

This is an unattributed fork of the problem I reported HERE

Jun 30 2023, 2:28 PM · User-aborrero, Toolforge Jobs framework

Jun 15 2023

Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

I'm making more sense of this, figuring out things that should have been explained to us from the start of this phab.

Jun 15 2023, 8:15 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry
Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

... I drop my SQL

select left(page_links_updated,8) as date,count(*),avg(page_len),sum(page_len)
from page
where page_random between 0.001 and 0.002 and page_namespace = 0
group by date;

then I click run and...

DB engine Error
Only SELECT statements are allowed against this database.

I'm not sure what happened here. When I ran the same in quarry and superset, both work and give the same results on enwiki_p

Jun 15 2023, 4:10 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry
Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

Where is YuviPanda? Have they abandoned us?

Yuvi is a former WMF employee. He has not worked for WMF for quite some time.

Regardless of whether someone is a staff or volunteer, just because you worked on something once upon a time does not mean you are bound to it for the rest of your life...

Jun 15 2023, 2:44 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry
Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

If superset were to completely fall over, project was removed or some such, https://github.com/toolforge/superset-deploy/ has the instructions to bring it back, from nothing being deployed. It doesn't take long, about 20-30 minutes most of which is waiting for a k8s cluster to deploy, I've done it a few times now, and no one seemed to notice when I removed the entire back end of superset and replaced it with a different one.

I'm unaware of a similar set of instructions for quarry, if it really fell over I'm not convinced I could put it back. That leaves quarry in an uncertain position. This ticket is about mitigating that uncertainty.

Jun 15 2023, 1:26 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry
Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

Am I correct in my assumption that Quarry is 100% "supported" by volunteers? Who wrote it?

Jun 15 2023, 12:53 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry
Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

OK this thread has bugged and annoyed me to sufficiently motivate me to attempt to use Superset. After looking at the user interface Dashboards... Charts... Datasets... for a couple of minutes ..... where do I enter my SQL query?? Oh duh, click on the "SQL" tab... that's one step I don't need to make in Quarry ... I see a more familiar window where I drop my SQL

Jun 15 2023, 3:47 AM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry

Jun 11 2023

valerio.bozzolan awarded T335352: Provide a PHP 8.2 image for Kubernetes toolforge-jobs and webservice a Yellow Medal token.
Jun 11 2023, 6:05 AM · Toolforge (Software install/update)

Jun 1 2023

Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

Is this the right place to complain about features from Quarry that I'm missing from Superset? Because if so, I'm missing the option to export the results of a query to a Wikitable.

Seconded this, since I frequently use the "wikitable export" in Quarry.

Jun 1 2023, 12:17 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry

May 23 2023

Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

Won't you need to keep the Superset machines running and patched with the latest OS / security updates, etc. too?

May 23 2023, 3:28 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry
Wbm1058 added a comment to T169452: Replace Quarry with an installation of Superset.

I'll echo the "why not both" sentiment of Danilo above. Quarry doesn't get a lot of support. Right. Nothing on the developers platform gets a lot of support, so what else it new? Toolforge doesn't get a lot of support. Grid Engine doesn't get a lot of support. Kubernetes doesn't get a lot of support.

May 23 2023, 3:09 PM · cloud-services-team (FY2023/2024-Q3-Q4), superset.wmcloud.org, Quarry

Apr 25 2023

Wbm1058 created T335352: Provide a PHP 8.2 image for Kubernetes toolforge-jobs and webservice.
Apr 25 2023, 12:18 PM · Toolforge (Software install/update)

Feb 18 2023

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

(I'm assuming that all pages since Oct. 2022 have been updated since and it's not just a bad random sample.)

As I've pointed out previously in this Phab, except for the NULL Sweet 16 and the purge-resistant Super 6.

Feb 18 2023, 3:35 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

Feb 12 2023

Wbm1058 added a comment to T319590: Migrate billsbots from Toolforge GridEngine to Toolforge Kubernetes.

Status update. I only started working on GridEngine on October 1 2022 with submitting simple one-off jobs using 'jsub' and never got to the point of having any fully automated jobs running on that platform, as just five days later on October 6 I got your email informing me of this Phabricator. From that point I stopped even running one-offs on GridEngine.

Feb 12 2023, 3:37 PM · Grid-Engine-to-K8s-Migration

Feb 7 2023

Wbm1058 added a comment to T319568: Migrate archiving from Toolforge GridEngine to Toolforge Kubernetes.

If anyone figures out how to use a wrapper script, please let me know how you did it. Thanks

Lacking an answer there, I'm waiting for T301901 too.

T301901 has been resolved now. Are you able to proceed now?

Feb 7 2023, 9:09 PM · User-revi, Grid-Engine-to-K8s-Migration

Jan 25 2023

Wbm1058 added a comment to T327279: Toolforge jobs framework: introduce swagger to the API.

Swagger is a suite of tools for API developers from SmartBear Software and a former specification upon which the OpenAPI Specification is based.

Jan 25 2023, 12:49 PM · cloud-services-team, User-Raymond_Ndibe, Toolforge Jobs framework

Jan 23 2023

Wbm1058 added a comment to T327594: Sticky header covers up section title after following a section link on the very same page.

T317967 describes the same or a very similar phenomenon, which, as I said I've observed in legacy Vector from time to time as well.

Jan 23 2023, 11:16 PM · Desktop Improvements (Vector 2022)
Wbm1058 added a comment to T327594: Sticky header covers up section title after following a section link on the very same page.

Well now the Funeral#Visitation link works OK for me too.

Jan 23 2023, 11:01 PM · Desktop Improvements (Vector 2022)
Wbm1058 added a comment to T327594: Sticky header covers up section title after following a section link on the very same page.

Well I see that this section link works properly for me.
But this section link does not.
And neither does this section link which Sj provided in their original report above.

Jan 23 2023, 8:17 PM · Desktop Improvements (Vector 2022)
Wbm1058 added a comment to T319568: Migrate archiving from Toolforge GridEngine to Toolforge Kubernetes.

If anyone figures out how to use a wrapper script, please let me know how you did it. Thanks

Jan 23 2023, 8:04 PM · User-revi, Grid-Engine-to-K8s-Migration
Wbm1058 added a comment to T327594: Sticky header covers up section title after following a section link on the very same page.

OK, so now we've just gone from easy to reproduce to damned near impossible to reproduce. Like hunting for a needle in a haystack or finding the winning lottery ticket number.

Jan 23 2023, 7:46 PM · Desktop Improvements (Vector 2022)
Wbm1058 added a comment to T327594: Sticky header covers up section title after following a section link on the very same page.

Open casket is a redirect to [[Funeral#Visitation]].

Jan 23 2023, 3:21 PM · Desktop Improvements (Vector 2022)
Wbm1058 added a comment to T327594: Sticky header covers up section title after following a section link on the very same page.

I just updated to the latest version of Google Chrome and duplicated this on Windows 10.

Jan 23 2023, 2:40 PM · Desktop Improvements (Vector 2022)

Nov 26 2022

Wbm1058 added a comment to T319590: Migrate billsbots from Toolforge GridEngine to Toolforge Kubernetes.

Dear komla and nskaggs,

Nov 26 2022, 11:55 AM · Grid-Engine-to-K8s-Migration

Nov 13 2022

Wbm1058 added a comment to T301901: Allow specifying the path for log files for jobs executed on the new toolforge Jobs framework.

Per the documentation:

Nov 13 2022, 9:47 AM · cloud-services-team (FY2022/2023-Q3), User-Raymond_Ndibe, Toolforge Jobs framework, Patch-For-Review
Wbm1058 added a comment to T301901: Allow specifying the path for log files for jobs executed on the new toolforge Jobs framework.

$ toolforge-jobs run refreshlinks--k8s --command "php ./php/refreshlinks.php > ./logs/refreshlinks--k8s.log" --image tf-php74 --no-filelog

Nov 13 2022, 1:03 AM · cloud-services-team (FY2022/2023-Q3), User-Raymond_Ndibe, Toolforge Jobs framework, Patch-For-Review

Nov 12 2022

Wbm1058 added a comment to T286135: Toolforge jobs framework: email maintainers on job failure.

Oh, sorry, thanks. I tried that twice

Nov 12 2022, 8:59 PM · Patch-For-Review, cloud-services-team (Kanban), Toolforge
Wbm1058 added a comment to T182867: BotPasswords + Toolforge combination causing daily "login from new device" warning emails.

There is an ongoing ticket for recording logins in CheckUser and that would probably help with this problem. However, that will take some time to get built.

Nov 12 2022, 3:53 PM · MediaWiki-extensions-LoginNotify, User-notice, MediaWiki-Email, MediaWiki-User-login-and-signup, Toolforge
Wbm1058 added a comment to T286135: Toolforge jobs framework: email maintainers on job failure.

If this task has been finished and closed as resolved, then why isn't --emails EMAILS listed by the Help command?

Nov 12 2022, 3:10 PM · Patch-For-Review, cloud-services-team (Kanban), Toolforge

Nov 10 2022

Wbm1058 added a comment to T182867: BotPasswords + Toolforge combination causing daily "login from new device" warning emails.

The probable reason is that your bot only logs in and doesn't make any edits. The IP(s) don't get recorded in the CheckUser table that way and every log in is treated as being from a "new" IP. Unfortunately I don't have a solution for you except for either turning off the notifications for this feature (you don't have to turn off notifications for everything) or making a few null edits (on different logins) from the bot on a sandbox page. That'd make sure the few rotating IPs get registered in checkuser and are no longer "new".

There is an ongoing ticket for recording logins in CheckUser and that would probably help with this problem. However, that will take some time to get built.

Nov 10 2022, 2:12 PM · MediaWiki-extensions-LoginNotify, User-notice, MediaWiki-Email, MediaWiki-User-login-and-signup, Toolforge

Nov 6 2022

Wbm1058 added a comment to T182867: BotPasswords + Toolforge combination causing daily "login from new device" warning emails.

I see this item is still open, though no comments in three years.

Nov 6 2022, 12:11 PM · MediaWiki-extensions-LoginNotify, User-notice, MediaWiki-Email, MediaWiki-User-login-and-signup, Toolforge

Oct 30 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

Here's what page_links_updated looks like on enwiki now. I added page lengths to give an idea of the work involved in parsing them.

MariaDB [enwiki]> select left(page_links_updated,4) as year,count(*),avg(page_len),sum(page_len) from page where page_random between 0.001 and 0.002 group by year;
+------+----------+---------------+---------------+
| year | count(*) | avg(page_len) | sum(page_len) |
+------+----------+---------------+---------------+
| NULL |     2821 |      719.9596 |       2031006 |
| 2010 |        5 |      145.8000 |           729 |
| 2011 |        9 |      116.0000 |          1044 |
| 2012 |       11 |      111.1818 |          1223 |
| 2013 |       16 |       85.2500 |          1364 |
| 2014 |     1139 |     1619.6558 |       1844788 |
| 2015 |     1528 |     1383.2808 |       2113653 |
| 2016 |     1149 |     1116.9634 |       1283391 |
| 2017 |     1846 |     1817.3922 |       3354906 |
| 2018 |     1507 |     2056.5448 |       3099213 |
| 2019 |     6557 |      938.2196 |       6151906 |
| 2020 |    23928 |     2034.6179 |      48684337 |
| 2021 |    12018 |     5909.8995 |      71025172 |
+------+----------+---------------+---------------+
13 rows in set (0.78 sec)

So if we refreshed up to 2020-01-01, including nulls, that would be about 16.6M pages and 18.5 GB of wikitext.

Oct 30 2022, 8:28 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

Oct 6 2022

Wbm1058 added a comment to T319590: Migrate billsbots from Toolforge GridEngine to Toolforge Kubernetes.

A volunteer to help me migrate my English Wikipedia bot request for approval would be appreciated.

Oct 6 2022, 5:00 PM · Grid-Engine-to-K8s-Migration

Jun 25 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

It would be great to make some progress on this task. On en.WP, Category:Pages using ISBN magic links is still populating, seven months after the MediaWiki code change that created it. This bug is blocking implementation of things like the Tidy conversion and removal of magic links.

This is not really a task you make progress on, I'm afraid. It's more a "Rain may cause flooding" task, with some issue-amelioration sub-tasks proposed underneath. It certainly won't ever be "done", unless we radically re-think what MediaWiki is and re-write it. Can you link to the tasks you think are blocked by this so we can look for a way around this?

Jun 25 2022, 3:11 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED
Wbm1058 added a comment to T135964: Force pages to be fully re-parsed occasionally.

Bot request for approval

Jun 25 2022, 9:33 AM · MediaWiki-Core-HTTP-Cache, MediaWiki-Parser
Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

Bot request for approval

Jun 25 2022, 9:31 AM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

May 30 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

What's up? I just tried querying the database, which has been working for me for months, and see a query failed error:

May 30 2022, 11:23 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

May 10 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

Thanks. That does clarify things at a high level; I'm still foggy on the details.

May 10 2022, 11:52 AM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

May 8 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

What is the difference between refreshLinks.php (manual) and purgePage.php (manual)?

May 8 2022, 3:56 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

May 1 2022

Wbm1058 added a comment to T290146: Pressing the Stop button in Quarry results in a 500 error.

https://quarry.wmcloud.org/query/63057 has been running for four days now. I've run this many, many times and normally it runs in a matter of just seconds or a few minutes at most.

May 1 2022, 6:44 PM · Patch-For-Review, Quarry

Apr 12 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

And now I present the Super Six! These six pages have a special power that makes them highly resistant to conventional null-edit purging. All six share in common that they are the same 6 bytes long: {{OW}} i.e. they transclude Template:OW. This template has over 615,000 transclusions on English WIkipedia, which are generally are purge compliant, but for these six. HERE we see an editor work-around for the page's purge resistance. She actually edited the page to make a redirect to the template, in order to force the purge, and then self-reverted back to {{OW}}.

Apr 12 2022, 12:55 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

Mar 25 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

I have a suspect for the cause of "the 16". Noting that the T115081 report was filed on Oct 8 2015, this was just when someone first noticed and reported it. There is a bulge in User, and especially User talk pages to update with page_links_updated = 201505 which is about five months before the bad data was reported. The bulge is caused by a ton of users with names ending ~enwiki so my suspect is the project that implemented Unified login or SUL (single user login).

Mar 25 2022, 12:57 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

Mar 24 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

LOL! I found the Sweet Sixteen! American college basketball fans, the round to determine the Elite Eight kicks off in just a few hours!

Mar 24 2022, 8:11 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED
Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

In just over ten days I've cleared the NULL members of page_links_updated on enwiki, but for 16 pages that can't be purged, possibly due to random sunspot activity.

Mar 24 2022, 3:59 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

Mar 20 2022

Wbm1058 added a comment to T159512: Add option to refreshLinks.php to only update pages that haven't been updated since a timestamp.

Just to be clear on what this is about, here's a link to the manual for refreshLinks.php
https://www.mediawiki.org/wiki/Manual:RefreshLinks.php

Mar 20 2022, 12:33 PM · MW-1.40-notes (1.40.0-wmf.25; 2023-02-27), MediaWiki-Page-derived-data
Restricted Application added a project to T135964: Force pages to be fully re-parsed occasionally: Performance-Team.
Mar 20 2022, 11:52 AM · MediaWiki-Core-HTTP-Cache, MediaWiki-Parser

Mar 17 2022

Wbm1058 added a comment to T157670: Periodically run refreshLinks.php on production sites..

Just to make sure this is documented for WMF engineers. Apparently there is a community bot running to slowly null edit 2.7mil enwiki pages that had never had their page_links_updated value set yet.

https://en.wikipedia.org/w/index.php?title=Wikipedia:Village_pump_(technical)&oldid=1077662724#A_page_is_populating_a_hidden_maintenance_category,_but_the_category_is_empty!

Mar 17 2022, 2:53 PM · Platform Engineering Roadmap Decision Making, MediaWiki-Parser, MediaWiki-Page-editing, Parsing-Team--ARCHIVED

Mar 6 2021

Wbm1058 added a comment to T254649: Rename SpamBlacklist.

I like

Mar 6 2021, 12:15 AM · SpamBlacklist

Mar 1 2021

Wbm1058 added a comment to T254649: Rename SpamBlacklist.

Local blacklists and whitelists hmm, maybe a MAGIC WORD is needed to pull the location out of the common or local settings?

Mar 1 2021, 9:04 PM · SpamBlacklist
Wbm1058 added a comment to T254649: Rename SpamBlacklist.

LocalSettings.php is not a wiki page and you cannot access it with your web browser. Instead, it is a file in the file system of the server. Its contents are generated during the initial setup of the wiki and the resulting file must be copied on the server manually.

Mar 1 2021, 7:32 PM · SpamBlacklist
Wbm1058 added a comment to T254649: Rename SpamBlacklist.

Would it be an option to have all wiki pages be custom set by the wiki:
$whereIsSpamBlacklist=Wikipedia:here?

Mar 1 2021, 4:27 PM · SpamBlacklist

Feb 20 2021

Wbm1058 added a comment to T254649: Rename SpamBlacklist.

See the closed discussion at Wikipedia talk:Spam blacklist §Requested move 10 February 2021

Feb 20 2021, 4:20 PM · SpamBlacklist

Dec 24 2020

Wbm1058 added a comment to T235957: Change {{REVISIONID}} from number to "-" in wgMiserMode.

Why does {{REVISIONID}} now return blank when substed? Shouldn't it at least return '-'?

What is the accommodation for cases where the revision ID needs to be inserted into a URL such as in Template:Db-g12 or Template:RMassist/core?

Dec 24 2020, 3:47 PM · MediaWiki-Platform-Team (Radar), User-notice, Parsing-Team--ARCHIVED, MediaWiki-Parser

Nov 23 2020

Wbm1058 added a comment to T14019: ifexist function uses pagelinks table in lieu of better options.

A solution was implemented on English Wikipedia that removes undesirable Side Effect #1 but apparently also removes the desirable side effect(s) as well.

Nov 23 2020, 4:38 PM · Community-Wishlist-Survey-2015, ParserFunctions

Sep 13 2020

Wbm1058 added a comment to T239277: Add user right to delete single revision redirects, regardless of target, during page moves.

Are there any default (or wmf-specific) groups this will be added to, or will WMF communities need to request this be added to groups as needed?

No groups have it yet. I was envisioning this as a right for enwiki's page mover group, and was planning to start a discussion for that at some point once the train reaches enwiki

Sep 13 2020, 2:29 PM · User-notice-archive, MW-1.36-notes (1.36.0-wmf.8; 2020-09-08), Platform Team Workboards (External Code Reviews), MediaWiki-Page-rename, MediaWiki-Page-deletion, MediaWiki-User-management, User-DannyS712, MediaWiki-Redirects

Feb 28 2020

Wbm1058 added a comment to T235957: Change {{REVISIONID}} from number to "-" in wgMiserMode.

Thanks, but this link https://en.wikipedia.org/wiki/Template:If_preview is more helpful. My understanding is that the test can only be done using a Lua module; all the template does is invoke the Lua module.

Feb 28 2020, 5:13 PM · MediaWiki-Platform-Team (Radar), User-notice, Parsing-Team--ARCHIVED, MediaWiki-Parser
Wbm1058 added a comment to T235957: Change {{REVISIONID}} from number to "-" in wgMiserMode.

Can I ask what purpose is served by {{REVISIONID}}? With the disabling of this feature, which was the ONLY useful application of this magic word, there is absolutely no practical use for {{REVISIONID}} that I can envision, so you all might just as well remove {{REVISIONID}} from large wikis entirely. No point in documenting something that has no practical use.

Feb 28 2020, 4:27 PM · MediaWiki-Platform-Team (Radar), User-notice, Parsing-Team--ARCHIVED, MediaWiki-Parser

May 17 2019

Wbm1058 added a comment to T22307: Generate automatic summary /* blah */ when I manually add a section heading when editing.

OK, so every time I try to move a page over a redirect the software breaks in with 'The destination page " " already exists. Do you want to delete it to make way for the move? (Check the edit history.)' How dare it do this AGAINST MY EXPECTATIONS! Just move the page and stop running interference.

May 17 2019, 12:58 AM · MediaWiki-Page-editing, Wikimedia-Hackathon-2017, Community-Wishlist-Survey-2015

Feb 12 2019

Wbm1058 added a comment to T75908: Avoid lost link for deleting pages which are later restored.

History-merging pages on enwiki is enough of a pain already (delete and restore are slow, and often time out and need to be repeated) and having to tend to Wikidata on top of that just adds to the trouble.
https://en.wikipedia.org/wiki/Wikipedia:Administrators%27_guide/Fixing_cut-and-paste_moves#Bugs_and_problems

Feb 12 2019, 11:49 PM · Wikidata Sitelinks, Wikidata data quality and trust, Wikidata, MediaWiki-extensions-WikibaseRepository, MediaWiki-extensions-WikibaseClient

Feb 10 2019

Wbm1058 added a comment to T76557: Special:MergeHistory causes incorrect byte change values in history.

Is this a bug or feature? This is the only evidence that I'm aware of where Special:MergeHistory leaves any log on the target page indicating that another page was merged into it. There is no log entry, nor a no-changes edit that leaves an edit summary indicating a history-merge occurred at this edit. The telltale sign that a merge ooccurred at that edit is the fact that the edit ostensibly increased the page size from zero bytes, when the previous edit did not blank the page. SO to me, this is a useful feature in that it leaves a bit of evidence, albeit cryptic and hard to find, of where another page was histmerged in.

Feb 10 2019, 10:08 PM · MediaWiki-MergeHistory
Wbm1058 added a comment to T30819: Deleted revision links should use "rev_id" not "page/timestamp".

See the description of problems at https://en.wikipedia.org/wiki/Wikipedia:Administrators%27_guide/Fixing_cut-and-paste_moves#Bugs_and_problems

Feb 10 2019, 10:00 PM · MediaWiki-Page-deletion

Feb 8 2019

Wbm1058 added a comment to T45911: Special:Undelete fails when too many checkboxes are checked.
Feb 8 2019, 5:40 PM · MediaWiki-Page-deletion

Jan 25 2019

Wbm1058 added a comment to T210739: Target deletion during page move fails.

Already done
https://en.wikipedia.org/wiki/User_talk:Anomie#Great_work!

Jan 25 2019, 11:08 PM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error

Jan 19 2019

Wbm1058 added a comment to T210739: Target deletion during page move fails.

Right, that occured to me moments after I sent my last message. So, in the Tech News, please do advise sysops to add a notice to their wiki's [[MediaWiki:Delete and move confirm]] page.

Jan 19 2019, 12:11 AM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error
Wbm1058 added a comment to T210739: Target deletion during page move fails.

I restored https://en.wikipedia.org/wiki/MediaWiki:Delete_and_move_confirm which I'd deleted when this went into hibernation. That's probably sufficient; I'm not sure a notice in Tech News is necessary.

Jan 19 2019, 12:00 AM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error

Jan 15 2019

Wbm1058 added a comment to T210739: Target deletion during page move fails.

Anomie, thanks for "taking ownership" of this. Just noting that when it has failed for me, retrying has never been successful. I just retried another move several times, and it failed each time. I'll stop doing that now as it is probably just pointless spamming of your logs. Hopefully your temporary logging will find the culprit.

Jan 15 2019, 6:15 PM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error
Wbm1058 added a comment to T210739: Target deletion during page move fails.

Internal error

Jan 15 2019, 5:47 PM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error
Wbm1058 added a comment to T210739: Target deletion during page move fails.

Probably downgrade it from UBN, since it seems it mostly stopped happening:

Jan 15 2019, 5:38 PM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error

Jan 14 2019

Wbm1058 added a comment to T210739: Target deletion during page move fails.

OK, I just got this error again: Internal error

Jan 14 2019, 11:16 PM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error

Dec 10 2018

Wbm1058 added a comment to T210739: Target deletion during page move fails.

While the fact this was first reported early on a Friday has led everyone to suspect something in a Thursday code deployment was responsible for these page-move errors, I note that coincident with that a bot https://en.wikipedia.org/wiki/Wikipedia:Bots/Requests_for_approval/TheSandBot was approved to move over 35,000 pages. It was shortly after this bot was approved and began moving pages en masse that I first encountered this error. Now, it may be a coincidence, as the bot does not have admin privileges and thus does not attempt to move over pages that require deletion to move over them, but it was someone manually trying to do what the bot couldn't, and failing, that threw up the red flags I noticed, and then when I attempted to "fix" their "error" I saw this error.

Dec 10 2018, 2:39 PM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error

Dec 9 2018

Wbm1058 added a comment to T210739: Target deletion during page move fails.

Is this still a problem? A week ago Friday I saw this error every time I tried to move over a page with history. It didn't seem random, it happened every time. But this condition only lasted for a day or two or three. I can't recall exactly the last time this failed for me, but it's been almost a week now I think since the last time. It seems to have fixed itself. Maybe the problem was some lag in software deployment? Surely someone can figure out why this happened?

Dec 9 2018, 12:14 AM · User-notice-archive, Platform Team Workboards (Done with CPT), MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Anti-Harassment, Patch-For-Review, Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error

Dec 8 2018

Wbm1058 added a comment to T200391: Cleaning up after EducationProgram.

Can a batch fix of moving them all to Project/Project_talk just be done?

I wonder if we should just re-add the EducationProgram NS in mw-config to the Wikis that had it enabled...

https://en.wikipedia.org/w/api.php?action=query&pageids=38654465&prop=info%7Crevisions&rvprop=content confirms the content type isn't anything that depends on the extension, it's just wikitext

Dec 8 2018, 7:49 PM · MediaWiki-extensions-EducationProgram
Wbm1058 added a comment to T200391: Cleaning up after EducationProgram.

See https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Special_pages_for_the_Education_Program_%E2%80%93_what_happened_to_them?

Dec 8 2018, 4:29 PM · MediaWiki-extensions-EducationProgram

Apr 27 2018

Wbm1058 added a comment to T193210: CodeMirror: allow users to customize links vs. file links differently via CSS.

All of the .cm-mw- items seem to be for specifying how to color and font-weight something that is not ordinary, normal text, i.e. a section heading, a template, a wikilink, etc.

Apr 27 2018, 5:30 PM · MediaWiki-extensions-CodeMirror
Wbm1058 added a comment to T193210: CodeMirror: allow users to customize links vs. file links differently via CSS.

I'm not following MusikAnimal's comment above.

Apr 27 2018, 5:14 PM · MediaWiki-extensions-CodeMirror

Feb 24 2018

Wbm1058 created T188191: {{dead link}} is an invalid infobox parameter.
Feb 24 2018, 11:23 PM · InternetArchiveBot

Dec 19 2017

Wbm1058 added a comment to T183107: DateInputWidget on Special:Contributions doesn't always link to user's newer contributions (due to start= vs offset=).

The fundamental issue here is that start=2016-03-10 is incompatible with offset=20160311235959. You can't start from two different dates! Is start a new parameter; why was it created? It seems like a fork of offset. What are the rules for behavior when both are specified?

Dec 19 2017, 3:20 PM · MediaWiki-Special-pages

Dec 18 2017

Wbm1058 reopened T183107: DateInputWidget on Special:Contributions doesn't always link to user's newer contributions (due to start= vs offset=) as "Open".

OK, so I click the blue link for "500" and it shows me 500 edits, which extend well beyond the date range I selected. Now it does show both "newer 500" and "older 500".
https://en.wikipedia.org/w/index.php?title=Special:Contributions&offset=20160311235959&limit=500&contribs=user&target=Dbachmann&namespace=&tagfilter=&start=2016-03-10&end=2016-03-11

Dec 18 2017, 1:52 PM · MediaWiki-Special-pages