Find a URL for which Citoid is failing, for example https://teara.govt.nz/en/biographies/4g2/galbraith-alexander (thanks @DrThneed!)

Pending documentation update at https://meta.wikimedia.org/wiki/Web2Cit/Docs/Templates#Range_transformation.

Done: https://meta.wikimedia.org/w/index.php?diff=30697399

Deployed with w2c-server v1.4.0

Deployed in w2c-server v1.4.0

Deployed with w2c-server v1.4.0

Deployed with w2c-server v1.4.0

Deployed with w2c-server 1.4.0

Deployed with w2c-server v1.4.0

Oh sure, no worries. I can perfectly wait. Closing this then. Thanks!

Deployed with w2c-server v1.4.0

Citing the following from an old email to @DrThneed:

Deployed with w2c-server v1.4.0

Added Case transformation to templates schema with c8665bed.

Added Replacement transformation to templates schema with 7b9a4f91.

Some errors are already caught, therefore not preventing translation from proceeding, but it would still be useful to log them to help diagnose problems:

Maybe this could be fixed if there was a way to not automatically choose one of the enum values?

In addition, JSON editor was updated to provide a custom validation error in cases where a path not matching one of the test paths has already been defined.

Note that on Toolforge, the webservice toolforge logs output shows encoding issues and gets truncated, as opposed to the kubectl logs output. Reported in T429028.

Also lowered logging level of some common events in w2c-core as they would otherwise flood the server logs: 859ca801.

Added support for setting custom logger in Web2Cit-Core with 2105091d. In the future, consider T302588.

Jobs logging in Toolforge is moving to Loki (log aggregation system): https://wikitech.wikimedia.org/wiki/News/2025_New_Toolforge_log_storage. But it's not clear if this is also the case for web services.

Done in ca75959e.

To identify requests made by the Web2Cit-Gadget we may consider whether the user script should use the Api-User-Agent header.

See T390791

This would also let us monitor pageviews of these pages with Massviews.

https://pageviews.wmcloud.org/massviews/?platform=all-access&agent=user&source=category&start=2025-05-28&end=2026-05-28&subjectpage=0&subcategories=0&sort=views&direction=1&view=chart&target=https://meta.wikimedia.org/wiki/Category:Web2Cit_Monitor_Results

In the meantime we may offer the list of recent changes to any of our Web2Cit/monitor/*/*/results pages.

Add errors and coverage parameters to Web2Cit/log/row template. For now, adding them at the end of the row, to support old log and results pages with hardcoded log header:

Monitor changes deployed and log and result pages updated. Changed errors and coverage column order in log and header templates:

• https://meta.wikimedia.org/w/index.php?title=Template:Web2Cit/log/row&diff=prev&oldid=30606074
• https://meta.wikimedia.org/w/index.php?title=Template:Web2Cit/log/header&diff=prev&oldid=30606079

Updated Web2Cit/log/row template to split timestamp on "T" divider for better fitting page width: https://meta.wikimedia.org/w/index.php?title=Template:Web2Cit/log/row&diff=prev&oldid=30604315

Web2Cit domain configuration

This may be useful to use Special:RelatedChanges to list recent changes for files in one of these categories (may related to T322632).

Web2Cit check results

Also added Web2Cit Monitor Results without paths (see T321093).

Likewise, I'm getting internal server error for www.animenewsnetwork.com URLs, with Web2Cit but not with Citoid.

• Fixed in 8db4129a.
• Added corresponding Web2Cit Monitor Results without paths category: https://meta.wikimedia.org/wiki/Category:Web2Cit_Monitor_Results_without_paths
• Updated Module:Web2Cit/results accordingly: https://meta.wikimedia.org/w/index.php?title=Module:Web2Cit/results&diff=prev&oldid=30601234

solved for the overview page at Web2Cit/monitor if this page is generated dynamically,

In this case, users wouldn't be able to add the page to their watchlist to be notified of new domains configured (T329573).

Web2Cit check log

• Created Web2Cit Monitor Logs category: https://meta.wikimedia.org/wiki/Category:Web2Cit_Monitor_Logs
• Added to Web2Cit-Core log mako template in 3011790d

This problem would be solved for the overview page at Web2Cit/monitor if this page is generated dynamically, maybe by having a Web2Cit Monitor Log category for domain log pages (see T317970) and by creating and using a Template Gadget.

Fixed in 96cb0f86.

• Web2Cit check results
  • Web2Cit check OK (>80%)
  • Web2Cit check FAIL (<80%)

See T329573#11927033 & T408861#11953217 for some Web2Cit Monitor Results categories created and used.

Implement results with root path categorization suggested above.

• Module:Web2Cit/results: https://meta.wikimedia.org/w/index.php?title=Module:Web2Cit/results&diff=prev&oldid=30588711
• https://meta.wikimedia.org/wiki/Category:Web2Cit_Monitor_Results_with_root_path

On testing the Web2Cit-Monitor changes locally with domain tfl.gov.uk I was getting some [!!] tfl.gov.uk Targets error: No applicable translation template for target "/" errors and output files were not written. I'm not getting these errors anymore. Investigate.

The coverage() functions implemented with fd83dfc6 were failing for paths with translation errors. Fixed in 988cdc76.

Support errors and test coverage in results page test results table.

• Module:Web2Cit/results https://meta.wikimedia.org/w/index.php?title=Module:Web2Cit/results&diff=prev&oldid=30588599
• Web2Cit-Monitor 8d0e2117

On testing the Web2Cit-Monitor changes locally with domain tfl.gov.uk I was getting some [!!] tfl.gov.uk Targets error: No applicable translation template for target "/" errors and output files were not written. I'm not getting these errors anymore. Investigate.

New Web2Cit/log/row template:

• Create localized log table header template: https://meta.wikimedia.org/wiki/Template:Web2Cit/log/
• Update monitor overview page (Web2Cit/monitor) to use it: https://meta.wikimedia.org/w/index.php?title=Web2Cit/monitor&diff=prev&oldid=30566744
• Update log mako template to use it in Web2Cit-Monitor with 9cb1f5d9
• Update Web2Cit/results module to use it: https://meta.wikimedia.org/w/index.php?title=Module:Web2Cit/results&diff=prev&oldid=30566761

We may also consider including the number of tests failed in the monitor results and log pages.

Consider updating result scores in Web2Cit-Server and Web2Cit-Monitor to also show number or percentage of output fields or output paths without corresponding test goals.

Consider using this to also warn them about templates for "/" path (see T337131).

Solved by using dynamically-generated templates JSON schema including a list of allowed paths as determined by the tests paths defined in the corresponding translation tests configuration file.

Thank you!

Oh, I see! Then maybe it would make sense to update the documentation here and here? I didn't find the page you linked to anywhere in the docs :)

We now support automatic categorization of Web2Cit Monitor result pages into a Web2Cit Monitor Results with missing tests category. See T321606.

Along with changes made to fix T321606, we should now support automatic categorization of Web2Cit Monitor result pages into the following categories (Web2Cit-Monitor bot changes deployment pending:

I created Template:Web2Cit/results/domain to handle this.

Hi! Yes, still happening. Just checked with two browsers:

• Firefox 149.0.2
• Chrome 147.0.7727.55

Consider creating a Web2Cit Monitor Results template on-wiki so that these and other format changes (such as adding a Web2Cit Monitor Results category as proposed in T329573#11907779) can be made without changing Web2Cit-Monitor code and, more importantly, without triggering watchlist notifications (which should be limited as much as possible to translation results changes).

Also, consider logging the Referrer or Origin headers of the request (if any) to identify requests made by the Web2Cit-Gadget.

create a new Web2Cit Monitor Results category for these results pages.

In the meantime we may offer the list of recent changes to any of our Web2Cit/monitor/*/*/results pages.

Possibly consider scanning all templates to identify templates missing itemType or title fields and notify interested users.

If this change is applied, we will have to run a script that automatically converts templates.json and tests.json files into paths.json. Maybe consider merging one into the other to preserve edit history as much as possible.

Fixed in Web2Cit-Core with 436b7e77.

From T309310 mentioned above:

Documentation updated with https://meta.wikimedia.org/w/index.php?title=Web2Cit/Docs/Templates&diff=prev&oldid=30517228

Replace transformation inplemented in Web2Cit-Core with 230f83c6.

Special replacement patterns would be supported

Regarding Replace transformation, how do we distinguish pattern and replacement parameters in the config value while T305903 is not supported?

Implemented in Web2Cit-Core with 2fdbde87.

Started working in branch T309869 of Web2Cit-Core:

• implement a QID transformation step that resolves an input QID into corresponding [[sitelink]] or label value from Wikidata, using a list of one or more language codes as config value to decide which sitelink/label to return.

carefully consider which translation templates currently use Range transformation steps with itemwise=true and how outputs would change before deploying any changes.

Supported in Web2Cit-Core with 6572653e.

Resolved in w2c-core with 7c259f4c. In a e.g., 4-element array, negative indices are supported as:

• -1 equivalent to 4
• -2 equivalent to 3
• -4 equivalent to 1

Fixed in Web2Cit-Core with 812d043c.

Edit summary hashtag implemented in f19a0db9:

• We now add [[meta:Web2Cit| #Web2Cit]] to the edit summary if one or more Web2Cit citations have been inserted. Tracked on https://hashtags.wmcloud.org/?query=Web2Cit.
• If no prior edit summary has been defined, we prepend "Add a citation" string, using localized Citoid's citoid-citoiddialog-title message.
• If contributor deliberately chooses not to accept our suggestion, we won't try again until a new Web2Cit citation has been inserted.
• Note that in cases where an edit session is recovered (see T57370), we don't keep track of Web2Cit citations added in previous sessions.
• Also note that, as opposed to Change tags (which we are not using), the user can always remove the hashtag from the edit summary before publishing.

First, that it will have to be internationalized to fit different language Wikipedias, if we want to include a comment more explanatory than simply "Web2Cit".

We may workaround this by using messages from other components, such as Citoid extension's citoid-citoiddialog-credit (Powered by $1).

This issue also affects wikilinks such as [[meta:Web2Cit|#Web2Cit]], as mentioned by @Sophivorus in T321568#11358374.

We may thus consider further tweaking the Citoid extension to add something (maybe a comment?) to the citation template if it was inserted using Web2Cit-generated data.

Hi, @matmarex! Thanks for your suggestions and sorry for my long delayed follow up.

Fixed in 5ccd48b5. Pending deployment.

In addition, right now a path for which no applicable translation template is found, makes the Web2Cit-Monitor fail for the whole domain (T321093).

Fixed in 6ff4df3c.

Also noting that:

• This only happens after the citation dialog has been opened at least once. That is: if I start in visual mode and switch to source mode *without having opened the citation dialog*, then a enabling/disabling Web2Cit *will* work in source mode.
• The Web2Cit edit button that appears in the error message (added in 8cf5c95c) also doesn't work after switching.

Note these two elements are created in our patchInitialize function (which doesn't get called again after switching), but added to the DOM in the patched CitoidInspector.initialize function, which is called again after switching.

Noting that the problem seems to be at switching from one mode to the other. If the editor is started in source mode, enabling and disabling Web2Cit does work. But it stops working after switching to visual mode. And the other way round, as reported originally.

Hi @Yurik, @matmarex and @aude! I'm pinging you here because I saw you have edited Wikimedia's CommonSettings.php with Extension:JsonConfig related lines.

Should be fixed in 8cf5c95c. Deployed in 133886.

Should be fixed in 8cf5c95c. Deployed in 133886.

Should be fixed in 8cf5c95c. Deployed in 133886.

As per discussion on https://en.wikipedia.org/wiki/User_talk:Diegodlh/Web2Cit/script#Serve_from_Wikimedia_Gitlab I have decided not to implement this for the moment.

It is still possible to get on-wiki notifications – on Special:Watchlist.

On-wiki notifications already work fine through Special:Watchlist (so 54fc9771f4a870f2051634590277423666bf202c is also incorrect), why doesn’t that suffice?

Resolved in https://en.wikipedia.org/w/index.php?title=User:Diegodlh/Web2Cit/script.js&diff=prev&oldid=1337979577

Resolved in https://en.wikipedia.org/w/index.php?title=User:Diegodlh/Web2Cit/script.js&diff=prev&oldid=1337979577

Apparently there is a way to get watchlist edit notifications on-wiki through the Echo extension: T203941. But this hasn't been deployed to production wikis: T309855.

At the moment there is no way to get notifications for bot-made edits on watchlisted pages because such email notifications have been disabled. See T379149.

Hi, @Michael! Thanks for your reply.

To address this we could change Web2Cit-Core and Web2Cit-Server so that the API response includes the config revision timestamp in addition to the revision id (see https://meta.wikimedia.org/wiki/Web2Cit/Docs/Server#Version_1.0:).

In the meantime, mentioning this bug in the documentation:

Removed column from field template: https://meta.wikimedia.org/w/index.php?title=Template:Web2Cit/results/field&diff=prev&oldid=30055205

Hi! I'm trying to fix T329573 as one of the tasks in a Rapid Fund grant, but apparently it's blocked by this issue. Are there any plans to fix this? Thank you!