Page MenuHomePhabricator

Mvolz (Marielle Volz)
User

Projects (12)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 15 2014, 9:50 PM (440 w, 5 d)
Availability
Available
IRC Nick
Mvolz
LDAP User
Mvolz
MediaWiki User
Mvolz (WMF) [ Global Accounts ]

mvolz@wikimedia.org

Recent Activity

Thu, Mar 2

Mvolz added a comment to T330768: citoid having stability issues.

I 've updated https://grafana.wikimedia.org/d/NJkCVermz/citoid?orgId=1 a bit (more could be done, but I 'd rather do it in a consistent automated way across all of the Service folder in grafana instead of one offs) to use thanos instead of the per DC prometheus sources. The picture painted is a consistent one across the last 90d. So, while the Switchover allowed us to revisit this and unearth it once more, it's currently "expected" and "normal" (for some definition of those)

Ignoring 4xx as errors (whether that's a correct assumption or not is a good discussion, my gut says we should count 4xx - I 've updated the panels) and sticking strictly to 5xx, we have an error rate over the last 90 days that is averaging ~6%, with peaks at 12% and lows at 0.5% (those lows are unsurprisingly right on January 1st, so they can be safely discounted). 6% of an error rate is pretty high (it follows that we have an availability of 94%) and there are dependent services (RESTBase) whose health checks are occasionally flapping because of that. As far as I know, the service does not have an SLO so that (pretty high) error rate might be acceptable, but in that case, we need to adapt monitoring to account for that.

Thu, Mar 2, 10:58 AM · Platform Team Workboards (Platform Engineering Reliability), serviceops, Citoid

Feb 23 2023

Mvolz updated the task description for T306995: Migrate node-based services in production to node14.
Feb 23 2023, 2:38 PM · Patch-For-Review, serviceops, SRE

Jan 16 2023

Mvolz updated the task description for T219551: Migrate Wikimedia wikis to MediaWiki:Cite-tool-definition.json rather than MediaWiki:Visualeditor-cite-tool-definition.json and drop b/c.
Jan 16 2023, 12:09 PM · Technical-Debt, Citoid, VisualEditor, Cite

Jan 15 2023

Mvolz updated the task description for T219551: Migrate Wikimedia wikis to MediaWiki:Cite-tool-definition.json rather than MediaWiki:Visualeditor-cite-tool-definition.json and drop b/c.
Jan 15 2023, 12:34 PM · Technical-Debt, Citoid, VisualEditor, Cite
Mvolz updated the task description for T219551: Migrate Wikimedia wikis to MediaWiki:Cite-tool-definition.json rather than MediaWiki:Visualeditor-cite-tool-definition.json and drop b/c.
Jan 15 2023, 12:34 PM · Technical-Debt, Citoid, VisualEditor, Cite
Mvolz triaged T327023: Export to markdown or wikitext includes broken link as Low priority.
Jan 15 2023, 12:33 PM · Tool-global-search
Mvolz created T327023: Export to markdown or wikitext includes broken link.
Jan 15 2023, 12:33 PM · Tool-global-search
Mvolz added a comment to T219551: Migrate Wikimedia wikis to MediaWiki:Cite-tool-definition.json rather than MediaWiki:Visualeditor-cite-tool-definition.json and drop b/c.

I have moved pages where I had permission. On a few wikis, moves have special restrictions. I didn't have enough edits on https://he.wikipedia.org/ and on https://bg.wikipedia.org/ it was detected as vandalism.

Jan 15 2023, 12:27 PM · Technical-Debt, Citoid, VisualEditor, Cite
Mvolz renamed T219551: Migrate Wikimedia wikis to MediaWiki:Cite-tool-definition.json rather than MediaWiki:Visualeditor-cite-tool-definition.json and drop b/c from Migrate Wikimedia wikis to MediaWiki:cite-tool-definition.json rather than MediaWiki:visualeditor-cite-tool-definition.json and drop b/c to Migrate Wikimedia wikis to MediaWiki:Cite-tool-definition.json rather than MediaWiki:Visualeditor-cite-tool-definition.json and drop b/c.
Jan 15 2023, 12:27 PM · Technical-Debt, Citoid, VisualEditor, Cite
Mvolz updated the task description for T219551: Migrate Wikimedia wikis to MediaWiki:Cite-tool-definition.json rather than MediaWiki:Visualeditor-cite-tool-definition.json and drop b/c.
Jan 15 2023, 11:07 AM · Technical-Debt, Citoid, VisualEditor, Cite

Dec 17 2022

Mvolz triaged T325425: VE auto citation is broken in hewiki as Unbreak Now! priority.
Dec 17 2022, 12:32 PM · Verified, Editing-team (Kanban Board), RESTbase Sunsetting, Citoid, VisualEditor

Dec 15 2022

Mvolz added a comment to T323169: Automatic cite tool no longer works with nytimes.com.

I think this bug could be closed because it doesn't seem possible to reproduce anymore. Maybe it was some temporary rate limiting.

Dec 15 2022, 2:15 PM · Citoid, Cite, VisualEditor
Mvolz closed T323169: Automatic cite tool no longer works with nytimes.com as Resolved.
Dec 15 2022, 2:14 PM · Citoid, Cite, VisualEditor
Mvolz merged T325156: Auto-link website parameter into T212112: Wikilink certain fields in the citation with citoid.
Dec 15 2022, 2:13 PM · Citoid
Mvolz merged task T325156: Auto-link website parameter into T212112: Wikilink certain fields in the citation with citoid.
Dec 15 2022, 2:13 PM · Citoid

Dec 13 2022

Mvolz added a comment to T198456: Users entering small numbers into automatic citations, expecting it to re-use an existing citation.

I mean, it does interfere, you can no longer enter pmids under 1000 (generally papers before 1975). I'm not a huge fan of this approach consequently.

Sorry, I was unclear -- I meant literally entering "PMID 1" into the field, which should result in it still generating the citation for PMID 1. Just entering "1" would no longer do it, but it should still be possible to make the citation if you know that trick. (But not "pmid 1". It's very specific.)

Screen Recording 2022-12-11 at 1.35.42 PM.gif (688×1 px, 1 MB)

(I've never tried sticking a gif into here before, so I'm curious how well that'll work.)

Dec 13 2022, 1:09 PM · User-Ryasmeen, Verified, MW-1.40-notes (1.40.0-wmf.14; 2022-12-12), Editing-team (Kanban Board), Citoid, VisualEditor-MediaWiki-References, VisualEditor

Dec 10 2022

Mvolz added a comment to T198456: Users entering small numbers into automatic citations, expecting it to re-use an existing citation.

As a starting point, that patch makes it so that pressing “generate” after you’ve entered any number less than 1000 in the auto input will switch to the reuse panel and fill in its search field with that number. The user would then be responsible for clicking the item in the search results that corresponds to the one they meant.

Enhancements to this that'd take slightly more work to implement would be:

  1. pressing generate instantly inserting the new citation without requiring confirmation
  2. making this behavior trigger when you enter any valid citation reference in the auto input (i.e. named refs would be caught as well, and numbers that aren't references to existing citations would get passed through to the regular citoid behavior)
Dec 10 2022, 8:07 AM · User-Ryasmeen, Verified, MW-1.40-notes (1.40.0-wmf.14; 2022-12-12), Editing-team (Kanban Board), Citoid, VisualEditor-MediaWiki-References, VisualEditor

Dec 3 2022

Mvolz added a comment to T321333: Please enable citoid at the Nepali Wikipedia.

@Mvolz: do you have a sense for what – if anything – is blocking us from enabling Citoid at the Nepali Wikipedia?

Dec 3 2022, 8:12 AM · VisualEditor, Citoid, VisualEditor-MediaWiki-References
Mvolz closed T321333: Please enable citoid at the Nepali Wikipedia, a subtask of T127354: Help some smaller Wikipedias' communities by writing the TemplateData and enabling citoid for them, as Resolved.
Dec 3 2022, 8:11 AM · Croatian-Sites, Dagbani-Sites, VisualEditor, Citoid, VisualEditor-MediaWiki-References
Mvolz closed T321333: Please enable citoid at the Nepali Wikipedia as Resolved.
Dec 3 2022, 8:11 AM · VisualEditor, Citoid, VisualEditor-MediaWiki-References

Nov 22 2022

Mvolz added a comment to T316835: Can't generate citation based on PMC or PMC URL.

That URL works for me now. Possibly not a block, but just slow sometimes?

Nov 22 2022, 11:33 AM · VisualEditor, Citoid
Mvolz added a comment to T54582: TemplateData: Allow hinting to specify auto-numbered parameter names in some fashion.

I think there are still a lot of templates that don’t use Lua and thus support exactly as many parameters as documented. They probably don’t show error messages if unknown parameters are used, either, since that would also require Lua. This means that the extra parameters would simply not appear – which doesn’t cause visual breakage, but it’s also hard for the editors to notice. What does Citoid do now if there are more authors/whatever data than what the template – according to TemplateData – supports?

Nov 22 2022, 11:27 AM · WMDE-References-FocusArea, Patch-For-Review, patch-welcome, ProveIt-Gadget, VisualEditor-MediaWiki, VisualEditor, TemplateData
Mvolz closed T315146: Contecatenated authors limited to 5 in extension as Resolved.
Nov 22 2022, 11:06 AM · MW-1.40-notes (1.40.0-wmf.10; 2022-11-14), Citoid

Nov 20 2022

Mvolz added a comment to T54582: TemplateData: Allow hinting to specify auto-numbered parameter names in some fashion.

In lieu of a better plan, I think I'm just going to have the Citoid extension "guess" additional parameters from the last one rather naively by incrementing whatever integer is at the end. I.e. if it's last7, the next param will be last8

Nov 20 2022, 4:55 PM · WMDE-References-FocusArea, Patch-For-Review, patch-welcome, ProveIt-Gadget, VisualEditor-MediaWiki, VisualEditor, TemplateData

Nov 16 2022

Mvolz updated subscribers of T323169: Automatic cite tool no longer works with nytimes.com.

@akosiaris I can't find anything in the logs... did we stop logging 404s or is it I am bad at finding things?

Nov 16 2022, 2:21 PM · Citoid, Cite, VisualEditor
Mvolz closed T108980: Write help page for using citoid in VisualEditor as Resolved.
Nov 16 2022, 10:03 AM · patch-welcome, Documentation, VisualEditor
Mvolz closed T108980: Write help page for using citoid in VisualEditor, a subtask of T138751: Update VisualEditor user guide, as Resolved.
Nov 16 2022, 10:03 AM · Documentation, VisualEditor
Mvolz edited Description on Citoid.
Nov 16 2022, 9:51 AM
Mvolz added a comment to T323169: Automatic cite tool no longer works with nytimes.com.

I've checked, and the urls work locally for me.

Nov 16 2022, 9:48 AM · Citoid, Cite, VisualEditor

Nov 13 2022

Mvolz reopened T108980: Write help page for using citoid in VisualEditor as "Open".
Nov 13 2022, 12:40 PM · patch-welcome, Documentation, VisualEditor
Mvolz reopened T108980: Write help page for using citoid in VisualEditor, a subtask of T138751: Update VisualEditor user guide, as Open.
Nov 13 2022, 12:39 PM · Documentation, VisualEditor
Mvolz added a comment to T108980: Write help page for using citoid in VisualEditor.

Hi folks, is this task being actively worked on or planned for the near future? If not, maybe we should remove links to https://www.mediawiki.org/wiki/Help:VisualEditor/User_guide/Citations-Full until it can be translated? We're sending people from wikis to these help pages (e.g. https://m.mediawiki.org/wiki/Help:VisualEditor/User_guide/ro ) and we would much rather have them localized.

Nov 13 2022, 12:35 PM · patch-welcome, Documentation, VisualEditor
Mvolz closed T108980: Write help page for using citoid in VisualEditor, a subtask of T138751: Update VisualEditor user guide, as Resolved.
Nov 13 2022, 12:34 PM · Documentation, VisualEditor
Mvolz closed T108980: Write help page for using citoid in VisualEditor as Resolved.
Nov 13 2022, 12:34 PM · patch-welcome, Documentation, VisualEditor

Oct 26 2022

Mvolz created T321669: Add support for page/pages field.
Oct 26 2022, 11:05 AM · Web2Cit

Oct 21 2022

Mvolz added a comment to T232565: case-sensitive equivalent of haswbstatement.

Some identifiers (such as P356) are case-insensitive, but others (such as P3083) are case-sensitive. We have no control over it, since those are identifiers in external sources. As a result, when I'm searching for haswbstatement:"P3083=* b Cen" I'm getting:

  1. https://www.wikidata.org/wiki/Q2072696#P3083 (* b Cen)
  2. https://www.wikidata.org/wiki/Q4836952#P3083 (* B Cen)

and there is no way I can limit my search to the first result only.
Either case-sensitivity parameter in search or corresponding property text in results (so I can filter second entity by myself) would work for me.

Oct 21 2022, 11:30 AM · Wikidata
Mvolz closed T242098: Citoid: Import from oria.no fails as Declined.
Oct 21 2022, 11:21 AM · Citoid
Mvolz added a comment to T242098: Citoid: Import from oria.no fails.

I think this is because the examples you mentioned use JavaScript for rendering the final page, and as far as I know the Citoid server does not render JavaScript content. That is, it works on the webpages' source code as returned from the web server.

Oct 21 2022, 11:20 AM · Citoid

Sep 13 2022

Mvolz added a comment to T317387: Visual Editor > Cite Automatic is creating cite journal for URLs.

Realistically, we can't do anything about bad metadata on websites upstream, other than the workaround @diegodlh has mentioned, so closing this!

Sep 13 2022, 6:53 PM · VisualEditor, Citoid
Mvolz closed T317387: Visual Editor > Cite Automatic is creating cite journal for URLs as Declined.
Sep 13 2022, 6:51 PM · VisualEditor, Citoid

Sep 8 2022

Mvolz updated the task description for T290750: Migrate node-based services in production to node12.
Sep 8 2022, 10:33 AM · Similar Editors, Recommendation-API, Image-Suggestion-API, EventStreams, ChangeProp, Patch-For-Review, serviceops, SRE
Mvolz closed T290753: Migrate citoid and zotero production services to node12, a subtask of T290750: Migrate node-based services in production to node12, as Resolved.
Sep 8 2022, 10:32 AM · Similar Editors, Recommendation-API, Image-Suggestion-API, EventStreams, ChangeProp, Patch-For-Review, serviceops, SRE
Mvolz closed T290753: Migrate citoid and zotero production services to node12 as Resolved.
Sep 8 2022, 10:32 AM · SRE, Editing-team, Citoid

Sep 2 2022

Mvolz added a comment to T316835: Can't generate citation based on PMC or PMC URL.

I'd guess we've been blocked for too much traffic.

Sep 2 2022, 5:24 PM · VisualEditor, Citoid

Aug 31 2022

Mvolz moved T315771: Citoid has no php tests from Backlog to Extension on the Citoid board.
Aug 31 2022, 1:26 PM · VisualEditor-MediaWiki-References, VisualEditor, Citoid, Technical-Debt, Test-Coverage

Aug 21 2022

Mvolz renamed T315771: Citoid has no php tests from Citoid has no tests to Citoid has no php tests.
Aug 21 2022, 1:08 PM · VisualEditor-MediaWiki-References, VisualEditor, Citoid, Technical-Debt, Test-Coverage

Aug 18 2022

Mvolz closed T268419: ve adds unix timestamp as date in cs1|2 templates as Resolved.
Aug 18 2022, 10:23 AM · Wikimania-Hackathon-2022, Citoid, VisualEditor

Aug 14 2022

Mvolz added a comment to T278704: Please import citation templates and set up citoid for the Twi Wikipedia.

I have enabled this, however it probably needs a lot of translation work - I have attempted it using google translate so I expect it has not turned out great

Aug 14 2022, 10:24 AM · Wikimania-Hackathon-2022, Citoid
Mvolz closed T278704: Please import citation templates and set up citoid for the Twi Wikipedia as Resolved.
Aug 14 2022, 10:15 AM · Wikimania-Hackathon-2022, Citoid

Aug 13 2022

Mvolz created T315146: Contecatenated authors limited to 5 in extension.
Aug 13 2022, 11:28 AM · MW-1.40-notes (1.40.0-wmf.10; 2022-11-14), Citoid
Mvolz claimed T268419: ve adds unix timestamp as date in cs1|2 templates.
Aug 13 2022, 10:20 AM · Wikimania-Hackathon-2022, Citoid, VisualEditor

Aug 12 2022

Mvolz updated the task description for T268419: ve adds unix timestamp as date in cs1|2 templates.
Aug 12 2022, 4:00 PM · Wikimania-Hackathon-2022, Citoid, VisualEditor
Mvolz merged T296942: Citoid does not interpret unix timestamps as dates into T268419: ve adds unix timestamp as date in cs1|2 templates.
Aug 12 2022, 3:59 PM · Wikimania-Hackathon-2022, Citoid, VisualEditor
Mvolz merged task T296942: Citoid does not interpret unix timestamps as dates into T268419: ve adds unix timestamp as date in cs1|2 templates.
Aug 12 2022, 3:59 PM · Citoid
Mvolz moved T289287: Add support for the 'Cite Q' template to Citoid from Backlog to Extension on the Citoid board.
Aug 12 2022, 3:57 PM · WMDE-References-FocusArea, VisualEditor-MediaWiki-References, VisualEditor, WikiCite, Citoid
Mvolz moved T306049: Upgrade deployment-docker-citoid01 host to Buster from Backlog to Production on the Citoid board.
Aug 12 2022, 3:57 PM · Editing-team, Citoid, Beta-Cluster-Infrastructure
Mvolz moved T290753: Migrate citoid and zotero production services to node12 from Backlog to Production on the Citoid board.
Aug 12 2022, 3:56 PM · SRE, Editing-team, Citoid

Jul 21 2022

Mvolz claimed T290753: Migrate citoid and zotero production services to node12.
Jul 21 2022, 10:31 AM · SRE, Editing-team, Citoid
Mvolz closed T307591: Citoid ignores query string parameters for non-www urls without protocol as Resolved.
Jul 21 2022, 10:21 AM · Citoid

Jul 19 2022

Mvolz updated the task description for T312852: Update all services to node 12.
Jul 19 2022, 1:42 PM · Technical-Debt, WMDE-TechWish-Maintenance, Math, Product-Infrastructure-Team-Backlog-Deprecated, ChangeProp, EventStreams, Maps (Tilerator), service-template-node, Proton, Recommendation-API, HyperSwitch, Mathoid, Citoid, Platform Engineering
Mvolz updated the task description for T312852: Update all services to node 12.
Jul 19 2022, 1:00 PM · Technical-Debt, WMDE-TechWish-Maintenance, Math, Product-Infrastructure-Team-Backlog-Deprecated, ChangeProp, EventStreams, Maps (Tilerator), service-template-node, Proton, Recommendation-API, HyperSwitch, Mathoid, Citoid, Platform Engineering

Jul 12 2022

Mvolz updated the task description for T312852: Update all services to node 12.
Jul 12 2022, 1:11 PM · Technical-Debt, WMDE-TechWish-Maintenance, Math, Product-Infrastructure-Team-Backlog-Deprecated, ChangeProp, EventStreams, Maps (Tilerator), service-template-node, Proton, Recommendation-API, HyperSwitch, Mathoid, Citoid, Platform Engineering
Mvolz created T312852: Update all services to node 12.
Jul 12 2022, 12:51 PM · Technical-Debt, WMDE-TechWish-Maintenance, Math, Product-Infrastructure-Team-Backlog-Deprecated, ChangeProp, EventStreams, Maps (Tilerator), service-template-node, Proton, Recommendation-API, HyperSwitch, Mathoid, Citoid, Platform Engineering

Jul 5 2022

Mvolz added a comment to T201636: The staff page does not show teams/sub-teams anymore which makes it considerably less useful.

(Looks resolved to me now)

Jul 5 2022, 2:43 PM · wikimediafoundation.org
Mvolz closed T201636: The staff page does not show teams/sub-teams anymore which makes it considerably less useful as Resolved.
Jul 5 2022, 2:43 PM · wikimediafoundation.org
Mvolz added a comment to T302521: Citoid ISBN lookup not working.

Copying from the other thread -

Jul 5 2022, 1:24 PM · Citoid

Jul 1 2022

Mvolz updated subscribers of T302521: Citoid ISBN lookup not working.

@akosiaris - looks like for the last week or so we're getting hammered for isbn requests so much it's made the current error rate like 70% -> https://grafana.wikimedia.org/d/NJkCVermz/citoid?orgId=1&from=now-30d&to=now&refresh=5m

Jul 1 2022, 8:49 AM · Citoid

Jun 14 2022

Mvolz claimed T307591: Citoid ignores query string parameters for non-www urls without protocol.
Jun 14 2022, 12:00 PM · Citoid

Jun 5 2022

Mvolz created T309940: Template Editor should open up template data for the whole page even whilst section editing in 2017 wikitext editor.
Jun 5 2022, 9:15 AM · VisualEditor, VisualEditor-MediaWiki-2017WikitextEditor, TemplateData

Jun 2 2022

Mvolz added a comment to T305574: Consider using a hierarchy of configuration files.

Another point is that having separate templates for separate wikis would allow wikilinking to pages in the fields (i.e. the publisher, for instance). (Relevant mailing list discussion here: https://lists.wikimedia.org/hyperkitty/list/webtocit@lists.wikimedia.org/thread/HRYDDXA6MLTKBEV477H6FMZ4CBSNVGS4/)

Jun 2 2022, 6:50 PM · Web2Cit
Mvolz closed T309645: Web2Cit template debug output seems okay (for some fields), but still not seeing template it being used in gadget. as Resolved.
Jun 2 2022, 6:42 PM · Web2Cit

May 31 2022

Mvolz created T309645: Web2Cit template debug output seems okay (for some fields), but still not seeing template it being used in gadget. .
May 31 2022, 5:10 PM · Web2Cit

May 30 2022

Mvolz closed T308433: VisualEditor apparently creates malformed |volume= parameter values in cs1|2 templates (en.wiki) as Resolved.
May 30 2022, 11:21 AM · VisualEditor
Mvolz added a comment to T308433: VisualEditor apparently creates malformed |volume= parameter values in cs1|2 templates (en.wiki).

Ah, and only volume but not issue was in the suggested params - so they didn't probably notice you could add the issue separately. Fixed: https://en.wikipedia.org/w/index.php?title=Template:Cite_journal/doc&type=revision&diff=1090606937&oldid=1090605535&diffmode=source

May 30 2022, 11:06 AM · VisualEditor
Mvolz added a comment to T309251: PubMed source dates with no day.

We used to add 01 as the day. This made people mad due to "false precision". As has nearly every other way I've tried to resolve this. There is extensive discussion on the other thread if you want to weigh in there!

May 30 2022, 10:59 AM · Citoid, VisualEditor
Mvolz merged T309251: PubMed source dates with no day into T132308: Internationalise citoid dates.
May 30 2022, 10:59 AM · User-notice, User-Josve05a, VisualEditor, Citoid
Mvolz merged task T309251: PubMed source dates with no day into T132308: Internationalise citoid dates.
May 30 2022, 10:57 AM · Citoid, VisualEditor
Mvolz added a comment to T308433: VisualEditor apparently creates malformed |volume= parameter values in cs1|2 templates (en.wiki).

A potential fix could be change the template data type - currently issue and volume are both set to "line" and it could be set to "number". However if you have, for instance, a "summer" issue, then that would prevent people from using that. Other than validating it against the type, there's currently no way to validate it more specifically than that.

May 30 2022, 10:56 AM · VisualEditor
Mvolz removed a project from T308433: VisualEditor apparently creates malformed |volume= parameter values in cs1|2 templates (en.wiki): Citoid.
May 30 2022, 10:42 AM · VisualEditor
Mvolz added a comment to T308433: VisualEditor apparently creates malformed |volume= parameter values in cs1|2 templates (en.wiki).

Now having looked at the examples, these can't be from citoid because they're both pdf links which citoid doesn't do. Potentially user error?

May 30 2022, 10:41 AM · VisualEditor
Mvolz added a comment to T308433: VisualEditor apparently creates malformed |volume= parameter values in cs1|2 templates (en.wiki).
May 30 2022, 10:40 AM · VisualEditor
Mvolz triaged T308433: VisualEditor apparently creates malformed |volume= parameter values in cs1|2 templates (en.wiki) as Medium priority.
May 30 2022, 10:39 AM · VisualEditor

May 24 2022

Mvolz added a comment to T305574: Consider using a hierarchy of configuration files.

At Wikimedia Hackathon 2022's Web2Cit session (T308449), @Mvolz commented that having separate Web2Cit configurations per Wikipedia may be useful for the specific case described in T132308. That is, that incomplete dates returned by Citoid (e.g., 2010-12, meaning December 2010) throw an error in English Wikipedia citation templates, to avoid confusion with date ranges (i.e., 2010-2012). As described there, it was tried with -XX at the end (i.e., 2010-12-XX), but whereas accepted by English Wikipedia, it was rejected by other Wikipedias.

If this is the only case where we would benefit from having different Web2Cit/Citoid response format between Wikipedias, I think that it would be outweighed by the benefits of having one single set of common Web2Cit configurations across Wikipedias (i.e., the benefit of a larger community). I've added a comment to T132308 with an idea of how this could be sorted out at the Citoid extension's level.

@Mvolz, can you think of where we may benefit from having separate Web2Cit configurations per Wikipedia? Thanks!

May 24 2022, 11:54 AM · Web2Cit

Apr 28 2022

Mvolz added a comment to T225415: Tests hang when running full citoid suite with node 11 and higher.

Tried with 12 and it's fine now :).

Apr 28 2022, 10:43 AM · Citoid
Mvolz closed T225415: Tests hang when running full citoid suite with node 11 and higher as Invalid.
Apr 28 2022, 10:42 AM · Citoid

Apr 7 2022

Mvolz added a comment to T205870: Fully migrate producers off statsd.

This is now deployed for citoid.

This is great to see! Thanks for your help @Mvolz

I have updated grafana for the most part, however there are a few (minor) metrics this broke which relied on the service-runner native ones; quantiles by status and method are broken, but quantiles overall are still working. I'm not sure how to fix them but I'm not sure how essential those are since it's the same info but just broken down a bit.

Garbage collection metrics have been broken for a while, as have memory pod metrics, and that's not related to this change.

ack, please feel free to contact us (SRE o11y) for assistance with the missing/broken metrics if needed

Apr 7 2022, 4:31 PM · Observability-Metrics, MW-1.38-notes (1.38.0-wmf.4; 2021-10-12), Goal, Performance-Team (Radar), Patch-For-Review, SRE
Mvolz added a comment to T205870: Fully migrate producers off statsd.

This is now deployed for citoid.

Apr 7 2022, 11:25 AM · Observability-Metrics, MW-1.38-notes (1.38.0-wmf.4; 2021-10-12), Goal, Performance-Team (Radar), Patch-For-Review, SRE
Mvolz updated the task description for T205870: Fully migrate producers off statsd.
Apr 7 2022, 11:22 AM · Observability-Metrics, MW-1.38-notes (1.38.0-wmf.4; 2021-10-12), Goal, Performance-Team (Radar), Patch-For-Review, SRE

Apr 5 2022

Mvolz created T305456: Upgrade to use node 12.
Apr 5 2022, 12:24 PM · service-template-node

Mar 29 2022

Mvolz added a comment to T291707: zotero paging / serving 5xxes after CPU spikes.

In terms of a get endpoint, would swagger docs suffice? I started to do something like that but never got around to finishing it :/ https://github.com/zotero/translation-server/issues/76

That would work fine. Many thanks for working on that!

In review -> https://github.com/zotero/translation-server/pull/131

@Mvolz, care to ping upstream again on that one? It's 6 months already.

We had another slew of pages disrupting our weekend as SREs. Pages we could literally do nothing else than just restart things and hope the problem doesn't show up again. This is not sustainable and is demoralizing long term, I am afraid that if this continues SRE will have to pull support for zotero and stop receiving pages for incidents/outages/degradations the service faces.

Judging from the graphs, https://w.wiki/4zi8 we still had spare capacity (14 replicas and at most 9 were fully utilized) and could serve requests. So if we had this get endpoint to use as a readiness probe, kubernetes would have automatically depooled the non responsive instances until they were responsive again leading to no user-visible issues for end users.

Mar 29 2022, 8:58 AM · Patch-For-Review, serviceops, Citoid

Mar 2 2022

Mvolz added a comment to T302521: Citoid ISBN lookup not working.

It's probable we ran into our request limit with worldcat, but I can't find any obvious spike on the 24th like we've had in the past with bots eating up our requests. It's working for now - we should perhaps improve metrics/ tracking to alert us when we go over our request limit.

Mar 2 2022, 11:28 AM · Citoid
Mvolz added a comment to T301510: Optimize large number of Citoid requests for coverage estimation research project.

I've been looking into Citoid API request rate limits.

We access the Citoid API through Wikmedia's RESTBase proxy. I found two 429 HyperSwitch errors for exceeded request rates: https://www.mediawiki.org/wiki/HyperSwitch/errors/rate_exceeded and https://www.mediawiki.org/wiki/HyperSwitch/errors/request_rate_exceeded

Here it says that there is a global limit of up to 200 requests per second, but that individual endpoints may have specific limits. However, the Citoid API documentation doesn't seem to say anything about it.

On the other hand, I found this thread where @Mvolz mentions a "1000/10s (100/s long term, with 1000 burst)" limit.

She also refers to how long requests take and timeouts, but I'm not sure what she means. How does time to response affect request rate limit? Say we make 1000 requests at t=0s of which only 500 have returned a response at t=10s, can we make another 1000-request batch now? Or do pending requests count against our request rate limit?

Mar 2 2022, 11:04 AM · Web2Cit-Research, Citoid

Jan 27 2022

Mvolz created T300257: console.logging proxy metrics object fails because it doesn't recognise "util.inspect.custom" as a valid property.
Jan 27 2022, 2:48 PM · service-runner

Jan 25 2022

Mvolz added a comment to T299981: Improving cite extraction from URLs when the author has one or two surnames (Basque, Spanish...).

This is very cool! The short answer is - it would be very difficult to integrate this into the actual service we use. It uses a web scraper (Zotero) and each website is parsed by a different translator.

Jan 25 2022, 2:36 PM · Citoid

Jan 6 2022

Mvolz renamed T298427: Zotero translator needed to get correct author for Condé Nast requests from Zotero translator for Tatler/Teen Vogue request to Zotero translator needed to get correct author for Tatler/Teen Vogue requests.
Jan 6 2022, 1:31 PM · VisualEditor, Citoid
Mvolz renamed T298427: Zotero translator needed to get correct author for Condé Nast requests from Citoid incorrectly inserts "Condé Nast" as author in references to Zotero translator for Tatler/Teen Vogue request.
Jan 6 2022, 1:31 PM · VisualEditor, Citoid
Mvolz moved T298427: Zotero translator needed to get correct author for Condé Nast requests from Backlog to Zotero on the Citoid board.
Jan 6 2022, 1:30 PM · VisualEditor, Citoid
Mvolz added a comment to T298427: Zotero translator needed to get correct author for Condé Nast requests.

Unfortunately this is a case where you would have to write a custom translator for zotero (see https://www.mediawiki.org/wiki/Citoid#My_favourite_site_isn't_recognised_by_citoid_and_only_gets_basic_information) for these sites.

Jan 6 2022, 1:30 PM · VisualEditor, Citoid

Nov 5 2021

Mvolz added a comment to T294010: Automatic citation generation using ISBN on Wikipedia doesn't work.

It's ~70 rps at those peaks. They are most definitely violating https://www.mediawiki.org/wiki/API:Etiquette (even if we don't have hard numbers in that page) and we can take action against that. A quick look at turnilo shows a single AWS IP with a user agent of Apache-HttpClient/4.5.6 (Java/1.8.0_265) doing the vast majority of these calls in the last day (>85%).

I 've gone ahead and added them to our abuser lists (in the private repo). It will take some 30 minutes to propagate fully, but after that they should receive back a 403 asking them to contact noc@wikimedia.org.

To be fair, https://en.wikipedia.org/api/rest_v1/ says limit it to 200 r/s.

I had forgotten about that. Good point.

Unfortunately even 1r/s would eat up our quota. We could add more specific documentation to citoid on the page.

Yup, we should do that. Having a global recommendation that is incompatible with more specific services like Citoid isn't good decorum. Thanks for bringing it up!

Nov 5 2021, 9:16 AM · WMSE-Bug-Reporting-and-Translation-2021, serviceops, Editing-team (Kanban Board), Citoid, VisualEditor, User-JosefineHellrothLarssonWMSE

Nov 4 2021

Mvolz added a comment to T294010: Automatic citation generation using ISBN on Wikipedia doesn't work.

It's ~70 rps at those peaks. They are most definitely violating https://www.mediawiki.org/wiki/API:Etiquette (even if we don't have hard numbers in that page) and we can take action against that. A quick look at turnilo shows a single AWS IP with a user agent of Apache-HttpClient/4.5.6 (Java/1.8.0_265) doing the vast majority of these calls in the last day (>85%).

I 've gone ahead and added them to our abuser lists (in the private repo). It will take some 30 minutes to propagate fully, but after that they should receive back a 403 asking them to contact noc@wikimedia.org.

Nov 4 2021, 11:43 AM · WMSE-Bug-Reporting-and-Translation-2021, serviceops, Editing-team (Kanban Board), Citoid, VisualEditor, User-JosefineHellrothLarssonWMSE