mvolz@wikimedia.org
User Details
- User Since
- Oct 15 2014, 9:50 PM (402 w, 7 h)
- Availability
- Available
- IRC Nick
- Mvolz
- LDAP User
- Mvolz
- MediaWiki User
- Mvolz (WMF) [ Global Accounts ]
Tue, Jun 14
Sun, Jun 5
Thu, Jun 2
Another point is that having separate templates for separate wikis would allow wikilinking to pages in the fields (i.e. the publisher, for instance). (Relevant mailing list discussion here: https://lists.wikimedia.org/hyperkitty/list/webtocit@lists.wikimedia.org/thread/HRYDDXA6MLTKBEV477H6FMZ4CBSNVGS4/)
Tue, May 31
May 30 2022
Ah, and only volume but not issue was in the suggested params - so they didn't probably notice you could add the issue separately. Fixed: https://en.wikipedia.org/w/index.php?title=Template:Cite_journal/doc&type=revision&diff=1090606937&oldid=1090605535&diffmode=source
We used to add 01 as the day. This made people mad due to "false precision". As has nearly every other way I've tried to resolve this. There is extensive discussion on the other thread if you want to weigh in there!
A potential fix could be change the template data type - currently issue and volume are both set to "line" and it could be set to "number". However if you have, for instance, a "summer" issue, then that would prevent people from using that. Other than validating it against the type, there's currently no way to validate it more specifically than that.
Now having looked at the examples, these can't be from citoid because they're both pdf links which citoid doesn't do. Potentially user error?
May 24 2022
Apr 28 2022
Tried with 12 and it's fine now :).
Apr 7 2022
This is now deployed for citoid.
Apr 5 2022
Mar 29 2022
Mar 2 2022
It's probable we ran into our request limit with worldcat, but I can't find any obvious spike on the 24th like we've had in the past with bots eating up our requests. It's working for now - we should perhaps improve metrics/ tracking to alert us when we go over our request limit.
Jan 27 2022
Jan 25 2022
This is very cool! The short answer is - it would be very difficult to integrate this into the actual service we use. It uses a web scraper (Zotero) and each website is parsed by a different translator.
Jan 6 2022
Unfortunately this is a case where you would have to write a custom translator for zotero (see https://www.mediawiki.org/wiki/Citoid#My_favourite_site_isn't_recognised_by_citoid_and_only_gets_basic_information) for these sites.
Nov 5 2021
Nov 4 2021
It's ~70 rps at those peaks. They are most definitely violating https://www.mediawiki.org/wiki/API:Etiquette (even if we don't have hard numbers in that page) and we can take action against that. A quick look at turnilo shows a single AWS IP with a user agent of Apache-HttpClient/4.5.6 (Java/1.8.0_265) doing the vast majority of these calls in the last day (>85%).
I 've gone ahead and added them to our abuser lists (in the private repo). It will take some 30 minutes to propagate fully, but after that they should receive back a 403 asking them to contact noc@wikimedia.org.
Nov 2 2021
Oct 29 2021
This paints a nice picture. https://grafana.wikimedia.org/d/NJkCVermz/citoid?orgId=1&from=1635185829182&to=1635189452614 something is eating up our isbn requests for about a half hour, they keep going for a half our after that with all the requests getting 404ed, and then the requests stop.
Oct 28 2021
According to WorldCat we're probably exceeding a usage cap of 50,000 requests a day.
Oct 27 2021
Oct 22 2021
Oct 21 2021
Thank you to @Dzahn in ops for rotating the keys! It looks all fixed now.
I have checked and can confirm locally that the key we use for worldcat in production is no longer working, whereas our other keys still work. However, according to Worldcat dashboard the key has not exceeded usage and is not blocked. I can try rotating the key and see if that works, otherwise will need to get in touch with support. It might have just been dropped from their db or something and reissuing might do the trick.
Oct 5 2021
In terms of a get endpoint, would swagger docs suffice? I started to do something like that but never got around to finishing it :/ https://github.com/zotero/translation-server/issues/76
That would work fine. Many thanks for working on that!
Sep 29 2021
Sep 28 2021
The PDF connection might be a red herring because although that's what happened in the past, attempting to translate those was disabled here: https://github.com/zotero/translation-server/issues/68
Sep 17 2021
Sep 14 2021
Sep 10 2021
Sep 8 2021
Could Legal do it?
Sep 3 2021
Sep 2 2021
A slightly edge-casey library is https://github.com/wikimedia/html-metadata which is not on gerrit and is also an npm package, so I'll need to point npm to the new location (Come to think of it I might be the only one with the rights to do that since mobrovac left? need to fix..). Happy to do that earlier rather than later but not be helpful as a template for other repos.
I think at this stage it makes sense to just move to gitlab instead so change the task to that ^-^
Aug 14 2021
Aug 13 2021
Aug 12 2021
Aug 6 2021
Aug 5 2021
Jul 9 2021
I can temporarily silence this if you want, by commenting out the offending test and redeploying, at least for the time being? Doesn't seem to actually affect operation, at least. We used to actually probe www.example.com but that would cause errors like this too, and switched to our own stuff so uptime would be concurrent... is it a temporary DNS issue do you think?
Jun 30 2021
Jun 28 2021
Jun 27 2021
Jun 23 2021
Jun 21 2021
Jun 10 2021
connectivity hiccup probably
Jun 8 2021
Jun 3 2021
Not sure if this a temporary hiccup / just things timing out, and if I should just try to deploy again or something more serious so filing :)
May 28 2021
May 20 2021
Not all citation templates have a DOI field, and only have a URL field. As long as we have this information, we should provide it, because some consumers will prefer to use the URL. If en wiki prefers to remove these with bots that's a preferred option imo. We can't delete fields that are being used on other wikis in the back-end just because of policy in en wiki.
May 19 2021
@zeljkofilipin Thalia's handle is Tchanders but for some reason when I try to actually tag her it breaks Phabricator.
Came across this as well - triggered in reftoolbar (https://en.wikipedia.org/wiki/MediaWiki:RefToolbar.js) found this archived topic where it's suggested it's due to Ace being outdated and it's since been fixed* https://www.mediawiki.org/wiki/Topic:Tat8gxmbmjtpn5dl