Page MenuHomePhabricator

Multichill (Maarten Dammers)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 14 2014, 3:01 PM (343 w, 1 d)
Availability
Available
IRC Nick
multichilll
LDAP User
Multichill
MediaWiki User
Multichill [ Global Accounts ]

Pywikibot, Wikidata, i18n, GLAM stuff

Recent Activity

Sat, May 8

Multichill closed T282222: SPARQL query for all painting stopped returning results as Resolved.

My bad, the depool command I ran this morning did not work due to an error running the command (I ran sudo depool wdqs1012 instead of sudo depool so it depooled the service wdqs1012 which is nonexistent).

For the record I ran the proper command now:

dcausse@wdqs1012:~$ sudo depool
Depooling all services on wdqs1012.eqiad.wmnet
eqiad/wdqs/wdqs/wdqs1012.eqiad.wmnet: pooled changed yes => no
eqiad/wdqs/wdqs-heavy-queries/wdqs1012.eqiad.wmnet: pooled changed yes => no
eqiad/wdqs/wdqs-ssl/wdqs1012.eqiad.wmnet: pooled changed yes => no

This server should stop receiving traffic now.

Sat, May 8, 10:20 AM · Wikidata, Wikidata-Query-Service

Fri, May 7

Multichill created T282222: SPARQL query for all painting stopped returning results.
Fri, May 7, 9:10 AM · Wikidata, Wikidata-Query-Service

Tue, May 4

Multichill awarded T281854: Get baseline measurements/expectations for splitting scholarly articles from Wikidata a Meh! token.
Tue, May 4, 7:27 PM · Wikidata, Wikidata-Query-Service

Thu, Apr 29

Multichill added a comment to T266155: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails.

As a work around on pages like https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Old_European_art_missing_genre/Sweden where most thumbnails don't work:
wget -E -H -k -K -p https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Old_European_art_missing_genre/Sweden

Thu, Apr 29, 5:20 PM · StructuredDataOnCommons, Patch-For-Review, SRE, MediaWiki-File-management, Thumbor, Commons
Multichill created T281468: Automatic SI unit conversion not working on Commons SPARQL engine.
Thu, Apr 29, 11:53 AM · Wikidata-Campsite, wdwb-tech, Wikidata, DataValues, Wikidata-Query-Service, SDC General, Commons

Mar 20 2021

Multichill added a comment to T277665: [L] Determine an IRI to join commons mediainfo entities and wikidata properties referencing commons images.

File names are bad URI's. Files get renamed all the time (see https://commons.wikimedia.org/w/index.php?title=Special:Log&offset=&limit=500&type=move ) causing all sorts of breakage. The pageid stays the same so the mediaid also stays the same. That's a much more stable identifier.

Mar 20 2021, 11:44 AM · Structured-Data-Backlog (Current Work), WikibaseMediaInfo

Mar 17 2021

Multichill reopened T258776: Add Structured Data on Commons M-ID to Wikidata dumps as "Open".

I'm going to close this as a duplicate of T277665 as that is what we see as the practical solution to this problem. Please re-open if you don't think that will solve your use case.

Mar 17 2021, 8:52 PM · StructuredDataOnCommons, Wikidata-Query-Service, Wikidata

Mar 7 2021

Multichill moved T276718: Move captions from file information to structured data tab from Unsorted to Single wikis on the Community-consensus-needed board.
Mar 7 2021, 6:35 PM · Community-consensus-needed, Commons, StructuredDataOnCommons
Multichill created T276718: Move captions from file information to structured data tab.
Mar 7 2021, 6:31 PM · Community-consensus-needed, Commons, StructuredDataOnCommons
Multichill added a comment to T258590: Change incorrect usage of HTTP to HTTPS for concept URIs on Commons.

Note that the SD team work to change the Concept URIs in Commons is estimated to be a small.

Mar 7 2021, 6:19 PM · Patch-For-Review, Structured-Data-Backlog (Current Work), StructuredDataOnCommons, Commons, Wikidata-Query-Service, Wikidata
Multichill created T276710: Include sha1 in mediainfo rdf.
Mar 7 2021, 2:54 PM · Commons, StructuredDataOnCommons

Mar 3 2021

Multichill added a comment to T166094: Allow editors to provide default alt text on Wikimedia Commons file description pages.

No we don't, captions are just labels, see https://commons.wikimedia.org/wiki/Special:EntityData/M96527.json . Description is currently unused in SDOC.

Well, perhaps the variable is called label in the code, but in the Wikipedia app, people are being asked to fill these fields as image captions. So it's a bit of a conflicting usage of that specific field right now (descriptions on Commons, captions in the Wikipedia app), but neither of them are for the purpose of alt text. Which means it would be a huge work cleaning up before it would be useable even if we started to designate that field for it. Better start fresh in my opinion (and if the label/description/caption field is redundant in your opinion, then suggest remove it in a separate ticket).

Mar 3 2021, 6:53 PM · User-Tgr, Commons, Accessibility, Wikidata, SDC General
Multichill added a comment to T166094: Allow editors to provide default alt text on Wikimedia Commons file description pages.

Well, then we need a new field for the caption. They are not meant to solve the same problem and should almost always be different from each other. So for every image it would be very useful with two separate text fields.

Mar 3 2021, 12:29 PM · User-Tgr, Commons, Accessibility, Wikidata, SDC General

Mar 2 2021

Multichill added a comment to T166094: Allow editors to provide default alt text on Wikimedia Commons file description pages.

Why are we not using the description field for this? Seems more sensible to me than creating new properties

Mar 2 2021, 10:38 PM · User-Tgr, Commons, Accessibility, Wikidata, SDC General
Multichill updated subscribers of T258776: Add Structured Data on Commons M-ID to Wikidata dumps.

The URI for the image is https://commons.wikimedia.org/entity/M6919529 (yes, https, not http, that got messed up, see T258590). You can see an RDF representation of that at https://commons.wikimedia.org/entity/M6919529.rdf . We should someone include this URI on Wikidata too. The royal way would be to update the image data type which accepts the Mediainfo ID and does all the logic like the current image data type.

Mar 2 2021, 3:07 PM · StructuredDataOnCommons, Wikidata-Query-Service, Wikidata
Multichill renamed T258590: Change incorrect usage of HTTP to HTTPS for concept URIs on Commons from Decide on HTTP vs HTTPS for concept URIs on Commons to Change incorrect usage of HTTP to HTTPS for concept URIs on Commons.
Mar 2 2021, 2:46 PM · Patch-For-Review, Structured-Data-Backlog (Current Work), StructuredDataOnCommons, Commons, Wikidata-Query-Service, Wikidata

Mar 1 2021

Multichill added a comment to T275787: Faceted search for Commons location of creation.

@CBogen why did you remove the search projects? This looks very search to me.

The Discovery-Search project is mainly for backend search work; this is a front-end project in MediaSearch on Commons so it would be part of the Structured Data team's purview.

Mar 1 2021, 6:55 PM · Structured-Data-Backlog, Wikidata, Commons, SDC General

Feb 27 2021

Multichill added a comment to T275787: Faceted search for Commons location of creation.

We now have more than 1 million files with location of creation on Commons, see https://commons.wikimedia.org/w/index.php?search=haswbstatement%3AP1071&title=Special%3ASearch

Feb 27 2021, 8:43 AM · Structured-Data-Backlog, Wikidata, Commons, SDC General

Feb 25 2021

Spinster awarded T275787: Faceted search for Commons location of creation a 100 token.
Feb 25 2021, 4:32 PM · Structured-Data-Backlog, Wikidata, Commons, SDC General
Multichill created T275787: Faceted search for Commons location of creation.
Feb 25 2021, 4:19 PM · Structured-Data-Backlog, Wikidata, Commons, SDC General
Multichill renamed T195680: Faceted search toolinfo from Faceted search to Faceted search toolinfo.
Feb 25 2021, 3:57 PM · User-bd808, Developer-Advocacy (Jan-Mar 2021), Goal, Toolhub
Multichill renamed T271377: API for faceted search toolinfo from API for faceted search to API for faceted search toolinfo.
Feb 25 2021, 3:57 PM · User-bd808, Developer-Advocacy (Jan-Mar 2021), Toolhub
Multichill renamed T271383: UI for faceted search toolinfo from UI for faceted search to UI for faceted search toolinfo.
Feb 25 2021, 3:57 PM · User-bd808, Goal, Developer-Advocacy (Jan-Mar 2021), Toolhub

Feb 21 2021

Multichill added a comment to T275286: SDC: Suppress usual UI display of a property when its number of statements is very large.

If it aint' broken, don't fix it? Let's just see what happens and if anything explodes, than focus on fixing that.

Feb 21 2021, 12:34 PM · SDC General, Wikidata

Feb 13 2021

Multichill added a comment to T269539: Image with 'P4765/Commons compatible image available at url' is not picked up by bot to be uploaded to Commons.

Wrote https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Automated_image_uploads and shared the link by email some time ago.

Feb 13 2021, 6:07 PM · Koninklijke-Bibliotheek-Team-Wiki

Feb 9 2021

Multichill added a comment to T271105: wbeditentity response does not contain lemma data.

This change is subject to the https://www.wikidata.org/wiki/Wikidata:Stable_Interface_Policy . Please complete the steps listed there.

Can you clarify which part of the policy you think hasn’t been followed so far?

Feb 9 2021, 11:19 AM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), Wikidata, Wikidata Lexicographical data

Feb 8 2021

Multichill added a comment to T271105: wbeditentity response does not contain lemma data.

This change is subject to the https://www.wikidata.org/wiki/Wikidata:Stable_Interface_Policy . Please complete the steps listed there.

Feb 8 2021, 6:26 PM · MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), Wikidata, Wikidata Lexicographical data

Feb 2 2021

Multichill added a comment to T273110: Using Structured Data on Commons in file pages.

I obviously like getting more structured data and better usage, but I see some issues with this task: The scope seems to be very broad. Is this intentional? What kind of time investment is expected? Might have a higher chance of making a difference when it's more tightly scoped. We have several steps in the process and possible tasks related to it:

  • Convert existing data from wikitext to structured data. This is already happening on a small subset, but on a large scale. Not controversial as long as you don't remove any data. Still a ton of work to do here, but quite a few things are not clear yet on how to model things. Building some kind of workflow to extract knowledge from the category tree and show it to users for approval would be extremely useful.
  • Show the structured data in a pretty way. You already mentioned some examples, https://commons.wikimedia.org/wiki/Module:Artwork and https://commons.wikimedia.org/wiki/Module:Information . The current approach here is to do incremental improvements without changing the look and view from what it used to be. You can also take a radical different approach like skins: You make another implementation for the same data with a completely different look and feel. With some logic logged-in users can enable this new template skin. That way you can experiment quite freely without disturbing the Monobook people. This task would be fun for someone who is on the edge of development and design.
Feb 2 2021, 7:29 PM · Outreach-Programs-Projects

Jan 21 2021

Multichill added a comment to T269609: Ensure all ToolsDB databases comply with current naming conventions.

Reasoning why the convention is suddenly enforced are missing. Instructions on how to fix are also missing.

Jan 21 2021, 5:49 PM · Developer-Advocacy (Apr-Jun 2021), cloud-services-team (Kanban), Data-Services

Jan 18 2021

Multichill added a comment to T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem).

Checked a couple of these inconsistencies and they appear to all be out of order in the kafka topics. I suggest to disable async imports as I believe it might be possible cause of these inconsistencies.

Jan 18 2021, 6:00 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Jan 17 2021

Multichill added a comment to T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem).

@RKemper so what's the status of this? I see a lot of cases where the last edit didn't get processed so the data in SPARQL is not consistent. See https://w.wiki/ugf for some examples.

Jan 17 2021, 5:11 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Jan 14 2021

Multichill added a comment to T180113: Support the creation and use of volunteer tools that help to convert information in Commons categories to structured data.

@CBogen Hi, can you help me figure out if this is needed, otherwise I'd like to resolve. Thanks.

Jan 14 2021, 9:35 PM · CommRel-Specialists-Support, Wikidata, SDC General

Jan 6 2021

Multichill added a comment to T270522: [16hrs] Investigate Infrequent JobQueueErrors on Wikidata.

Just had it again:
pywikibot.data.api.APIMWException: internal_api_error_JobQueueError: [X-VEtQpAIDkAAHaGUqkAAADW] Caught exception of type JobQueueError
[servedby: mw1345;
errorclass: JobQueueError]

Jan 6 2021, 7:52 AM · MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), MediaWiki-API, Wikidata

Jan 5 2021

Multichill added a comment to T270522: [16hrs] Investigate Infrequent JobQueueErrors on Wikidata.

Ha, right after I posted that my bot crashed twice. Now with internal API errors:

Jan 5 2021, 8:31 PM · MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), MediaWiki-API, Wikidata
Multichill added a comment to T270522: [16hrs] Investigate Infrequent JobQueueErrors on Wikidata.

One of my robots ran non-stop for the last week so looks like it's not happening at the moment. You got to love intermittent problems.....

Jan 5 2021, 8:11 PM · MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), MediaWiki-API, Wikidata
Multichill added a comment to T270911: Remove GWToolset extension from Wikimedia Commons.

https://commons.wikimedia.org/wiki/Commons:Bureaucrats%27_noticeboard#Remove_users_from_gwtoolset_group_who_haven%27t_used_it_in_the_last_two_years

Jan 5 2021, 8:10 PM · Structured-Data-Backlog, Code-Stewardship-Reviews, Technical-Debt, Wikimedia-Site-requests, Commons, Community-consensus-needed, MediaWiki-extensions-GWToolset, GLAM

Jan 1 2021

Spinster awarded T270911: Remove GWToolset extension from Wikimedia Commons a Like token.
Jan 1 2021, 11:53 AM · Structured-Data-Backlog, Code-Stewardship-Reviews, Technical-Debt, Wikimedia-Site-requests, Commons, Community-consensus-needed, MediaWiki-extensions-GWToolset, GLAM

Dec 29 2020

Multichill updated subscribers of T270911: Remove GWToolset extension from Wikimedia Commons.
Dec 29 2020, 10:16 PM · Structured-Data-Backlog, Code-Stewardship-Reviews, Technical-Debt, Wikimedia-Site-requests, Commons, Community-consensus-needed, MediaWiki-extensions-GWToolset, GLAM
Multichill added a comment to T270911: Remove GWToolset extension from Wikimedia Commons.

Thanks Sam, can you do a per user per year breakdown? I expect a small number of users with a lot of uploads.

Dec 29 2020, 6:13 PM · Structured-Data-Backlog, Code-Stewardship-Reviews, Technical-Debt, Wikimedia-Site-requests, Commons, Community-consensus-needed, MediaWiki-extensions-GWToolset, GLAM
Reedy awarded T270911: Remove GWToolset extension from Wikimedia Commons a Burninate token.
Dec 29 2020, 5:49 PM · Structured-Data-Backlog, Code-Stewardship-Reviews, Technical-Debt, Wikimedia-Site-requests, Commons, Community-consensus-needed, MediaWiki-extensions-GWToolset, GLAM
Multichill updated the task description for T270911: Remove GWToolset extension from Wikimedia Commons.
Dec 29 2020, 5:09 PM · Structured-Data-Backlog, Code-Stewardship-Reviews, Technical-Debt, Wikimedia-Site-requests, Commons, Community-consensus-needed, MediaWiki-extensions-GWToolset, GLAM
Multichill created T270911: Remove GWToolset extension from Wikimedia Commons.
Dec 29 2020, 5:04 PM · Structured-Data-Backlog, Code-Stewardship-Reviews, Technical-Debt, Wikimedia-Site-requests, Commons, Community-consensus-needed, MediaWiki-extensions-GWToolset, GLAM
Multichill added a comment to T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem).

I've observed quite a lot of inconsistencies over the past two weeks. I haven't looked very extensively at it, but I'm getting the impression that blocks of edits are missed and the timestamps are around a spike at https://grafana.wikimedia.org/d/000000489/wikidata-query-service?orgId=1&viewPanel=8 . Order of magnitude is several 100s of edits.

Dec 29 2020, 1:06 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata, Wikidata-Query-Service

Dec 21 2020

Multichill created T270622: Expand wbcreateclaim to be able to add references in the same edit.
Dec 21 2020, 12:43 PM · Wikidata

Dec 18 2020

Multichill created T270522: [16hrs] Investigate Infrequent JobQueueErrors on Wikidata.
Dec 18 2020, 8:16 PM · MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), MediaWiki-API, Wikidata

Dec 16 2020

Multichill added a comment to T132690: [Story] Maintain Query Examples.

@Lydia_Pintscher @Aklapper this is a never ending story

Dec 16 2020, 8:35 PM · Wikimedia-Hackathon-2017, Ladies-That-FOSS-Wikidata, Story, Wikidata.org, good first task, Wikidata-Query-Service, patch-welcome, Wikidata, Discovery

Dec 15 2020

Multichill added a comment to T225897: Cannot access wikitext of some old revisions on Commons, only get a comparison.

Tested on production and works as expected. See for example https://commons.wikimedia.org/w/index.php?title=File:John_Quinton_Pringle_(1864-1925)_-_Poultry_Yard,_Gartcosh_-_GMA_37_-_National_Galleries_of_Scotland.jpg&action=edit&oldid=518956340

Dec 15 2020, 7:09 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Structured-Data-Backlog (Current Work), Platform Team Workboards (Clinic Duty Team), Platform Team Initiatives (MCR), MediaWiki-Revision-backend, Commons

Dec 5 2020

Multichill added a comment to T225897: Cannot access wikitext of some old revisions on Commons, only get a comparison.

Checked in production (commons wmf.20) and in betalabs commons (tested more in depth there).

Dec 5 2020, 5:24 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Structured-Data-Backlog (Current Work), Platform Team Workboards (Clinic Duty Team), Platform Team Initiatives (MCR), MediaWiki-Revision-backend, Commons

Nov 28 2020

Multichill added a comment to T131553: Look into matching images of the same painting.
Nov 28 2020, 11:59 PM · artificial-intelligence, Machine-Learning-Team (Research)

Nov 24 2020

Multichill added a comment to T268645: Pywikibot crashing on ratelimit after the ratelimit removal from bot group in 2020.

Looks like it is the same as T192912

Due to

if code == 'failed-save' and \
   self.action == 'wbeditentity' and \
   self._is_wikibase_error_retryable(result['error']):
    self.wait()
    continue

it seems that action is not 'wbeditentity'; any idea what it was?

Nov 24 2020, 5:48 PM · Wikidata, Pywikibot
Multichill added a comment to T257938: License type filter for media search.

@AnneT the config patch has been merged so you're good to go on the UI patch. Options are

  • haslicense:cc-by
  • haslicense:cc-by-sa
  • haslicense:unrestricted
  • haslicense:other
Nov 24 2020, 5:26 PM · MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Patch-For-Review, SDAW-MediaSearch (MediaSearch-Beta), SDC General, Commons, Wikidata, Structured-Data-Backlog (Current Work)
Multichill updated subscribers of T131553: Look into matching images of the same painting.

Hi folks, happy to see activity on this task. Current code at https://github.com/multichill/toollabs/blob/master/bot/wikidata/find_painting_images.py#L704

Nov 24 2020, 5:14 PM · artificial-intelligence, Machine-Learning-Team (Research)
Multichill created T268645: Pywikibot crashing on ratelimit after the ratelimit removal from bot group in 2020.
Nov 24 2020, 4:33 PM · Wikidata, Pywikibot

Nov 13 2020

Multichill added a comment to T257938: License type filter for media search.

@Cparle @matthiasmullie I noticed the change was merged. Do you have a pointer where the actual mappings are stored? See https://github.com/multichill/toollabs/blob/master/bot/commons/own_work_sdoc.py#L66 for a list of mappings that I would expect (minus the variants).

Nov 13 2020, 10:11 AM · MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Patch-For-Review, SDAW-MediaSearch (MediaSearch-Beta), SDC General, Commons, Wikidata, Structured-Data-Backlog (Current Work)

Nov 7 2020

Multichill added a comment to T266300: Establish a systemd timer to remove long-running processes on the bastion in a random and somewhat friendly way.

Thanks for adding screen. Can you add /usr/bin/mysql to the whitelist too? Just the client part. Mariadb server will auto disconnect any long open sessions and the client will just reconnect when a session is needed again.

Nov 7 2020, 2:01 PM · Patch-For-Review, Toolforge, cloud-services-team (Kanban)

Nov 1 2020

Multichill added a project to T266155: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails: StructuredDataOnCommons.

I just noticed this also breaks https://commons.wikimedia.org/wiki/Special:MediaSearch if you sort it by "recency".

Nov 1 2020, 5:42 PM · StructuredDataOnCommons, Patch-For-Review, SRE, MediaWiki-File-management, Thumbor, Commons

Oct 29 2020

Multichill added a comment to T145712: Use RDF statement counts from entity data, not page props ( wikibase:identifiers, wikibase:statements and wikibase:sitelinks ).

I looked around in old bugs and found T129046 . I think it went like this:

  • Several Wikibase page_props were added for some unknown reason (you would have to look in the code where these are actually used now)
  • I wanted to track items without statements (T129037) and easiest was to use the page_props (T129046)
  • Some other page_props were added to the RDF later
Oct 29 2020, 11:12 PM · MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), User-Daniel, Discovery, Wikidata, Wikidata-Query-Service

Oct 27 2020

Multichill added a comment to T266394: Protection interface displays 'Allow all users' despite $wgNamespaceProtection being applied.

Very confusing indeed. I updated https://www.wikidata.org/wiki/MediaWiki:Protect-text

Oct 27 2020, 9:09 PM · MediaWiki-Page-protection
Multichill added a comment to T266589: Unable to semi-protect properties on Wikidata.

Still means the wording of the protect page is incorrect. Currently it says "all users" and "allow only administrators". The "all users" is not correct because changing the protection to that won't make it possible for all users to edit, only for autoconfirmed users and above. I see we have T266394 for that

Oct 27 2020, 9:05 PM · MediaWiki-Page-protection, Wikidata
Multichill created T266589: Unable to semi-protect properties on Wikidata.
Oct 27 2020, 6:06 PM · MediaWiki-Page-protection, Wikidata

Oct 25 2020

Multichill added a comment to T57755: Allow time values more precise than day on Wikidata.

Forked the Commons part in T266407 and left this one for the Wikidata part.

Oct 25 2020, 3:21 PM · Wikidata, MediaWiki-extensions-WikibaseRepository
Multichill created T266407: Increase maximum precision for time datatype from day to second on Commons.
Oct 25 2020, 3:19 PM · Wikidata, StructuredDataOnCommons, MediaWiki-extensions-WikibaseRepository, Structured-Data-Backlog, Commons
Multichill renamed T57755: Allow time values more precise than day on Wikidata from Allow time values more precise than day to Allow time values more precise than day on Wikidata.
Oct 25 2020, 3:00 PM · Wikidata, MediaWiki-extensions-WikibaseRepository
Multichill added a comment to T57755: Allow time values more precise than day on Wikidata.

....

There is no indication about what time zone will be assumed for the creation or first publication date. You can't expect users to provide correct dates and times if you don't tell them at the time of upload that whatever they enter will be assumed to have the time zone that was in force at the time and place where the photo was taken.

Oct 25 2020, 3:00 PM · Wikidata, MediaWiki-extensions-WikibaseRepository
Multichill added a comment to T57755: Allow time values more precise than day on Wikidata.

So, this ticket was created specifically for allowing entering time values with second precision on wikidata.org and it should probably (i guess) remain just for that.
Having second precision time values on commons does not mean wikidata has to have them.

As said in T57755#4639411 the underlying value object being used already supports second precisions.
Just wikidata has them turned off.
If commons uses the same validators as we use on wikidata.org then second precisions will not work.
If other validators are used then commons can have second precision values.

Oct 25 2020, 9:34 AM · Wikidata, MediaWiki-extensions-WikibaseRepository

Oct 22 2020

Multichill added a comment to T245349: wbeditentity doesn't trigger page update on Wikimedia Commons.

Presumably the bot doesn't do an actual null edit but calls the purge API? Those things are supposed to do the same but the actual code path is fairly different.

Oct 22 2020, 8:52 PM · MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), Structured-Data-Backlog (Current Work), Wikibase-SDC-Shared, Structured Data Engineering
Multichill added a comment to T266155: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails.

Thanks for your explanation Gilles. You can see the bug in action at https://commons.wikimedia.org/wiki/Special:NewFiles

Oct 22 2020, 5:33 PM · StructuredDataOnCommons, Patch-For-Review, SRE, MediaWiki-File-management, Thumbor, Commons

Oct 21 2020

Multichill updated subscribers of T266155: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails.

@Gilles how did you come up with the number 50? The standard number of thumbnails in a Commons category is 200 and it's very common for galleries to have more thumbnails than that. I've hit this limit many times over the last couple of months. This is a source of much annoyance.

Oct 21 2020, 9:33 PM · StructuredDataOnCommons, Patch-For-Review, SRE, MediaWiki-File-management, Thumbor, Commons
Multichill added a comment to T245349: wbeditentity doesn't trigger page update on Wikimedia Commons.

Not sure if this is related: https://commons.wikimedia.org/wiki/Category:Creative_Commons_Attribution-Share_Alike_4.0_International_missing_SDC_copyright_license is empty now, but https://commons.wikimedia.org/w/index.php?sort=last_edit_desc&search=incategory%3ACreative_Commons_Attribution-Share_Alike_4.0_International_missing_SDC_copyright_license&title=Special%3ASearch&profile=advanced&fulltext=1&advancedSearch-current=%7B%7D&ns0=1&ns6=1&ns9=1&ns12=1&ns14=1&ns100=1&ns106=1 returns over 400.000 hits.

Oct 21 2020, 4:27 PM · MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), Structured-Data-Backlog (Current Work), Wikibase-SDC-Shared, Structured Data Engineering
Multichill created T266155: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails.
Oct 21 2020, 4:12 PM · StructuredDataOnCommons, Patch-For-Review, SRE, MediaWiki-File-management, Thumbor, Commons
Multichill closed T252334: Decide upon basic P31 values for frequently-used kinds of Wikimedia Commons files as Resolved.

This was just a task for one of the in person events (feels like ages ago!). Online discussion continued on https://commons.wikimedia.org/wiki/Commons:Structured_data/Modeling

Oct 21 2020, 3:52 PM · Wikimedia-Hackathon-2020

Oct 18 2020

Multichill updated subscribers of T265573: Allow to mark Structured Data on Commons edits as minor.
Oct 18 2020, 11:17 AM · Structured-Data-Backlog, MediaWiki-extensions-WikibaseRepository, Wikidata, StructuredDataOnCommons

Oct 17 2020

Multichill added a comment to T225897: Cannot access wikitext of some old revisions on Commons, only get a comparison.

It seems that structured data breaks old revisions. Not just for random files but for ALL files. So soon we have 60 million files on Commons where the old revisions are broken.

Oct 17 2020, 8:07 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Structured-Data-Backlog (Current Work), Platform Team Workboards (Clinic Duty Team), Platform Team Initiatives (MCR), MediaWiki-Revision-backend, Commons
Multichill added a comment to T245349: wbeditentity doesn't trigger page update on Wikimedia Commons.

This (finally - thanks @Tgr!) got merged.
@Jarekt or @Multichill, any chance either of you could verify that this got fixed? (happy to wait if it's too much hassle to try to reproduce!)

Oct 17 2020, 7:59 PM · MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), Structured-Data-Backlog (Current Work), Wikibase-SDC-Shared, Structured Data Engineering

Oct 13 2020

Multichill added a comment to T263298: Not getting an edit conflict on two conflicting structured data edits on Commons (since MediaWiki 1.36/wmf.9?).

Stepping back a bit. Wbeditentity should work more like the normal edit (action=edit) with things like how to handle edit conflicts and also minor edits.

Oct 13 2020, 6:56 PM · Structured-Data-Backlog, User-Addshore, Wikidata, MediaWiki-API, Regression

Oct 11 2020

Multichill closed T122711: Appending ".json" to an entity url should work (Feature Request) as Declined.

With all the respect, but the task specifically asks to make https://www.wikidata.org/wiki/Q269728.json work. It might be that this is not something the Wikidata team want's to implement and maintain. If this is the case, the task needs to be declined, not closed as "resolved".

Oct 11 2020, 2:51 PM · MediaWiki-extensions-WikibaseRepository, Wikidata
Multichill closed T122711: Appending ".json" to an entity url should work (Feature Request), a subtask of T109420: [Story] Make exports formats more visible, as Declined.
Oct 11 2020, 2:51 PM · good first task, Story, patch-welcome, MediaWiki-extensions-WikibaseRepository, Wikidata
Multichill added a comment to T263298: Not getting an edit conflict on two conflicting structured data edits on Commons (since MediaWiki 1.36/wmf.9?).

I just noticed this mid air collision: https://commons.wikimedia.org/w/index.php?title=File%3ANSG_Salmorth_PM19-09.jpg&type=revision&diff=485124008&oldid=485009736 .
If I understand Adman correctly, adding the option to use baserevid won't solve this. Using wbsetclaim isn't really an option because edits like this would take 8 edits instead of one. Maybe introduce baserevid and some kind of option for the bot to indicate that it wants strict checking instead of a warning?

Oct 11 2020, 10:58 AM · Structured-Data-Backlog, User-Addshore, Wikidata, MediaWiki-API, Regression

Oct 10 2020

Multichill raised the priority of T225897: Cannot access wikitext of some old revisions on Commons, only get a comparison from Medium to High.

Raising this to high because more than half the files on Commons have structured data now so the chance of running into this is much higher.
The easiest solution is probably to just show the wikitext in view mode only like when you try to edit a protected page, but you don't have the right to do so. That way we can at least access the wikitext and copy it.

Oct 10 2020, 11:10 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), Structured-Data-Backlog (Current Work), Platform Team Workboards (Clinic Duty Team), Platform Team Initiatives (MCR), MediaWiki-Revision-backend, Commons
Multichill closed T122711: Appending ".json" to an entity url should work (Feature Request) as Resolved.

http://www.wikidata.org/entity/Q269728 is the entity uri (not https://www.wikidata.org/wiki/Q269728), http://www.wikidata.org/entity/Q269728.json redirects to https://www.wikidata.org/wiki/Special:EntityData/Q269728.json which returns the json. Marking this one as resolved.

Oct 10 2020, 3:29 PM · MediaWiki-extensions-WikibaseRepository, Wikidata
Multichill closed T122711: Appending ".json" to an entity url should work (Feature Request), a subtask of T109420: [Story] Make exports formats more visible, as Resolved.
Oct 10 2020, 3:29 PM · good first task, Story, patch-welcome, MediaWiki-extensions-WikibaseRepository, Wikidata

Oct 6 2020

Multichill added a comment to T261694: Support maps serving for affiliate sites via an allow list.

@CDanis based on the webserver logs we should know what domains give the most hits. Can you share a list of these domains which are not on the whitelist already? That would give a good indication of what might be missing before breaking it.

Oct 6 2020, 7:01 PM · Epic, Traffic, Maps, Product-Infrastructure-Team-Backlog, SRE

Oct 5 2020

Multichill created T264659: Update BAG & BRT SPARQL endpoint in the whitelist.
Oct 5 2020, 7:34 PM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata, Wikimedia-Site-requests
Multichill added a comment to T192733: Remove old symlinks to trunk/rewrite/compat/pywikipedia in /shared.

Don't see that this is related to Pywikibot framework.

pywikipedia is the old name for Pywikbot so this is related to the framework, we even have a special swimlane for this on the workboard

Sure but it is related to toolforge. I don’t see anything what can be done on framework side:
https://codesearch.wmcloud.org/pywikibot/?q=trunk%7Crewrite%7Ccompat%20%7Cpywikipedia&i=nope&files=&repos=

Oct 5 2020, 7:04 PM · Pywikibot, cloud-services-team (Kanban), Toolforge
Multichill added a project to T192733: Remove old symlinks to trunk/rewrite/compat/pywikipedia in /shared: Pywikibot.

Don't see that this is related to Pywikibot framework.

Oct 5 2020, 6:36 PM · Pywikibot, cloud-services-team (Kanban), Toolforge

Oct 1 2020

Multichill added a comment to T131553: Look into matching images of the same painting.

Essentially, the idea (if I understand it) is to dedupe commons.

That would imply deleting things. Goal is just to identify images of paintings so that they can be linked to the correct Wikidata item.

Oct 1 2020, 8:20 AM · artificial-intelligence, Machine-Learning-Team (Research)

Sep 30 2020

Multichill added a comment to T264241: Class 'LathMathML' not found.

I had about 20 bots running and all crashed with errors like:

Sep 30 2020, 9:41 PM · serviceops, Math, Wikimedia-production-error

Sep 28 2020

Multichill added a comment to T258354: remove noratelimit from bot group for Wikidata.

Ok, I see, we only put misbehaving bots in this group.

Sep 28 2020, 4:28 PM · Pywikibot, Pywikibot-Wikidata, Patch-For-Review, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), Wikidata, Wikidata.org

Sep 24 2020

Multichill added a comment to T263298: Not getting an edit conflict on two conflicting structured data edits on Commons (since MediaWiki 1.36/wmf.9?).

It's only on Commons and to reproduce you need a file with no structured data yet. First try doing an edit with "baserevid", you'll get a nasty API error (that's why I'm unable to use that).
To reproduce just do two edits close to each other from different jobs.

Sep 24 2020, 7:20 PM · Structured-Data-Backlog, User-Addshore, Wikidata, MediaWiki-API, Regression

Sep 18 2020

Multichill created T263298: Not getting an edit conflict on two conflicting structured data edits on Commons (since MediaWiki 1.36/wmf.9?).
Sep 18 2020, 9:32 PM · Structured-Data-Backlog, User-Addshore, Wikidata, MediaWiki-API, Regression

Sep 16 2020

Multichill added a comment to T261621: ☂Support the addition of the IIIF API for Wikimedia projects regarding content partnerships.

IIIF is a whole framework (the F in IIIF). Which API or API's are you planning to work on and what parts? Quite a few of them, see https://iiif.io/technical-details/#information-gathering . In the past we implemented small parts, like https://zoomviewer.toolforge.org/index.php?f=M104_ngc4594_sombrero_galaxy_hi-res.jpg&flash=no as part of T89552 (currently slightly broken). And of course https://mirador.toolforge.org/?manifest=https://wd-image-positions.toolforge.org//iiif/Q1231009/P18/manifest.json is nice too.

Sep 16 2020, 8:45 PM · WMSE-Tools-for-Partnerships-2020

Sep 14 2020

Multichill updated subscribers of T262794: Unintentional mass rollback (due to "link-investigator" Firefox add-on?).

Caused by this extension: https://github.com/Smile4ever/link-investigator It will investigate all the links so it will also follow the rollback lists on your watchlist causing a mass revert on all recently edited pages on your watchlist.

Sep 14 2020, 9:00 PM · Wikimedia-General-or-Unknown

Sep 12 2020

Multichill added a comment to T257938: License type filter for media search.

@matthiasmullie any thoughts on getting around the search string character limit here? Now that I've rebased this patch onto the one that swaps out the search modules, I'm hitting the default limit of 300 characters for the cc-by and cc-by-sa filter options, and the "other" option is over the hard limit of 2048 (by about 150 characters, but this could always grow as more license items are added).

Sep 12 2020, 1:46 PM · MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Patch-For-Review, SDAW-MediaSearch (MediaSearch-Beta), SDC General, Commons, Wikidata, Structured-Data-Backlog (Current Work)

Sep 7 2020

Multichill raised the priority of T261050: Frequent "Invalid CSRF token" errors on Wikimedia projects using Pywikibot since August 2020 from Medium to High.

Bumping this to high because this makes longer pywikibot bot runs crash.

Sep 7 2020, 4:14 PM · Platform Engineering, MediaWiki-API, Pywikibot, Security

Aug 30 2020

Multichill added a comment to T261050: Frequent "Invalid CSRF token" errors on Wikimedia projects using Pywikibot since August 2020.

I think this happens:

  • Bot fires up and gets some tokens
  • Bot does a lot of edits all with the same token
  • For some reason after a long time the token is not valid anymore
  • The bot continues to try to edit with the old invalid token instead of getting a new one

How long is a token supposed to be valid? Forever? The Pywikibot code seems to assume that it can use the same token for all edits in a one run. One run can take days or weeks. As a work around I now force the site to get a new token when I run into a problem. That seems to be stable.

Aug 30 2020, 11:27 AM · Platform Engineering, MediaWiki-API, Pywikibot, Security
Multichill added a comment to T238574: Create wiki replica views for MachineVision extension tables.

I ran into this missing tables. Can the view be added please?

Aug 30 2020, 10:57 AM · Structured-Data-Backlog (Current Work), Privacy Engineering, Privacy, Security-Team, Data-Services, cloud-services-team (Kanban), SDC-Statements (Machine-vision-depicts), MachineVision

Aug 29 2020

Multichill added a comment to T261050: Frequent "Invalid CSRF token" errors on Wikimedia projects using Pywikibot since August 2020.

I think I found what is going wrong. site.get_tokens(['csrf']) gets you a new token, but doesn't update the internal token state:

Aug 29 2020, 7:41 PM · Platform Engineering, MediaWiki-API, Pywikibot, Security
Multichill added a comment to T261050: Frequent "Invalid CSRF token" errors on Wikimedia projects using Pywikibot since August 2020.

If the error is easy enough to reproduce, you could try setting the X-Wikimedia-Debug header to get some pretty detailed logs.

Aug 29 2020, 6:30 PM · Platform Engineering, MediaWiki-API, Pywikibot, Security

Aug 28 2020

Multichill updated subscribers of T261424: Limit maps serving to Wikimedia hosted sites only.
Aug 28 2020, 8:21 PM · Maps, Traffic, Product-Infrastructure-Team-Backlog, SRE
Multichill updated subscribers of T261424: Limit maps serving to Wikimedia hosted sites only.

I noticed the announcement on the maps-l list and I also noticed https://twitter.com/krmaher/status/1299203640188690434 where @Katherine-WMF replied. Someone recently mention to me "the only way to prevent WMF people from doing making stupid mistakes these days is tagging Katherine on Twitter".

Aug 28 2020, 8:20 PM · Maps, Traffic, Product-Infrastructure-Team-Backlog, SRE