Page MenuHomePhabricator

Jarekt (Jarek Tuszynski)
User

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Nov 5 2014, 5:13 PM (493 w, 2 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Jarekt [ Global Accounts ]

Admin on Commons and Wikidata

Recent Activity

Fri, Apr 12

Jarekt added a comment to T177955: TargetInvocationException in ApiEdit.MD5.

The issue with my computer is that for other tools to work some internet security related stuff, update schedule, etc. are managed by my employer. I can change thinks but if it is against some policy, after a while it will be reverted. I could use some other computer to run AWB, or flip the FIPS flag, reboot and have few days of working AWB. It sounds like very few people are affected by this issue, but at the moment AWB is incompatible with some Windows settings, which might become more commonly used. If it can not be fixed without changes to API, maybe check for this flag at the startup and provide information about what is happening and what are workarounds. I have been plagued by this issue for a long time but only recently figured out what is causing it after spending good part of a week debugging similar issues with a different software.

Fri, Apr 12, 12:53 PM · AutoWikiBrowser
Jarekt added a comment to T177955: TargetInvocationException in ApiEdit.MD5.

This issue is making AWB almost unusable for me, but I did figured out what is causing the issue. Apparently AWB is using some non-compliant encryption algorithms and my computer throws an error each time I try to save an edit. One can disable checking for FIPS compliance by following steps of "Disabling FIPS-Complaint Encryption on Windows". But unfortunately in my case the flag always comes back and I need a reboot to reset it.

Fri, Apr 12, 3:17 AM · AutoWikiBrowser
Jarekt added a comment to T177955: TargetInvocationException in ApiEdit.MD5.

This issue is making AWB almost unusable for me, but I did figured out what is causing the issue. Apparently AWB is using some non-compliant encryption algorithms and my computer throws an error each time I try to save an edit. One can disable checking for FIPS compliance by following steps of "Disabling FIPS-Complaint Encryption on Windows". But unfortunately in my case the flag always comes back and I need a reboot to reset it.

Fri, Apr 12, 3:17 AM · AutoWikiBrowser

Mar 14 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.

I have a question for MediaWiki developers.

Mar 14 2024, 12:34 AM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Mar 10 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.

After some discussion we retired Template:License_template_tag which was used to track files without licenses and was redundant to Extension:CommonsMetadata which was introduced latter. That should eventually remove 100M template links.

That template is used for many different things that you probably just broke. I see uploadwizard and no license bot already. Please don't do this in such an uncontrolled way. Please check what is using it and switch it before trying again.

Mar 10 2024, 11:07 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

After some discussion we retired Template:License_template_tag which was used to track files without licenses and was redundant to Extension:CommonsMetadata which was introduced latter. That should eventually remove 100M template links.

Mar 10 2024, 5:10 AM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Feb 12 2024

Jarekt added a comment to T334352: Usage in SDC should be shown when deleting items on Wikidata.

Also once Wikidata item is deleted it should be removed from SDC, the way deleted image is removed from Wikidata or wikipedia. I just run into File:Francesco Filippini - Barche sulla spiaggia (1892-93).jpg which still references long deleted Q108176371 item. The item was deleted as part of removal of all contributions by some no-longer liked user, but it creates hard to fix mess on Commons.

Feb 12 2024, 3:38 AM · Wikidata Integration in Wikimedia projects, SDC General, Wikidata

Feb 8 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.

Now looking at Module:Autotranslate called from Template:Autotranslate, which in turn is only called from other templates. I think we could call Module:Autotranslate directly from the other templates, without Template:Autotranslate for high volume templates. This would have a nice side-effect of avoiding issues described at T196464: Incorrect template loop detection

Let me know how it goes.

Feb 8 2024, 3:17 AM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Feb 1 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.

Thanks. I don't recommend doing 9m edits to remove 9m rows from templatelinks, it just adds the same number but larger rows to another table.

Feb 1 2024, 4:40 AM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Jan 26 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.

I eliminated the use of Template:Description in language templates, like Template:En in favor of calling Module:Description directly. It actually makes much more readable wikicode as Module:Description uses named variables as opposed to numbered variables. That should (eventually) eliminate 66.6M templatelinks entries.

Jan 26 2024, 7:21 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Jan 24 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.

Another way to reduce size of transclude table used in the past was to run a bot job of substituting template redirects. Does anybody have a good SQL query to see if we have any templates with often used redirects? I run many such bot jobs in the past but not in the last decade or so.

https://quarry.wmcloud.org/query/12286 First field is the redirect, second field is redirect target, third field is transclusions of redirect.

Jan 24 2024, 5:25 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

Another way to reduce size of transclude table used in the past was to run a bot job of substituting template redirects. Does anybody have a good SQL query to see if we have any templates with often used redirects? I run many such bot jobs in the past but not in the last decade or so.

Jan 24 2024, 4:48 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

On finding templates that could be merged together ...

Jan 24 2024, 4:06 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Jan 23 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.

There are multiple options:

  • Simply move the template and localizations to MediaWiki namespace and do nothing more. You can now use int: to call the template in MediaWiki namespace and a translation based on user interface language will be automatically chosen. The translation can only be managed by admins or other users with editinterface right.

In 2010 several hundred messages were moved from MediaWiki namespace to translatewiki, because of how hard it was for the translators to work with MediaWiki namespace. I also do not know how to "simply" move 54 translations from Template:PD-old-text , another 50+ from Template:PD-US-expired-text and probably bunch of other similar templates. The manual approach seems quite laborious and potentially error-prone.

  • Similar to above but mark the page in MediaWiki namespace for translation. It can now be translated by any users (even without editinterface).

I have never run into any pages in MediaWiki namespace managed by Translate extension, are there any pages using this feature I can look at?

  • If you want to make it translatable in translatewiki, you need to add a message to WikimediaMessage extension.

I do not know what that means . File a ticket at https://phabricator.wikimedia.org/tag/wikimediamessages/ or something. If anybody is familiar with this process please contact me.

Jan 23 2024, 2:33 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

If I see {{#time:Y|now -95 years}}, I have no idea what it means. If I see {{Not-PD-US-expired-min-year}}, I know what it means. And the backlinks in non-file namespaces (mainly template and Commons namespaces) help updating relevant pages when we reach another row in https://commons.wikimedia.org/wiki/Commons:Hirtle_chart.

This can be achieved by hidden comment such as <!--Not-PD-US-expired-min-year-->.

Jan 23 2024, 1:44 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T337023: Automatically display structured copyright data in Lua-driven infobox templates on Wikimedia Commons file pages.

@Spinster, Also I am not sure you are aware but {{Information}} template is fully compatible with SDC since 2018. What that means is that if you have standard SDC properties set up, than you can remove all the wikitext from {{Information}} template. See for example File:OpenRefine Commons editing - wikitext data extension.png file, where I removed all the wikitext from the template and it is pulled from SDC. That is the infobox used by 85M files. See Template:Information documentation (SDC was mentioned there but I just added examples).

Jan 23 2024, 5:09 AM · Commons, Wikimedia-Hackathon-2023
Jarekt added a comment to T337023: Automatically display structured copyright data in Lua-driven infobox templates on Wikimedia Commons file pages.

I can revisit the Module:License code and work on supporting more cases. If someone wants to help I could use a tester adding cases to Module:License/doc cataloging cases where current code gave adequate result and when it did not

Thank you so much @Jarekt - that's amazing! (and Happy New Year to you!)

Do I understand correctly that you'd like us to test the cases at Module:License/doc and add new-to-develop examples and cases there too? Or use the talk page to list these new cases? What kind of process would work best for you?

Jan 23 2024, 3:46 AM · Commons, Wikimedia-Hackathon-2023

Jan 21 2024

Jarekt added a comment to T343131: Commons database is growing way too fast.
Jan 21 2024, 8:00 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

Those need an function that accepts arguments, not frame. For example, https://commons.wikimedia.org/wiki/Module:SDC_tracking needs "function p._SDC_statement_exist(args)", "function p.SDC_statement_exist(frame)" will not work.

In lua code you use "frame" to pass arguments from wikitext to lua and regular function arguments to pass data between lua functions. If we want to call SDC_tracking from other lua codes we would add "function p._SDC_statement_exist(args)" function to the module to allow that; however here we are talking about calling {{#invoke:SDC_tracking|SDC_statement_exist|...}} from templates instead of {{SDC_statement_exist|...}}, and that can be done with the code as is. The only purpose of Template:SDC_statement_exist is to provide an page with clear interface documentation for people that often do not know much about Lua. However as this template if mostly meant to be used by other templates we can probably assume that those users are familiar with both.

Jan 21 2024, 7:35 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

There are templates like https://commons.wikimedia.org/wiki/Template:Geograph_from_structured_data that used structured data but used many templates inside, so a file with only such template used more than 40 templates and modules. They should be rewritten using one module.

Jan 21 2024, 7:13 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

For License template tag, also note files without license tags are automatically added to https://commons.wikimedia.org/wiki/Category:Files_with_no_machine-readable_license by Extension:CommonsMetadata.

Similarly files without information template are in https://commons.wikimedia.org/wiki/Category:Files_with_no_machine-readable_source.

Jan 21 2024, 5:58 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

Some more specific templates (more to add):

Jan 21 2024, 4:19 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Dec 26 2023

Jarekt created T354034: TargetInvocationException in ApiEdit.MD5.
Dec 26 2023, 11:30 PM · AutoWikiBrowser
Jarekt added a comment to T337023: Automatically display structured copyright data in Lua-driven infobox templates on Wikimedia Commons file pages.

I can revisit the Module:License code and work on supporting more cases. If someone wants to help I could use a tester adding cases to Module:License/doc cataloging cases where current code gave adequate result and when it did not

Dec 26 2023, 2:25 PM · Commons, Wikimedia-Hackathon-2023

Dec 17 2023

Marsupium awarded T309867: thumbnails of STL files incorrectly sized in packed gallery mode a Love token.
Dec 17 2023, 7:55 PM · Thumbor, 3D, MediaWiki-Gallery

Oct 13 2023

Jarekt added a comment to T56790: Some files uploaded without images.

Similar issue in 2023, see T348827

Oct 13 2023, 3:05 AM · Multimedia, Wikimedia-Media-storage
Jarekt created T348827: files uploaded to Commons without images.
Oct 13 2023, 3:04 AM · SRE-swift-storage, Commons

Sep 7 2023

Jarekt added a comment to T343131: Commons database is growing way too fast.

For authority control links, these work solely based on the property IDs and their values on the connected Wikidata item, and the code then follows the formatter URLs (through P1630) to make the URL. There's a possibility of migrating this over to using interwiki prefix at Wikimedia (P6720) if that might be come more widespread - if that would help performance.

Sep 7 2023, 3:29 AM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

Aug 8 2023

Jarekt added a comment to T343131: Commons database is growing way too fast.

About Template:Dir used on 112M pages, likely dozen times on each page. That template is imbedded in almost every non-lua-based template that shows some text. Lua based templates (like Template:Information and other infoboxes) use mw.language:getDir function. We do have 181k templates on Commons and good fraction of them show something, so it would be a big job to replace that template. The easiest solution would be to add it to "software or parser functions" which would use the current format, the way {{!}} template was replaced by a parser function. Whatever way it is implemented it would be good to keep it in synch with Lua function. Shall we create a ticket for that?

Aug 8 2023, 8:22 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

Just for reference and general understanding, can someone explain why external links are stored in a database?

Aug 8 2023, 6:18 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt added a comment to T343131: Commons database is growing way too fast.

About links from commons to commons

We don't have any recorded external links to commons, because of the change that was implemented in 2009. We do have issue of externallinks to wikidata.org in commons instead of interwiki links.

Aug 8 2023, 6:12 PM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons
Jarekt updated subscribers of T343131: Commons database is growing way too fast.

About links from commons to commons: I think a lot of them come from c:Category:Language_link_templates (aka /lang templates) which are used by some old templates. For example Template:PD-US-no_notice/lang is transcluded by Template:PD-US-no_notice which is then transcluded to all the files using that template. /Lang templates are automatically generated or updated by template:LLE which uses external links to subpages instead of internal links, in order to help with some database table exploding in 2009. See discussion. A lot of transclusions of /lang templates in license templates was removed in 2013, because they were causing other issues, but not all of them.

Aug 8 2023, 6:48 AM · MW-1.42-notes (1.42.0-wmf.23; 2024-03-19), MediaWiki-Platform-Team (Radar), Data-Persistence (work done), Commons

May 5 2023

TiagoLubiana awarded T237262: Tool for undoing Wikidata merges a Like token.
May 5 2023, 12:39 PM · Wikidata, Wikidata-Gadgets

Jun 3 2022

Jarekt updated the task description for T309867: thumbnails of STL files incorrectly sized in packed gallery mode.
Jun 3 2022, 2:12 PM · Thumbor, 3D, MediaWiki-Gallery
Jarekt added a comment to T309867: thumbnails of STL files incorrectly sized in packed gallery mode.

was produced by

Jun 3 2022, 1:58 PM · Thumbor, 3D, MediaWiki-Gallery
Jarekt added a project to T309867: thumbnails of STL files incorrectly sized in packed gallery mode: Thumbor.
Jun 3 2022, 1:50 PM · Thumbor, 3D, MediaWiki-Gallery
Jarekt added a project to T309867: thumbnails of STL files incorrectly sized in packed gallery mode: 3D.
Jun 3 2022, 1:49 PM · Thumbor, 3D, MediaWiki-Gallery
Jarekt added a comment to T309867: thumbnails of STL files incorrectly sized in packed gallery mode.

Was produced by the following code:

Jun 3 2022, 1:46 PM · Thumbor, 3D, MediaWiki-Gallery
Jarekt created T309867: thumbnails of STL files incorrectly sized in packed gallery mode.
Jun 3 2022, 1:43 PM · Thumbor, 3D, MediaWiki-Gallery

May 26 2022

Jarekt added a comment to T294637: Improvements to the WikibaseLexeme Lua interface (before full rollout).

I am still trying to wrap my head around how to use lexme data, but I also have use case similar to Marsupium's use case. I would like to replace tables like c:Data:I18n/MonthCases.tab where we store declensions of month names in different languages, so that we can have a function like c:Module:DateI18n's MonthCase(month, case, lang) (like 146) where, MonthCase(1, "ins", "pl") will give you L1872-F5, Polish instrumental case, singular of January. I would love to be able to point to Q108 and ask for any language, any grammatical case.

May 26 2022, 1:29 PM · [DEPRECATED] wdwb-tech, All-and-every-Wiktionary, Wikidata, Wikidata Lexicographical data

May 17 2022

Jarekt created T308564: TargetInvocationException in ApiEdit.MD5.
May 17 2022, 2:47 PM · AutoWikiBrowser

May 11 2022

Moebeus awarded T294803: WDQS query returns dead links instead of SomeValue values a Like token.
May 11 2022, 10:56 PM · Wikidata, Wikidata Query UI
TiagoLubiana awarded T294803: WDQS query returns dead links instead of SomeValue values a Like token.
May 11 2022, 10:25 PM · Wikidata, Wikidata Query UI

May 5 2022

Jarekt updated the task description for T307692: TargetInvocationException in ApiEdit.MD5.
May 5 2022, 2:19 PM · AutoWikiBrowser
Jarekt created T307692: TargetInvocationException in ApiEdit.MD5.
May 5 2022, 2:18 PM · AutoWikiBrowser

Mar 14 2022

Abbe98 awarded T245861: Add Structured data during file upload with Upload Wizard a Stroopwafel token.
Mar 14 2022, 12:22 PM · Structured-Data-Backlog, StructuredDataOnCommons, UploadWizard, Structured Data Engineering

Jan 26 2022

Jarekt created T300211: Disable Special:NewItem on Commons.
Jan 26 2022, 11:11 PM · Wikidata, SDC General

Jan 11 2022

Jarekt added a comment to T247433: Disable watchlist notifications for bot edits made on Commons structured data.

Almost two years latter, it is still an issue. See my talk page when small maintenance tasks are swamping people's watchlists.

Jan 11 2022, 1:26 AM · Tools, Structured-Data-Backlog, Structured Data Engineering

Dec 17 2021

Harcisis awarded T167521: Simplify access to properties that currently require traversing numerous items a Like token.
Dec 17 2021, 10:28 PM · Wikibase-Lua, DataTypes, Wikidata, MediaWiki-extensions-WikibaseClient

Dec 10 2021

Jarekt created T297454: WCQS gives "502 Bad Gateway Error".
Dec 10 2021, 4:31 AM · Discovery-Search (Current work), Cloud-Services-Origin-User, Cloud-Services-Worktype-Unplanned, User-dcaro, Wikidata, SDC General, Wikidata-Query-Service

Nov 2 2021

Jarekt created T294803: WDQS query returns dead links instead of SomeValue values.
Nov 2 2021, 3:35 AM · Wikidata, Wikidata Query UI

Nov 1 2021

Jarekt closed T286015: Wikimedia Commons Module creator uses a wrong regex for property Property:P1053 as Resolved.
Nov 1 2021, 11:57 PM · Commons
Jarekt added a comment to T286015: Wikimedia Commons Module creator uses a wrong regex for property Property:P1053.

I did correct the RegExp at https://commons.wikimedia.org/w/index.php?title=Module%3AAuthority_control&type=revision&diff=604990227&oldid=602191369

Nov 1 2021, 11:56 PM · Commons

Aug 21 2021

Quiddity awarded T223772: Extend #time parser function to display time in format specific to each language a Like token.
Aug 21 2021, 5:23 PM · I18n, ParserFunctions

May 27 2021

Jarekt created T283820: TargetInvocationException in ApiEdit.MD5.
May 27 2021, 1:40 PM · AutoWikiBrowser

May 23 2021

Kozuch awarded T68877: Upload wizard should allow batch naming/renaming options, especially for flickr mode a Like token.
May 23 2021, 10:06 AM · Multimedia, UploadWizard

May 14 2021

Jarekt created T282872: TargetInvocationException in ApiEdit.MD5.
May 14 2021, 1:46 PM · AutoWikiBrowser

Apr 19 2021

Jarekt added a comment to T280397: Replace OTRS text on Commons.

There is a lot to do here, like content/ title of:

Apr 19 2021, 1:03 PM · Commons, Znuny

Mar 15 2021

Jarekt added a comment to T276718: Move captions from file information to structured data tab.

This topic is discussed at Commons_talk:Structured_data#Proposal%3A_Move_captions_from_file_information_to_structured_data_tab

Mar 15 2021, 1:16 PM · Community-consensus-needed, Commons, StructuredDataOnCommons

Mar 12 2021

Jarekt added a comment to T13700: Edit tab on cascade protected pages.

This issue was just reported at https://commons.wikimedia.org/wiki/Commons:Village_pump/Technical#appearently_the_featured_pictures_are_protected_but_appearently_still_have_the_%22edit%22_tab. 13 years after 1st report.

Mar 12 2021, 2:48 AM · MediaWiki-Page-protection, MediaWiki-User-Interface

Feb 28 2021

Jarekt added a comment to T275958: Enable interlanguage links from multilingual Wikisource to other Wikisources.

@Tacsipacsi Yes your Module:Interwiki relying on connected Wikidata item, is what I had in mind. That is how it is done on Commons with associated template Template:Interwiki_from_Wikidata added to Template:Wikidata_Infobox (with 3M category transclusions) and many other templates.

Feb 28 2021, 2:20 PM · User-notice-archive, wikidata-campsite-a-b-split, MW-1.37-notes (1.37.0-wmf.9; 2021-06-07), User-Ladsgroup, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), Wikimedia-Site-requests, Wikidata, [DEPRECATED] wdwb-tech, All-and-every-Wikisource

Feb 27 2021

Jarekt added a comment to T275958: Enable interlanguage links from multilingual Wikisource to other Wikisources.

I can look into this. So as I understand it if a page like wikisource:Category:Jv_Basa_Jawa_(Javanese) is connected to d:Q8564118 which also have sitelinks to enwikisource and idwikisource pages, than those 2 should show up as interwiki links on wikisource:Category:Jv_Basa_Jawa_(Javanese).

Feb 27 2021, 3:43 PM · User-notice-archive, wikidata-campsite-a-b-split, MW-1.37-notes (1.37.0-wmf.9; 2021-06-07), User-Ladsgroup, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), Wikimedia-Site-requests, Wikidata, [DEPRECATED] wdwb-tech, All-and-every-Wikisource
Jarekt added a comment to T138332: Interwiki links to/from Multilingual Wikisource.

If the community wants it, I think this can have a follow up ticket and be done. I don't know how commons does it but it looks like it should be possible.

Feb 27 2021, 3:11 PM · User-notice-archive, User-Ladsgroup, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), All-and-every-Wikisource, Wikidata

Feb 22 2021

Jarekt added a comment to T238417: Structured localization framework for Scribunto modules.

As a guy maintaining most of the high use lua codes on multilanguage Commons wiki, I spend a lot of time dealing with translations and i18n in general. On Commons we use two already discussed systems, each with it's own advantages and disadvantages:

Feb 22 2021, 1:23 AM · Technical-Debt, Scribunto, MediaWiki-extensions-Translate, I18n, Language-strategy, Epic, WMF-General-or-Unknown

Feb 11 2021

Jarekt added a comment to T273109: Rewrite the Wikimedia Commons Wikidata-based Infobox in Lua.

Rewrite of {{Wikidata Infobox}} in Lua is a big task which is very needed. Current implementation of is functionally great, but it long-ago outgrew wiki-templates "language" it is written in. If someone can produce concise, clean, modular, well documented, and well tested (through unit-tests) Lua code which would be easy to pick up and maintain by others, than this task can have very good impact on Commons category namespace.

Feb 11 2021, 5:31 AM
Jarekt added a comment to T273110: Using Structured Data on Commons in file pages.

I can help with this task, but I agree that display of structured data and conversion from wikitext to structured data are two separate tasks. I also share @Multichill concern that this is such a broad scope that it is hard to pin down what it is, or tell when its goal is achieved. Some possible tasks:

Feb 11 2021, 5:19 AM · Outreach-Programs-Projects

Dec 9 2020

Jarekt updated the task description for T245861: Add Structured data during file upload with Upload Wizard.
Dec 9 2020, 3:47 AM · Structured-Data-Backlog, StructuredDataOnCommons, UploadWizard, Structured Data Engineering

Nov 20 2020

Jarekt added a comment to T57755: Allow time values more precise than day on Wikidata.

I see the following use cases:

  • A source states that the death of .. occurred at 9:25 on some day. I would like to save that information and I find the current approach of using refine date (P4241) = 09:25 (Q55810989) qualifier totally crazy
  • In case of images on Commons, like this one, upload wizard saved the date "9 March 2019, 17:20:46" and I would like to store it in SDC. I need up to a second precision if I want to order write SPARQL query of photographs from that event and sort them in a chronological order. In such a case the timezone is irrelevant.
Nov 20 2020, 10:12 PM · Wikidata, MediaWiki-extensions-WikibaseRepository

Nov 4 2020

Jarekt added a comment to T237991: Changes to Structured Data on Commons should trigger page refresh.

@matthiasmullie, in case it helps: most of out SDC tracking templates are based on c:Module:SDC_tracking and templates calling it. You probably recreated something similar for testing, but in case it is easier to test with already existing code, here it is.

Nov 4 2020, 3:15 AM · Editing-team (Tracking), Structured-Data-Backlog, User-Daniel, VisualEditor, TemplateData, Commons, SDC General, Wikidata

Nov 1 2020

Jarekt added a comment to T237991: Changes to Structured Data on Commons should trigger page refresh.

I tried it again did SDC edits using ACDC tool which should have emptied all 183 files from https://commons.wikimedia.org/wiki/Category:Creative_Commons_Attribution-Share_Alike_1.0_missing_SDC_copyright_license. An hour latter 136 files remain. See https://commons.wikimedia.org/w/index.php?title=File%3AAdil_Ray.JPG&type=revision&diff=508801789&oldid=443468314 for details.

Nov 1 2020, 3:39 AM · Editing-team (Tracking), Structured-Data-Backlog, User-Daniel, VisualEditor, TemplateData, Commons, SDC General, Wikidata
Jarekt added a comment to T237991: Changes to Structured Data on Commons should trigger page refresh.

@Ramsey-WMF I just did bunch of SDC edits which should have removed a tracking category for files missing SDC statement. Afterwards the category should have been empty, but the number of files did not change. I run a quick touch operation (add and empty line to the end of the file) and afterwards the category is empty. So no it is not working for me.

Nov 1 2020, 2:18 AM · Editing-team (Tracking), Structured-Data-Backlog, User-Daniel, VisualEditor, TemplateData, Commons, SDC General, Wikidata

Oct 30 2020

Jarekt added a comment to T266407: Increase maximum precision for time datatype from day to second on Commons.

I fully support this change. But, does this mean that all the bots that add date to Commons SDC fields in 65M files will have to go back and do it again? Most of the time I do not find time of the day that useful. For example with my own photos I set the time to US eastern time zone but than fly to California and take photos there. The date in the EXIF has date and time but no timezone, so unless I take a photo of a sunset I do not know the precise time. However I find time (hour:minute:second) part very useful when I am trying to occasionally figure out the order of the photographs taken by the same camera.

Oct 30 2020, 9:39 PM · Wikidata, StructuredDataOnCommons, MediaWiki-extensions-WikibaseRepository, Structured-Data-Backlog, Commons

Sep 18 2020

Jarekt added a comment to T263088: Allow to download WDQS and WCQS results as Excel spreadsheet.

MS Excel has a lot of issues with CSV files

Can these issues be solved?

Sep 18 2020, 7:08 PM · Wikidata, Wikidata-Query-Service

Sep 17 2020

Jarekt renamed T263088: Allow to download WDQS and WCQS results as Excel spreadsheet from WDQS excel to Allow to download WDQS and WCQS results as Excel spreadsheet.
Sep 17 2020, 1:33 AM · Wikidata, Wikidata-Query-Service
Jarekt created T263088: Allow to download WDQS and WCQS results as Excel spreadsheet.
Sep 17 2020, 1:25 AM · Wikidata, Wikidata-Query-Service

Sep 14 2020

Jarekt added a comment to T237899: Wikidata item ID changes caused by merges do not update entities on Structured data on Commons.

I created T262837 which might be a blocking issue for this task.

Sep 14 2020, 5:37 PM · Structured-Data-Backlog, Wikidata-Query-Service, Wikidata
Jarekt created T262837: SDC statements should record entity usage for wikidata entities used in statements.
Sep 14 2020, 5:35 PM · Wikidata data quality and trust, Wikidata, SDC General
Jarekt added a comment to T237899: Wikidata item ID changes caused by merges do not update entities on Structured data on Commons.

Furthermore, from a technical perspective I doubt it’s even possible for Wikibase to update statements on Commons when items on Wikidata are merged. Within Wikidata, the software could discover all the affected pages through the pagelinks table, but on Commons I don’t know how Wikibase would even find the affected pages that need to be edited. (MediaInfo statements don’t seem to automatically record entity usage for entities used in statements; compare the page information for a Test Commons file with one statement.)

Sep 14 2020, 5:16 PM · Structured-Data-Backlog, Wikidata-Query-Service, Wikidata
Jarekt added a comment to T237899: Wikidata item ID changes caused by merges do not update entities on Structured data on Commons.

Note that KrBot only updates statements pointing to redirects after a certain time has passed (a week, I believe). This is by design: otherwise, it would be more difficult to “untangle” bad merges, since after undoing the merge on the item itself, you could not distinguish between statements that should now point back to the original item and statements that always pointed to the other (merge target) item.

Sep 14 2020, 3:47 PM · Structured-Data-Backlog, Wikidata-Query-Service, Wikidata

Sep 12 2020

Jarekt added a comment to T237899: Wikidata item ID changes caused by merges do not update entities on Structured data on Commons.

WCQS queries that have to look things up on wikidata have a very tiny connection between WCQS and WDQS and are so under-powered it can not run queries of that complexity. See T261716 where I was just advised that for queries that rely on WDQS an "offline processing via the dumps might be a better option" because "we want to have strong limits on resource consumption". I personally have no idea how to use commons and wikidata dumps to stand up a database to do a simple SPARQL query. And how to rebuild that weekly.

Sep 12 2020, 1:01 AM · Structured-Data-Backlog, Wikidata-Query-Service, Wikidata

Sep 9 2020

Jarekt added a comment to T261716: Allow WCQS large volume connection to MWAPI and Wikidata services.

Those were just 2 usecases I run into lately, but great many queries we are trying to write run into this issue, as they seem to need something from "service https://query.wikidata.org/sparql" and that connection has very small bottleneck. Commons community is still mostly learning how to use WCQS, but If you look at Commons:SPARQL_query_service/queries/examples almost all examples rely on federation through a service of some sort, to connect it to Wikidata or Commons categories. A lot of those require some major changes to go around those limits. At the moment majority of my queries result in a timeout as I am searching for some combination that goes through.

Sep 9 2020, 9:39 PM · Commons, Wikidata, Wikidata-Query-Service

Sep 8 2020

Jarekt added a comment to T262178: One week after SDC edits the data still shows up in WCQS queries.

I can confirm that my query works as expected today all the found duplicates were real. I did not realized that we had at maximum one week lag between edit and the update of WCQS. The length of that lag was my concern, but it sounds like it will not be addressed in beta version

Sep 8 2020, 3:39 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, SDC General

Sep 7 2020

Jarekt renamed T262178: One week after SDC edits the data still shows up in WCQS queries from One week after SDC queries the data still shows up in WCQS queries to One week after SDC edits the data still shows up in WCQS queries.
Sep 7 2020, 2:37 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, SDC General
Jarekt created T262178: One week after SDC edits the data still shows up in WCQS queries.
Sep 7 2020, 2:37 AM · Discovery-Search (Current work), Wikidata, Wikidata-Query-Service, SDC General

Sep 3 2020

Gnoeee awarded T261909: In the Quary tool the download as excel creates empty files a Like token.
Sep 3 2020, 5:29 PM · Quarry
Jarekt created T261909: In the Quary tool the download as excel creates empty files.
Sep 3 2020, 1:57 AM · Quarry

Sep 2 2020

Jarekt added a comment to T258835: Update Commons query service favicon .

We have a new logo designed by User MaxxL. You can see it at File:Wikimedia_Commons_Query_Service_Logo.svg

Sep 2 2020, 12:31 PM · Discovery-Search (Current work), Logos, Wikidata-Query-Service, Wikidata, Commons

Sep 1 2020

Jarekt created T261716: Allow WCQS large volume connection to MWAPI and Wikidata services.
Sep 1 2020, 3:58 AM · Commons, Wikidata, Wikidata-Query-Service
Jarekt added a comment to T258835: Update Commons query service favicon .

I requested a new logo to be designed by the community at https://commons.wikimedia.org/wiki/Commons:Graphic_Lab/Illustration_workshop#Design_Commons_query_service_favicon

Sep 1 2020, 3:10 AM · Discovery-Search (Current work), Logos, Wikidata-Query-Service, Wikidata, Commons

Aug 24 2020

Jarekt added a comment to T230315: [XL] Create a way to see and add references to structured data on Commons (MediaInfo) statements .

I just noticed that I can not add references to items on SDC on Commons. In case of digital representations of objects which have wikidata items, our model stores properties of the object on Wikidata and properties of digital version on Commons, but we still need to be able to add references to document where those digitization properties come from. For example we have a photograph of a sculpture downloaded from some site. The information about the photograph will be stored in SDC: maybe the name of the copyright holder or a license it was released under. Those statements require references especially if the information is not on the same page listed as a source.

Aug 24 2020, 3:42 PM · MW-1.38-notes (1.38.0-wmf.19; 2022-01-24), User-John_Cummings, Patch-For-Review, GLAM, Structured-Data-Backlog (Current Work), Wikimedia-Hackathon-2021, Wikidata, StructuredDataOnCommons

Aug 22 2020

Jarekt added a project to T261036: Disable Cat-a-Lot on Commons in Tabular data namespace: WMF-General-or-Unknown.
Aug 22 2020, 3:30 AM · JavaScript, Commons
Jarekt created T261036: Disable Cat-a-Lot on Commons in Tabular data namespace.
Aug 22 2020, 3:29 AM · JavaScript, Commons

Aug 19 2020

Jarekt added a comment to T194465: When the author/source is indicated with a template, it is categorized as "Files with no machine-readable author/source".

Maybe the first step of resolving this issue should be some publication (or link to past publication) of machine-readable marking, expected by the software. At the moment those categories are useless, as they are filled with millions of files with correct templates and author/source info.

Aug 19 2020, 12:37 PM · Multimedia, CommonsMetadata, Commons

Aug 3 2020

Jarekt added a comment to T246746: Bot edits on Wikidata should be hidden in other project's recent changes.

I also reported it at https://bitbucket.org/magnusmanske/wikidata-todo/issues/124/qs-should-send-all-requests-with-bot-1

Aug 3 2020, 12:33 PM · Wikidata Change Dispatching & Watchlists, Growth-Team-Filtering, Upstream, MediaWiki-extensions-WikibaseClient, MediaWiki-Recent-changes, Wikidata, Edit-Review-Improvements-RC-Page, Growth-Team
Jarekt added a comment to T247433: Disable watchlist notifications for bot edits made on Commons structured data.

This continues to the the issue. I reported it also at https://bitbucket.org/magnusmanske/wikidata-todo/issues/124/qs-should-send-all-requests-with-bot-1

Aug 3 2020, 12:31 PM · Tools, Structured-Data-Backlog, Structured Data Engineering
Jarekt added a project to T247433: Disable watchlist notifications for bot edits made on Commons structured data: Tools.
Aug 3 2020, 11:55 AM · Tools, Structured-Data-Backlog, Structured Data Engineering

Jul 29 2020

Jarekt added a comment to T251507: [Spike] Investigate page cache not being purged when SD edits are made.

There is something odd happening now, with this issue: c:Template:PermissionOTRS adds either c:Category:Files_with_PermissionOTRS_template_but_without_P6305_SDC_statement or c:Category:P6305 SDC to files without or with P6305 statement. I recently added few hundred thousands of those statements and each edit trigered update which placed the file in c:Category:Files_with_PermissionOTRS_template_but_without_P6305_SDC_statement instead of c:Category:P6305 SDC category. It seems like adding SDC statement purges the page first and then adds the statement instead of the other way around.

Jul 29 2020, 5:28 PM · Structured-Data-Backlog (Current Work)

Jul 24 2020

Jarekt added a comment to T258489: Create a Examples Page for WCQS.

By the way, there is a lot of activity now at https://commons.wikimedia.org/wiki/c:Commons:SPARQL_query_service/queries/examples, a lot of great examples are being added.

Jul 24 2020, 7:24 PM · Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
Jarekt added a comment to T258776: Add Structured Data on Commons M-ID to Wikidata dumps.

I think Wikidata and SDC has an issue with representation of Wikimedia pages. Sometimes thy are stored as URLs (see Property:P1957), sometimes as strings (see Property:P1472), images are stored using data type just for images (see Property:P18) and in SDC they are stored as M-ids based on page ID. Some years ago there was a proposal to have a property data type just for Wikimedia pages, which would allow the links to stay valid when the original page was renamed, or would allow comparison of links saved in different formats, like compare Property:P1472 with a sitelink to Commons. If we add SDoC M-IDs to WDQS, maybe we could also find some way of representing other links to Wikimedia pages in some unified way as right now it is kind of a mess.

Jul 24 2020, 7:19 PM · StructuredDataOnCommons, Wikidata-Query-Service, Wikidata
Jarekt awarded T258769: ImageGrid for WCQS a Like token.
Jul 24 2020, 6:53 PM · Commons, Wikidata-Query-Service, Wikidata