Page MenuHomePhabricator

JeroenDeDauw (Jeroen De Dauw)
~=[,,_,,]:3

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 4:56 PM (519 w, 4 h)
Availability
Available
IRC Nick
JeroenDeDauw
LDAP User
Unknown
MediaWiki User
Jeroen De Dauw [ Global Accounts ]

Opinions posted here are my own, unless stated otherwise

Recent Activity

Aug 14 2024

JeroenDeDauw added a comment to T372458: Github Actions CI - pull from phabricator.wikimedia.org blocked 429.

I have also noticed this and worked around it for my own projects. However, I imagine that the recently added cloning restriction is hitting many users of Wikibase that suddenly see their submodule cloning fail. A fix of the root cause or workaround that works for everyone will limit the damage to the community.

Aug 14 2024, 4:26 PM · affects-Miraheze, Patch-For-Review, Wikibase Suite Team (Sprint-∞)

Jun 10 2023

JeroenDeDauw added a comment to T335073: PHP Fatal error: Declaration of MWCallbackStream::write($string) must be compatible with Psr\Http\Message\StreamInterface::write(string $string): int in /var/www/mediawiki/includes/http/MWCallbackStream.php on line 49 with guzzlehttp/psr7 2.5.0.

Also ran into this with External Content extension: https://github.com/ProfessionalWiki/ExternalContent/actions/runs/5223430655/jobs/9430279743

Jun 10 2023, 3:28 PM · MediaWiki-Vendor

Oct 5 2022

JeroenDeDauw awarded T312619: Include the Automated Values extension in the next Wikibase Docker release / Wikibase.cloud a Like token.
Oct 5 2022, 10:50 AM · Wikibase Cloud

Aug 15 2022

JeroenDeDauw added a comment to T314803: [Session] OpenRefine for Wikimedia developers: ask us anything!.

August 12th. So this session already happened?

Aug 15 2022, 4:50 PM · OpenRefine, Wikimania-Hackathon-2022
JeroenDeDauw awarded T314803: [Session] OpenRefine for Wikimedia developers: ask us anything! a Like token.
Aug 15 2022, 4:49 PM · OpenRefine, Wikimania-Hackathon-2022

Jul 23 2022

JeroenDeDauw updated subscribers of T313670: Header Tabs TOC config options are broken.
Jul 23 2022, 9:27 PM · MediaWiki-extensions-HeaderTabs
JeroenDeDauw updated subscribers of T313670: Header Tabs TOC config options are broken.
Jul 23 2022, 9:27 PM · MediaWiki-extensions-HeaderTabs
JeroenDeDauw created T313670: Header Tabs TOC config options are broken.
Jul 23 2022, 9:27 PM · MediaWiki-extensions-HeaderTabs

Feb 19 2022

JeroenDeDauw added a comment to T248925: Make MediaWiki release tarball compatible with PHP 8.0.

PHP makes limited breaking changes in minor releases. I already updated two MediaWiki extensions to avoid issues on PHP 8.1.

Feb 19 2022, 2:28 PM · MW-1.39-notes (1.39.0-wmf.27; 2022-08-29), MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), MW-1.35-notes, PHP 8.0 support, MediaWiki-General, MediaWiki-Stakeholders-Group
JeroenDeDauw added a comment to T248925: Make MediaWiki release tarball compatible with PHP 8.0.

What about PHP 8.1 for MediaWiki 38? Can we expect it to work as well as MW 37 on PHP 8.0?

Feb 19 2022, 1:59 PM · MW-1.39-notes (1.39.0-wmf.27; 2022-08-29), MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), MW-1.35-notes, PHP 8.0 support, MediaWiki-General, MediaWiki-Stakeholders-Group

Jan 21 2022

JeroenDeDauw created T299770: Build new images to get rid of Nuke bug.
Jan 21 2022, 2:33 PM · Docker-Hub-MediaWiki

Nov 25 2021

JeroenDeDauw added a comment to T222626: Turn logout link into a POST API call with refresh.

This causes problems for SAML auth. See https://phabricator.wikimedia.org/T246350 and https://www.mediawiki.org/w/index.php?title=Topic:W5nyw48nx1pc2lsy

Nov 25 2021, 4:41 PM · Security, MW-1.34-notes (1.34.0-wmf.10; 2019-06-18), Wikimedia-Hackathon-2019, User-Ladsgroup, MediaWiki-Core-AuthManager

Nov 23 2021

JeroenDeDauw added a comment to T246350: SAML logout does not work both ways.

Anyone found how to fix this yet?

Nov 23 2021, 9:22 PM · MediaWiki-extensions-SimpleSAMLphp

Oct 24 2021

JeroenDeDauw added a comment to T289125: Make PropertyId into an interface and introduce NumericPropertyId.

This is kinda painful for anything outside of Wikibase that relies on this PHP code such as extensions or tools. Firstly there is no deprecation period, the breaking change just instantly happens. Secondly, and more painfully, the new alternative is only introduce at time of breaking change, making it super difficult to support both old and new Wikibase.

Oct 24 2021, 11:00 PM · MW-1.38-notes (1.38.0-wmf.3; 2021-10-05), MW-1.37-notes (1.37.0-wmf.23; 2021-09-13), Patch-For-Review, Wikibase - Federated Properties (Federation v2 - Sprint 6)

Jul 15 2021

JeroenDeDauw awarded T280656: Include the EDTF Datatype extension in the Fall 2021 Wikibase Docker release a Like token.
Jul 15 2021, 1:59 PM · Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), [DEPRECATED] wdwb-tech, Wikidata, Wikibase Release Strategy

Apr 28 2021

JeroenDeDauw added a comment to T188395: [Task] Make sure all Wikibase codebases run PHPCS during `composer test`.

👎

Apr 28 2021, 3:12 PM · Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), [DEPRECATED] wdwb-tech, User-Addshore, Wikibase-DataModel, Technical-Debt, Wikidata

Mar 20 2021

JeroenDeDauw added a comment to T263427: Unable to process a particular wikibase dump using munge.sh (localised namespace name).

@dcausse: will anything bad happen if the URL comparison that is currently failing is removed? And is that applicable to people running their own Wikibase?

Mar 20 2021, 4:20 PM · MW-1.42-notes (1.42.0-wmf.25; 2024-04-02), Patch-For-Review, Product-Feature, Wikibase Suite Team, Wikibase (3rd party installations), Wikibase Release Strategy, Wikidata-Query-Service, User-Nikerabbit
JeroenDeDauw awarded T263427: Unable to process a particular wikibase dump using munge.sh (localised namespace name) a Burninate token.
Mar 20 2021, 4:15 PM · MW-1.42-notes (1.42.0-wmf.25; 2024-04-02), Patch-For-Review, Product-Feature, Wikibase Suite Team, Wikibase (3rd party installations), Wikibase Release Strategy, Wikidata-Query-Service, User-Nikerabbit

Mar 18 2021

JeroenDeDauw added a comment to T277166: Add Extension:Wikibase Local Media to Wikibase release docker image.

👍

Mar 18 2021, 5:26 PM · Wikibase Release Strategy (Hike 2, Sprint 3)
JeroenDeDauw added a comment to T263427: Unable to process a particular wikibase dump using munge.sh (localised namespace name).

@dcausse is it realistic to expect this bug to be fixed by Wikimedia in the near future? Several institutuions that we are helping with Wikibase adoption are running into it.

Mar 18 2021, 3:35 PM · MW-1.42-notes (1.42.0-wmf.25; 2024-04-02), Patch-For-Review, Product-Feature, Wikibase Suite Team, Wikibase (3rd party installations), Wikibase Release Strategy, Wikidata-Query-Service, User-Nikerabbit

Mar 15 2021

JeroenDeDauw awarded T263928: VisualEditor in 1.35 not working (404 / Permanent Loading) a Burninate token.
Mar 15 2021, 7:50 PM · Editing-team (Third-party), Parsoid (Third-party), RESTBase-API, RESTBase, VisualEditor, MW-1.35-release

Mar 12 2021

JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

I've added the description message: https://github.com/ProfessionalWiki/EDTF/blob/master/i18n/en.json#L2

Mar 12 2021, 5:18 PM · Language-Team (Language-2021-January-March), translatewiki.net
JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

@abi_ fantastic!

Mar 12 2021, 3:05 PM · Language-Team (Language-2021-January-March), translatewiki.net

Mar 10 2021

JeroenDeDauw created T277108: Query service throws exception for non-English wikis.
Mar 10 2021, 11:00 PM · Wikidata, Wikibase (3rd party installations), Wikidata-Query-Service

Mar 9 2021

JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

Thanks @Reedy. We now have message docs in qqq.json. Anything else that needs to happen?

Mar 9 2021, 9:51 PM · Language-Team (Language-2021-January-March), translatewiki.net

Mar 8 2021

JeroenDeDauw awarded T276320: Unbreak elastic search tests a Burninate token.
Mar 8 2021, 9:47 PM · Wikidata, MW-1.36-notes (1.36.0-wmf.34; 2021-03-09), Upstream, Patch-For-Review, Wikibase Release Strategy (Sprint 2.1)

Mar 6 2021

JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

We now have the messages in JSON format similar to MediaWiki: https://github.com/ProfessionalWiki/EDTF/tree/master/i18n

Mar 6 2021, 10:51 PM · Language-Team (Language-2021-January-March), translatewiki.net

Mar 2 2021

JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

Thank you abi_! We will use the MediaWiki i18n JSON format.

Mar 2 2021, 5:32 PM · Language-Team (Language-2021-January-March), translatewiki.net

Mar 1 2021

JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

The library now has GPL license and should be ready for TranslateWiki.

Mar 1 2021, 12:16 PM · Language-Team (Language-2021-January-March), translatewiki.net

Feb 21 2021

JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

And is there some recommendation on what to do in PHP? Is there a standard implementation we can use? Is using something like https://packagist.org/packages/gettext/gettext recommended, or is it better if we create our own thin wrapper?

Feb 21 2021, 4:12 PM · Language-Team (Language-2021-January-March), translatewiki.net
JeroenDeDauw removed a watcher for Wikibase Release Strategy: JeroenDeDauw.
Feb 21 2021, 4:09 PM
JeroenDeDauw added a comment to T275298: Add EDTF (PHP library) to translatewiki.net.

Is there an technical documentation on how to interface with TranslateWiki? I guess there should be message files in _some_ format at _some_ location, but am unsure if there are any restrictions, preferences or best practices we should be aware off.

Feb 21 2021, 1:45 PM · Language-Team (Language-2021-January-March), translatewiki.net
JeroenDeDauw created T275298: Add EDTF (PHP library) to translatewiki.net.
Feb 21 2021, 1:42 PM · Language-Team (Language-2021-January-March), translatewiki.net

Feb 2 2021

JeroenDeDauw added a watcher for Wikibase Release Strategy: JeroenDeDauw.
Feb 2 2021, 7:44 PM

Jan 22 2021

JeroenDeDauw added a comment to T271723: Support for custom Item IDs.

Use cases for DNB:

Jan 22 2021, 3:43 PM · Product-Feature, Wikibase Suite Team, Wikibase (3rd party installations), Wikidata
JeroenDeDauw closed T272222: OAuth broken in MW 1.35 bundle as Resolved.

Looks like this is a QuickStatement issue that is already tracked: https://github.com/magnusmanske/quickstatements/pull/1

Jan 22 2021, 3:15 PM · wbstack, MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), User-Ladsgroup, Patch-For-Review, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), Wikidata, Wikibase-Docker-2017+
JeroenDeDauw added a comment to T272222: OAuth broken in MW 1.35 bundle.

After the latest fix the extensions/OAuth/maintenance/createOAuthConsumer.php script is running without error.

Jan 22 2021, 2:21 PM · wbstack, MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), User-Ladsgroup, Patch-For-Review, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), Wikidata, Wikibase-Docker-2017+

Jan 19 2021

JeroenDeDauw added a comment to T272222: OAuth broken in MW 1.35 bundle.

Props for the fast response!

Jan 19 2021, 5:21 PM · wbstack, MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), User-Ladsgroup, Patch-For-Review, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), Wikidata, Wikibase-Docker-2017+

Jan 16 2021

JeroenDeDauw created T272222: OAuth broken in MW 1.35 bundle.
Jan 16 2021, 5:07 PM · wbstack, MW-1.36-notes (1.36.0-wmf.28; 2021-01-26), User-Ladsgroup, Patch-For-Review, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)), Wikidata, Wikibase-Docker-2017+

Jan 11 2021

JeroenDeDauw created T271723: Support for custom Item IDs.
Jan 11 2021, 4:15 PM · Product-Feature, Wikibase Suite Team, Wikibase (3rd party installations), Wikidata

Dec 23 2020

JeroenDeDauw added a comment to T248925: Make MediaWiki release tarball compatible with PHP 8.0.

monolog/monolog 2.0.2 requires php ^7.2 -> your PHP version (8.0.0) does not satisfy that requirement

Fun.

Dec 23 2020, 7:18 PM · MW-1.39-notes (1.39.0-wmf.27; 2022-08-29), MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), MW-1.35-notes, PHP 8.0 support, MediaWiki-General, MediaWiki-Stakeholders-Group

Dec 4 2020

JeroenDeDauw added a comment to T248925: Make MediaWiki release tarball compatible with PHP 8.0.

Does anyone know to which degrees MW 1.35 and master run on PHP 8.0? (I understand there is no official support)

Dec 4 2020, 5:34 PM · MW-1.39-notes (1.39.0-wmf.27; 2022-08-29), MW-1.36-notes (1.36.0-wmf.30; 2021-02-09), MW-1.35-notes, PHP 8.0 support, MediaWiki-General, MediaWiki-Stakeholders-Group

Sep 28 2020

JeroenDeDauw closed T258932: Local Media Data Type as Resolved.

We put the data type in a new extension. In retrospect perhaps we should have done that right away.

Sep 28 2020, 8:48 PM · Patch-For-Review, Wikidata, Wikibase-DataModel

Aug 6 2020

JeroenDeDauw added a comment to T249129: ResourceLoader breaks Leaflet library.

Thanks @TheDJ! Fixed with https://github.com/JeroenDeDauw/Maps/commit/eab4fcaa969b7b284aaa1fc530f2b53a3fcf6f6a

Aug 6 2020, 1:55 PM · MediaWiki-ResourceLoader, Performance-Team

Jun 29 2020

JeroenDeDauw created T256651: Title::getFragmentForURL escapes $.
Jun 29 2020, 3:39 PM · MediaWiki-General

Jun 4 2020

JeroenDeDauw updated the task description for T254457: Add setting to not show "leave feedback" option.
Jun 4 2020, 10:49 AM · VisualEditor
JeroenDeDauw created T254457: Add setting to not show "leave feedback" option.
Jun 4 2020, 10:49 AM · VisualEditor

May 4 2020

JeroenDeDauw added a comment to T35298: Option to disable some or all talk namespaces.

I think there is wisdom in "less is more" and that talk pages do not make sense for all wikis. A clean way to disable them would be nice.

May 4 2020, 10:47 AM · OKR-Work, MediaWiki-General
JeroenDeDauw awarded T35298: Option to disable some or all talk namespaces a Like token.
May 4 2020, 10:42 AM · OKR-Work, MediaWiki-General

Apr 16 2020

JeroenDeDauw awarded T250406: RFC: Hybrid extension management a Like token.
Apr 16 2020, 11:51 PM · MediaWiki-Configuration, MediaWiki-Stakeholders-Group, TechCom-RFC
JeroenDeDauw awarded T249573: Remove support for extensions requiring a MediaWiki version via Composer a Dislike token.
Apr 16 2020, 11:38 PM · MW-1.42-notes (1.42.0-wmf.9; 2023-12-12), Patch-Needs-Improvement, TechCom-RFC, Composer, MediaWiki-General

Apr 11 2020

JeroenDeDauw added a comment to T246949: Security Review Request for WikimediaApiPortal Skin.

In theory it could call wfLoadExtension()

Apr 11 2020, 7:29 PM · Platform Team Workboards (Green), WikimediaApiPortal, Core Platform Team Initiatives (API Gateway), secscrum, Application Security Reviews, RFS
JeroenDeDauw added a comment to T246949: Security Review Request for WikimediaApiPortal Skin.

It'd be nice to replace mediawiki/mw-extension-registry-helper provides with something simpler while retaining automatic enabling of dependencies. Can an extension somehow enable other extensions that it depends on when it is enabled? (We'd make this optional so you can define things manually/explicitly for WMF wikis.)

Apr 11 2020, 5:23 AM · Platform Team Workboards (Green), WikimediaApiPortal, Core Platform Team Initiatives (API Gateway), secscrum, Application Security Reviews, RFS

Apr 9 2020

JeroenDeDauw added a comment to T249172: Error from line 99 of "PF_CreateProperty.php": Call to a member function getDatatypeLabels() on null.

Also seeing this issue

Apr 9 2020, 6:47 PM · affects-translatewiki.net, MediaWiki-extensions-Page_Forms

Apr 6 2020

JeroenDeDauw added a comment to T208801: Support slots other than the main slot in EditPage - backend support.

Is this on some roadmap?

Apr 6 2020, 10:11 PM · Core Platform Team Initiatives (MCR), Multi-Content-Revisions (New Features)

Apr 1 2020

JeroenDeDauw updated the task description for T249129: ResourceLoader breaks Leaflet library.
Apr 1 2020, 3:57 PM · MediaWiki-ResourceLoader, Performance-Team
JeroenDeDauw updated the task description for T249129: ResourceLoader breaks Leaflet library.
Apr 1 2020, 3:57 PM · MediaWiki-ResourceLoader, Performance-Team
JeroenDeDauw created T249129: ResourceLoader breaks Leaflet library.
Apr 1 2020, 3:56 PM · MediaWiki-ResourceLoader, Performance-Team

Feb 23 2020

JeroenDeDauw added a comment to T196452: Archive the LiveTranslate extension.

+1

Feb 23 2020, 11:17 PM · translatewiki.net, User-MarcoAurelio, MediaWiki-extensions-LiveTranslate, Wikimedia-GitHub, Diffusion-Repository-Administrators, Projects-Cleanup

May 22 2019

JeroenDeDauw removed a watcher for Wikidata wb_terms Trailblazing: JeroenDeDauw.
May 22 2019, 7:37 AM

May 19 2019

JeroenDeDauw moved T221564: Create maintenance script for populating new item term persistence from In Review to Done on the Wikidata wb_terms Trailblazing board.
May 19 2019, 3:36 AM · MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Wikidata, Wikidata wb_terms Trailblazing

May 14 2019

JeroenDeDauw added a comment to T220150: [Story] Clean up unused records.

https://github.com/wmde/WikibaseDataModelServices/pull/219

May 14 2019, 6:23 PM · Wikidata, Wikidata wb_terms Trailblazing

May 5 2019

JeroenDeDauw closed T221699: Introduce appropriate abstraction for clean up invocation in wikibase-term-store as Invalid.
May 5 2019, 9:02 AM · Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw closed T221699: Introduce appropriate abstraction for clean up invocation in wikibase-term-store, a subtask of T220150: [Story] Clean up unused records, as Invalid.
May 5 2019, 9:02 AM · Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw removed a watcher for WMDE-FUN-Team: JeroenDeDauw.
May 5 2019, 8:59 AM
JeroenDeDauw moved T221564: Create maintenance script for populating new item term persistence from Backlog to In Review on the Wikidata wb_terms Trailblazing board.
May 5 2019, 8:55 AM · MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Wikidata, Wikidata wb_terms Trailblazing

May 4 2019

JeroenDeDauw moved T219894: Create maintenance script for migrating property terms to new schema from In Review to Done on the Wikidata wb_terms Trailblazing board.
May 4 2019, 10:28 AM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing

May 3 2019

JeroenDeDauw moved T219894: Create maintenance script for migrating property terms to new schema from In Progress to In Review on the Wikidata wb_terms Trailblazing board.
May 3 2019, 1:07 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

Ready for review: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/507954

May 3 2019, 1:06 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

One thing left in the maintenance script itself: support property id ranges. I will work on this today

May 3 2019, 12:13 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw moved T219894: Create maintenance script for migrating property terms to new schema from In Review to In Progress on the Wikidata wb_terms Trailblazing board.
May 3 2019, 12:13 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing

Apr 24 2019

JeroenDeDauw added a comment to T220150: [Story] Clean up unused records.

I think something along these lines makes sense, please comment here: https://github.com/wmde/doctrine-term-store/pull/8/files

Apr 24 2019, 12:36 AM · Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T221703: add a job to wikibase to invoke clean up logic.

I am also not happy with this task, as again it specifies a solution, not an outcome. I much rather have "avoid expensive cleanup during the request to the degree this is possible" as acceptance criteria in the story.

Apr 24 2019, 12:20 AM · Wikidata, Wikidata wb_terms Trailblazing

Apr 23 2019

JeroenDeDauw added a comment to T221699: Introduce appropriate abstraction for clean up invocation in wikibase-term-store.

We talked about this (two weeks ago?) and concluded there likely is no need to introduce anything in wikibase/term-store. I'm pretty annoyed with this task now since it specifies a solution rather than a problem that needs to be solved.

Apr 23 2019, 11:14 PM · Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T220210: Create a script to generate lots of Items/Properties with lots of Terms.

WikibaseImport contains a limited number of items and properties

Apr 23 2019, 10:24 PM · MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T220150: [Story] Clean up unused records.

https://www.mediawiki.org/wiki/Manual:Job_queue

Apr 23 2019, 8:10 PM · Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T220150: [Story] Clean up unused records.

This means we have to go with the "smart update using diff" approach, since otherwise we do not know which terms have been removed. Not clear to me it will make sense to do the cleanup in post-request, we might end up only delaying a few % of the cost. I suggest to first make it work on write and then see if we can gain a lot by moving stuff to a job.

Apr 23 2019, 2:27 AM · Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

I'm calling it a day. Current guess is that the tables are not created right because we are not using this setting in mediawiki/doctrine-connection.

Apr 23 2019, 1:03 AM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

There is some issues though. Some properties result in an error, and on re-run many of them do.

Apr 23 2019, 12:53 AM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

With https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/501992/ the rebuilding works using the Doctrine Term Store.

Apr 23 2019, 12:39 AM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing

Apr 22 2019

JeroenDeDauw moved T221568: Improve MW connection access from Backlog to Stalled on the Wikidata wb_terms Trailblazing board.
Apr 22 2019, 11:13 PM · Wikidata
JeroenDeDauw added a comment to T221568: Improve MW connection access.

@alaa_wmde what is the status of this?

Apr 22 2019, 11:13 PM · Wikidata
JeroenDeDauw created T221568: Improve MW connection access.
Apr 22 2019, 11:13 PM · Wikidata
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

AFAIK the script we currently have (https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/505670) is sufficient for this task. It has continuation based on page id rather than property id. I figure that won't fly for items but likely is OK for properties. Do we need continuation at all for properties?

Apr 22 2019, 11:07 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw moved T219894: Create maintenance script for migrating property terms to new schema from In Progress to In Review on the Wikidata wb_terms Trailblazing board.
Apr 22 2019, 10:58 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw moved T220210: Create a script to generate lots of Items/Properties with lots of Terms from In Review to In Progress on the Wikidata wb_terms Trailblazing board.
Apr 22 2019, 10:58 PM · MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw moved T220210: Create a script to generate lots of Items/Properties with lots of Terms from In Progress to In Review on the Wikidata wb_terms Trailblazing board.
Apr 22 2019, 10:58 PM · MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

https://github.com/wmde/WikibaseDataModelServices/pull/216

Apr 22 2019, 9:14 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T221564: Create maintenance script for populating new item term persistence.

We already did some of this while working on the property script: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/505679

Apr 22 2019, 8:44 PM · MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw created T221564: Create maintenance script for populating new item term persistence.
Apr 22 2019, 8:43 PM · MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T220210: Create a script to generate lots of Items/Properties with lots of Terms.

image.png (165×810 px, 28 KB)

Apr 22 2019, 8:32 PM · MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata, Wikidata wb_terms Trailblazing

Apr 21 2019

JeroenDeDauw added a comment to T220210: Create a script to generate lots of Items/Properties with lots of Terms.

Yesterday while thinking about design stuff I randomly realized that we might not need a script like this. Can't we just use https://github.com/Wikidata/WikibaseImport to important a bunch of real entities? If that is too slow, then perhaps we can use https://github.com/JeroenDeDauw/Replicator to import JSON dumps.

Apr 21 2019, 9:26 PM · MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata, Wikidata wb_terms Trailblazing

Apr 16 2019

JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

https://github.com/wmde/WikibaseDataModelServices/pull/214

Apr 16 2019, 3:42 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing

Apr 14 2019

JeroenDeDauw updated the task description for T219894: Create maintenance script for migrating property terms to new schema.
Apr 14 2019, 5:39 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw placed T219894: Create maintenance script for migrating property terms to new schema up for grabs.
Apr 14 2019, 5:39 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing

Apr 12 2019

JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/503331

Apr 12 2019, 12:26 PM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T219894: Create maintenance script for migrating property terms to new schema.

Don't think it is a good idea to modify the existing RebuildTermSqlIndex code. We can just create a new script. The existing code has things in there we don't need, and still having the wb_terms specific thing around might be useful to various users.

Apr 12 2019, 11:22 AM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw claimed T219894: Create maintenance script for migrating property terms to new schema.
Apr 12 2019, 11:20 AM · Wikidata, MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Patch-For-Review, Wikidata wb_terms Trailblazing
JeroenDeDauw added a comment to T220230: Tailor a migration plan.

@alaa_wmde is this done?

Apr 12 2019, 11:20 AM · Wikidata, Wikidata wb_terms Trailblazing
JeroenDeDauw closed T219296: Update TermSqlStore to comply with EntityTermStoreWriter interface as Resolved.
Apr 12 2019, 11:19 AM · MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), User-Ladsgroup, Wikidata, Wikidata wb_terms Trailblazing