We put the data type in a new extension. In retrospect perhaps we should have done that right away.
Sep 28 2020
Aug 6 2020
Jun 29 2020
Jun 4 2020
May 4 2020
I think there is wisdom in "less is more" and that talk pages do not make sense for all wikis. A clean way to disable them would be nice.
Apr 16 2020
Apr 11 2020
In theory it could call wfLoadExtension()
It'd be nice to replace mediawiki/mw-extension-registry-helper provides with something simpler while retaining automatic enabling of dependencies. Can an extension somehow enable other extensions that it depends on when it is enabled? (We'd make this optional so you can define things manually/explicitly for WMF wikis.)
Apr 9 2020
Also seeing this issue
Apr 6 2020
Is this on some roadmap?
Apr 1 2020
Feb 23 2020
May 22 2019
May 19 2019
May 14 2019
May 5 2019
May 4 2019
May 3 2019
Ready for review: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/507954
One thing left in the maintenance script itself: support property id ranges. I will work on this today
Apr 24 2019
I think something along these lines makes sense, please comment here: https://github.com/wmde/doctrine-term-store/pull/8/files
I am also not happy with this task, as again it specifies a solution, not an outcome. I much rather have "avoid expensive cleanup during the request to the degree this is possible" as acceptance criteria in the story.
Apr 23 2019
We talked about this (two weeks ago?) and concluded there likely is no need to introduce anything in wikibase/term-store. I'm pretty annoyed with this task now since it specifies a solution rather than a problem that needs to be solved.
WikibaseImport contains a limited number of items and properties
This means we have to go with the "smart update using diff" approach, since otherwise we do not know which terms have been removed. Not clear to me it will make sense to do the cleanup in post-request, we might end up only delaying a few % of the cost. I suggest to first make it work on write and then see if we can gain a lot by moving stuff to a job.
I'm calling it a day. Current guess is that the tables are not created right because we are not using this setting in mediawiki/doctrine-connection.
There is some issues though. Some properties result in an error, and on re-run many of them do.
With https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/501992/ the rebuilding works using the Doctrine Term Store.
Apr 22 2019
@alaa_wmde what is the status of this?
AFAIK the script we currently have (https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/505670) is sufficient for this task. It has continuation based on page id rather than property id. I figure that won't fly for items but likely is OK for properties. Do we need continuation at all for properties?
We already did some of this while working on the property script: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/505679
Apr 21 2019
Yesterday while thinking about design stuff I randomly realized that we might not need a script like this. Can't we just use https://github.com/Wikidata/WikibaseImport to important a bunch of real entities? If that is too slow, then perhaps we can use https://github.com/JeroenDeDauw/Replicator to import JSON dumps.
Apr 16 2019
Apr 14 2019
Apr 12 2019
Don't think it is a good idea to modify the existing RebuildTermSqlIndex code. We can just create a new script. The existing code has things in there we don't need, and still having the wb_terms specific thing around might be useful to various users.
@alaa_wmde is this done?
Apr 11 2019
Apr 10 2019
"delete everything" means deleting all terms for an item/property in the item/property_terms table, rather than just those that actually need to be removed.
Apr 9 2019
We won't be doing this as per https://phabricator.wikimedia.org/T220150
We figured we go with delete and insert everything. Task description updated to reflect this.
While not the best fro a design or flexibility perspective, I suspect the most pragmatic approach here is to just create a MW maintenance script in Wikibase (Repo?).
@alaa_wmde are you working on this? If so, please link the stuff you have so far.
Apr 8 2019
Apr 7 2019
Also part of this: https://github.com/wmde/wikibase-term-store/pull/7
Setting this up turned out to be easier than expected. The library has running tests on TravisCI and can transform Mysqli and SQLite (PDO) based MW Database objects.