Find out why rebuilding some items in new term store failed
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• alaa_wmde
	Sep 9 2019, 9:11 PM

Description

Context
When we ran the new term store rebuild script on item terms, up to Q2mio, we encountered few failing items reported by the script to have failed.
T225056: Run Item Terms Rebuild script

Problem
TBD

timbox investigation for 8hrs until problem is identified, or solution is implemented as well

Related Objects
Search...

Status	Assigned	Task
Resolved	Addshore	T208425 [EPIC] Kill the wb_terms table
Resolved	ArielGlenn	T226167 audit public tables and make sure we dump them all
Resolved	Addshore	T219175 [Mega] - Migrate data from wb_terms to new schema
Resolved	Ladsgroup	T219123 Migrate to and read from new store for item terms
Resolved	Ladsgroup	T232393 Find out why rebuilding some items in new term store failed

Event Timeline

• alaa_wmde created this task.Sep 9 2019, 9:11 PM

Restricted Application added a project: Wikidata. · View Herald TranscriptSep 9 2019, 9:11 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

• alaa_wmde triaged this task as High priority.Sep 9 2019, 9:11 PM

• alaa_wmde moved this task from Ready to estimate to Ready to pick up on the Wikidata-Campsite board.

• alaa_wmde mentioned this in T234948: New Wikibase deadlocks on Wikidata wiki since 2019-10-08T00:00:02: Wikibase\Lib\Store\Sql\Terms\{closure} Deadlock found when trying to get lock; try restarting transaction.Oct 9 2019, 10:33 AM

Ladsgroup claimed this task.Oct 25 2019, 9:52 AM

Ladsgroup edited projects, added Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)); removed Wikidata-Campsite.

Restricted Application added a project: User-Ladsgroup. · View Herald TranscriptOct 25 2019, 9:52 AM

Maintenance_bot moved this task from incoming to in progress on the Wikidata board.Oct 25 2019, 10:15 AM

Maintenance_bot moved this task from Incoming to In progress on the User-Ladsgroup board.

Ladsgroup mentioned this in T236466: PHP Warning: [data-update-failed]: A data update callback triggered an exception (Wikimedia\Rdbms\Database::makeList: empty input for field wbxl_text_id) [Called from Wikibase\Repo\Content\DataUpdateAdapter::doUpdate in /extensions/Wikibase/repo/includes/Content/DataUpdateAdapter.php at line 62].Oct 25 2019, 10:20 AM

Ladsgroup moved this task from To Do (prioritised from top to bottom) to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Oct 28 2019, 11:06 AM

Addshore added a parent task: T219123: Migrate to and read from new store for item terms.Oct 31 2019, 7:39 AM

Addshore mentioned this in T208425: [EPIC] Kill the wb_terms table.Oct 31 2019, 7:44 AM

It's because of Classical Chinese language code being too big to fit into wbt_text_in_lang.wbxl_language than failing in a cascade. Any item that "zh-classical" term would fail to have the new term store. Examples:

We should increase the upper limit.

Ladsgroup moved this task from Doing to Test (Verification) on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Nov 1 2019, 1:22 PM

Ladsgroup mentioned this in T237102: Increase the size of wbt_text_in_lang.wbxl_language.Nov 1 2019, 1:40 PM

Addshore closed this task as Resolved.Nov 5 2019, 1:36 PM

Addshore moved this task from Test (Verification) to Done on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.

Maintenance_bot moved this task from In progress to Done on the User-Ladsgroup board.Nov 5 2019, 2:15 PM