Script for populating term_full_entity_id column in wb_terms table
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	aude
	Apr 8 2017, 10:46 PM

Description

We need a script to populate the term_full_entity_id column in wb_terms, and also probably to update the column when running database updater.

then we will need to run the script.

Details

Subject	Repo	Branch	Lines +/-
Only load entity data TermSqlIndexBuilder when doing full rebuild	mediawiki/extensions/Wikibase	master	+397 -32
Make TermSqlIndexBuilder only rebuild entity terms when necessary	mediawiki/extensions/Wikibase	master	+97 -3
Script for rebuilding wb_terms table (e.g. w/ term_full_entity_id)	mediawiki/extensions/Wikibase	master	+643 -5

Customize query in gerrit

Related Objects
Search...

Status	Subtype	Assigned	Task
Declined		dchen	T118706 Conduct heuristic evaluation of image upload and insert flow in VisualEditor
Open		None	T115858 Design improvements for mw.ForeignStructuredUpload.BookletLayout
Open		None	T115865 Insert image in content immediately after it's uploaded, skipping the "General settings" step
Duplicate		None	T115864 Figure out if the description of the image can be used as the caption on-wiki
Open	Feature	None	T53032 When inserting an image, set its caption by default to be the Commons image description
Open	Feature	None	T39534 Wikimedia Commons should support searching by color
Duplicate		None	T39535 Wikimedia Commons should support filtering by color
Resolved		None	T19503 Provide metadata support on Wikimedia Commons
Resolved		None	T51662 VisualEditor: Use Multimedia/Wikidata's proposed rich structured meta-data in the image insertion dialog
Resolved		None	T68108 [Epic] Store media information for files on Wikimedia Commons as structured data
Duplicate		None	T66288 basic support for structured data on mediawiki files
Invalid		Lydia_Pintscher	T76012 make use of new entity type for multimedia / structured data of media files
Open		None	T109579 [Epic] Give more sister projects access to Wikidata
Open		None	T187900 There is no way to reference a specific quote on Wikiquote
Stalled		None	T71753 [Story] Wikibase / Wikidata support on Wikiquote
Open		None	T67626 [Epic] Support for queries on-wiki (automated list generation)
Resolved		Addshore	T76019 [Story] Support new types of Entities in Wikibase Client
Resolved		thiemowmde	T135650 [Task] Migrate PropertySuggester away from assuming all entities are numeric
Resolved		Addshore	T75496 [Epic] Support new types of Entities in Wikibase Repository
Declined		None	T58711 [Task] Update the wb_terms table so it does not have a numeric entity id
Open		None	T30599 Deadlock tracking bug (tracking)
Resolved		hoo	T111535 Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
Resolved		Lydia_Pintscher	T146637 Wikidata 2016 Q4 goals
Resolved		None	T86530 Replace wb_terms table with more specialized mechanisms for terms (tracking)
Declined		None	T51982 Add missing wb_entity_per_page entries on LinksUpdate
Invalid		Lydia_Pintscher	T70176 EntityPerPageTable class should be usable from the client
Resolved		Ladsgroup	T67333 Wikibase\EntityPerPageTable::getItemsWithoutSitelinks slow query with large LIMIT offset
Resolved		Addshore	T114902 Remove numeric entity IDs from database schema
Resolved		Ladsgroup	T95685 Drop wb_entity_per_page table
Declined		None	T114903 Migrate wb_terms to using prefixed entity IDs instead of numeric IDs
Resolved		aude	T162533 Script for populating term_full_entity_id column in wb_terms table

Event Timeline

aude created this task.Apr 8 2017, 10:46 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 8 2017, 10:46 PM

aude renamed this task from Populate term_full_entity_id column in wb_terms table to Script for populating term_full_entity_id column in wb_terms table.Apr 8 2017, 10:47 PM

aude claimed this task.

aude updated the task description. (Show Details)

aude moved this task from Proposed to Doing on the Wikidata-Former-Sprint-Board board.

aude mentioned this in T159851: Add a column for full entity ID to wb_terms table.

WMDE-leszek triaged this task as High priority.Apr 10 2017, 7:15 AM

Change 347306 had a related patch set uploaded (by Aude):
[mediawiki/extensions/Wikibase@master] Script for populating term_full_entity_id column in wb_terms [WIP]

https://gerrit.wikimedia.org/r/347306

gerritbot added a project: Patch-For-Review.Apr 10 2017, 9:57 AM

Lydia_Pintscher moved this task from incoming to in progress on the Wikidata board.May 5 2017, 12:30 PM

aude added a project: User-aude.May 19 2017, 2:11 PM

aude moved this task from Backlog to Doing on the User-aude board.

WMDE-leszek moved this task from Doing to Review on the Wikidata-Former-Sprint-Board board.Jun 9 2017, 7:42 AM

daniel awarded a token.Jun 9 2017, 3:36 PM

daniel subscribed.

Change 358387 had a related patch set uploaded (by WMDE-leszek; owner: WMDE-leszek):
[mediawiki/extensions/Wikibase@master] Make TermSqlIndexBuilder only rebuild entity terms when necessary

https://gerrit.wikimedia.org/r/358387

Change 358531 had a related patch set uploaded (by WMDE-leszek; owner: WMDE-leszek):
[mediawiki/extensions/Wikibase@master] Only load entity data TermSqlIndexBuilder when necessary

https://gerrit.wikimedia.org/r/358531

Change 347306 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Script for rebuilding wb_terms table (e.g. w/ term_full_entity_id)

https://gerrit.wikimedia.org/r/347306

WMDE-leszek moved this task from Review to Monitoring on the Wikidata-Former-Sprint-Board board.Jun 13 2017, 2:22 PM

Change 358387 abandoned by WMDE-leszek:
Make TermSqlIndexBuilder only rebuild entity terms when necessary

Reason:
Not needed given what is done in Ia0409ebfd7c905b178c8ebe17945226a845e010c

https://gerrit.wikimedia.org/r/358387

daniel added a parent task: T114903: Migrate wb_terms to using prefixed entity IDs instead of numeric IDs.Jul 18 2017, 11:32 AM

daniel mentioned this in T114903: Migrate wb_terms to using prefixed entity IDs instead of numeric IDs.Jul 24 2017, 11:12 AM

Script exists. Any improvements can get their own ticket.

Restricted Application added a subscriber: PokestarFan. · View Herald TranscriptJul 24 2017, 11:18 AM

Change 358531 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Only load entity data TermSqlIndexBuilder when doing full rebuild