analyse template usage on Wiktionaries
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Lydia_Pintscher
	Jan 11 2018, 1:24 PM

Description

I'd like to better understand how, where and why templates are currently used on the Wiktionaries so we can learn more about if there is anything we need to take into account for the development of the Lexeme entity type that we don't already have on our radar.

Some helpful questions to get started:

What are the most used templates?
What general purpose do they serve? (formatting? invisible markup? text generation?)
How many templates are used on a page on average?
Are there noteworthy differences in template usage across the different Wiktionaries?

Event Timeline

Lydia_Pintscher created this task.Jan 11 2018, 1:24 PM

Restricted Application added a project: Wikidata. · View Herald TranscriptJan 11 2018, 1:24 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Lydia_Pintscher updated the task description. (Show Details)Jan 11 2018, 1:24 PM

GoranSMilovanovic added a project: User-GoranSMilovanovic.Jan 11 2018, 1:53 PM

GoranSMilovanovic moved this task from Technical Wishlist to Incoming on the User-GoranSMilovanovic board.

I wonder if "What general purpose they serve" is answerable by a quantitative study.

Amire80 subscribed.Feb 3 2018, 3:24 PM

(Just a comment: I absolutely love this task. This is the right way to understand how community works and what can be learned to make a good tool. Many Wikimedia software development projects should do something like this.)

@Amire80 @Lydia_Pintscher I am working on three (3) developments/analytics in parallel now. I am on this as soon as the situation clears up a bit,

GoranSMilovanovic moved this task from Incoming to Prioritized on the User-GoranSMilovanovic board.Feb 3 2018, 4:05 PM

@Lydia_Pintscher Wikimedia Template is

(1) an instance of Wikimedia project page, and
(2) a subclass of Wikimedia project page

at the same time. Is there any specific reason why is this so?

He7d3r subscribed.Feb 6 2018, 3:27 PM

That looks like a mistake to me. Fixed.

@Lydia_Pintscher You did, and I've learned that immediately from the WDCM Structure Dashboard (check-out: Make your own network tab, an enter any Wikidata item, or up to five of them).

Now let's see about those templates.

@Lydia_Pintscher Please find enclosed the following:

(1) Report on Wikimedia Template Usage in Wiktionaries, and
(2) a full source data set used to produce everything that is found in the Report. The table is described in the text.

Please let me know if you need any additional details.

totalTemplateUsage.csv101 KBDownload

Template Usage Report.odt32 KBDownload

Thanks a lot, Goran!
Amir just showed me https://en.wiktionary.org/wiki/Special:MostTranscludedPages in addition which lists the templates and modules that are most used (not in the Wikidata usage sense but in the transclusion sense) for English Wiktionary. Equivalent pages exist on the other Wiktionaries. I'll have a look at those.

@Lydia_Pintscher Hmm, I had some doubts on whether a case of "S" aspect Wikidata usage is equivalent to transclusion or not for templates. If you need these pages that @Ladsgroup pointed to web-scraped and served or analyzed somehow - let me know. Also, do you happen to know how were these transclusion statistics produced? Thanks.

They are extracted from templatelinks table

@Ladsgroup Thanks, Amir - and exactly as I have assumed. @Lydia_Pintscher I wanted to by-pass the analysis of the templatelinks tables because I would face the same problem there as I did in my early attempts to analize the wbc_entity_usage tables from SQL in the beginning, while sqooping them first would be a massive operation (taking 6, 7 hours on the analytics cluster for the wbc_entity_usage tables for WDCM). Anyways, this has resolved itself with Amir's reference towards the already processed transclusion data sets from templatelinks. Again, thank you @Ladsgroup

SG9tZVBoYWJyaWNhdG9yCk5vIG1lc3NhZ2VzLiBObyBub3RpZmljYXRpb25zLgoKICAgIFNlYXJjaAoKQ3JlYXRlIFRhc2sKTWFuaXBoZXN0ClQxOTcyODEKRml4IGZhaWxpbmcgd2VicmVxdWVzdCBob3VycyAodXBsb2FkIGFuZCB0ZXh0IDIwMTgtMDYtMTQtMTEpCk9wZW4sIE5lZWRzIFRyaWFnZVB1YmxpYwoKICAgIEVkaXQgVGFzawogICAgRWRpdCBSZWxhdGVkIFRhc2tzLi4uCiAgICBFZGl0IFJlbGF0ZWQgT2JqZWN0cy4uLgogICAgUHJvdGVjdCBhcyBzZWN1cml0eSBpc3N1ZQoKICAgIE11dGUgTm90aWZpY2F0aW9ucwogICAgQXdhcmQgVG9rZW4KICAgIEZsYWcgRm9yIExhdGVyCgpUYWdzCgogICAgQW5hbHl0aWNzLUthbmJhbiAoSW4gUHJvZ3Jlc3MpCgpTdWJzY3JpYmVycwpBa2xhcHBlciwgSkFsbGVtYW5kb3UKQXNzaWduZWQgVG8KSkFsbGVtYW5kb3UKQXV0aG9yZWQgQnkKSkFsbGVtYW5kb3UsIEZyaSwgSnVuIDE1CkRlc2NyaXB0aW9uCgpPb3ppZSBqb2JzIGhhdmUgYmVlbiBmYWlsaW5nIGF0IGxlYXN0IGEgZmV3IHRpbWVzIGVhY2guIE1vcmUgaW52ZXN0aWdhdGlvbiBuZWVkZWQuCkpBbGxlbWFuZG91IGNyZWF0ZWQgdGhpcyB0YXNrLkZyaSwgSnVuIDE1LCA3OjIxIEFNCkhlcmFsZCBhZGRlZCBhIHN1YnNjcmliZXI6IEFrbGFwcGVyLiC3IFZpZXcgSGVyYWxkIFRyYW5zY3JpcHRGcmksIEp1biAxNSwgNzoyMSBBTQpKQWxsZW1hbmRvdSBjbGFpbWVkIHRoaXMgdGFzay5GcmksIEp1biAxNSwgNzoyMiBBTQpKQWxsZW1hbmRvdSB1cGRhdGVkIHRoZSB0YXNrIGRlc2NyaXB0aW9uLiAoU2hvdyBEZXRhaWxzKQpKQWxsZW1hbmRvdSBhZGRlZCBhIHByb2plY3Q6IEFuYWx5dGljcy1LYW5iYW4uCkpBbGxlbWFuZG91IG1vdmVkIHRoaXMgdGFzayBmcm9tIE5leHQgVXAgdG8gSW4gUHJvZ3Jlc3Mgb24gdGhlIEFuYWx5dGljcy1LYW5iYW4gYm9hcmQuCkNoYW5nZSBTdWJzY3JpYmVycwpDaGFuZ2UgUHJpb3JpdHkKQXNzaWduIC8gQ2xhaW0KTW92ZSBvbiBXb3JrYm9hcmQKQ2hhbmdlIFByb2plY3QgVGFncwpBbmFseXRpY3MtS2FuYmFuCtcKU2VjdXJpdHkK1wpXaWtpbWVkaWEtVkUtQ2FtcGFpZ25zIChTMi0yMDE4KQrXClNjYXAK1wpTY2FwIChTY2FwMy1BZG9wdGlvbi1QaGFzZTIpCtcKQWJ1c2VGaWx0ZXIK1wpEYXRhLXJlbGVhc2UK1wpIYXNodGFncwrXCkxhYnNEQi1BdWRpdG9yCtcKTGFkaWVzLVRoYXQtRk9TUy1NZWRpYVdpa2kK1wpMYW5ndWFnZS0yMDE4LUFwci1KdW5lCtcKTGFuZ3VhZ2UtMjAxOC1KYW4tTWFyCtcKSEhWTQrXCkhBV2VsY29tZQrXCkJvbGQKSXRhbGljcwpNb25vc3BhY2VkCkxpbmsKQnVsbGV0ZWQgTGlzdApOdW1iZXJlZCBMaXN0CkNvZGUgQmxvY2sKUXVvdGUKVGFibGUKVXBsb2FkIEZpbGUKTWVtZQpQcmV2aWV3CkhlbHAKRnVsbHNjcmVlbiBNb2RlClBpbiBGb3JtIE9uIFNjcmVlbgoyMzg0ODJuMzc1IGFkZGVkIHByb2plY3RzOiBTZWN1cml0eSwgV2lraW1lZGlhLVZFLUNhbXBhaWducyAoUzItMjAxOCksIFNjYXAgKFNjYXAzLUFkb3B0aW9uLVBoYXNlMiksIEFidXNlRmlsdGVyLCBEYXRhLXJlbGVhc2UsIEhhc2h0YWdzLCBMYWJzREItQXVkaXRvciwgTGFkaWVzLVRoYXQtRk9TUy1NZWRpYVdpa2ksIExhbmd1YWdlLTIwMTgtQXByLUp1bmUsIExhbmd1YWdlLTIwMTgtSmFuLU1hciwgSEhWTSwgSEFXZWxjb21lLlBSRVZJRVcKMjM4NDgybjM3NSBtb3ZlZCB0aGlzIHRhc2sgZnJvbSBJbiBQcm9ncmVzcyB0byBJbiBDb2RlIFJldmlldyBvbiB0aGUgQW5hbHl0aWNzLUthbmJhbiBib2FyZC4KMjM4NDgybjM3NSByZW1vdmVkIEpBbGxlbWFuZG91IGFzIHRoZSBhc3NpZ25lZSBvZiB0aGlzIHRhc2suCjIzODQ4Mm4zNzUgdHJpYWdlZCB0aGlzIHRhc2sgYXMgTG93ZXN0IHByaW9yaXR5LgoyMzg0ODJuMzc1IHJlbW92ZWQgc3Vic2NyaWJlcnM6IEFrbGFwcGVyLCBKQWxsZW1hbmRvdS4KQ29udGVudCBsaWNlbnNlZCB1bmRlciBDcmVhdGl2ZSBDb21tb25zIEF0dHJpYnV0aW9uLVNoYXJlQWxpa2UgMy4wIChDQy1CWS1TQSkgdW5sZXNzIG90aGVyd2lzZSBub3RlZDsgY29kZSBsaWNlbnNlZCB1bmRlciBHTlUgR2VuZXJhbCBQdWJsaWMgTGljZW5zZSAoR1BMKSBvciBvdGhlciBvcGVuIHNvdXJjZSBsaWNlbnNlcy4gQnkgdXNpbmcgdGhpcyBzaXRlLCB5b3UgYWdyZWUgdG8gdGhlIFRlcm1zIG9mIFVzZSwgUHJpdmFjeSBQb2xpY3ksIGFuZCBDb2RlIG9mIENvbmR1Y3QuILcgV2lraW1lZGlhIEZvdW5kYXRpb24gtyBQcml2YWN5IFBvbGljeSC3IENvZGUgb2YgQ29uZHVjdCC3IFRlcm1zIG9mIFVzZSC3IERpc2NsYWltZXIgtyBDQy1CWS1TQSC3IEdQTApZb3VyIGJyb3dzZXIgdGltZXpvbmUgc2V0dGluZyBkaWZmZXJzIGZyb20gdGhlIHRpbWV6b25lIHNldHRpbmcgaW4geW91ciBwcm9maWxlLCBjbGljayB0byByZWNvbmNpbGUu

Aklapper raised the priority of this task from Lowest to Needs Triage.Jun 15 2018, 12:44 PM

Aklapper removed projects: HAWelcome, HHVM, Language-2018-Jan-Mar, Language-2018-Apr-June, Ladies-That-FOSS-MediaWiki, LabsDB-Auditor, Hashtags, Data-release, AbuseFilter, Scap (Scap3-Adoption-Phase2), Wikimedia-VE-Campaigns (S2-2018), acl*security, Analytics-Kanban.

Aklapper edited subscribers, added: Aklapper; removed: • 238482n375.

Aklapper assigned this task to GoranSMilovanovic.Jun 15 2018, 12:47 PM

analyse template usage on WiktionariesClosed, ResolvedPublicActions

Description

Event Timeline

analyse template usage on Wiktionaries
Closed, ResolvedPublic
Actions