templatesWithParams misses template where a parameter value has a curly brace
Closed, ResolvedPublic
Actions

Assigned To

None

Authored By

	JeanFred
	Mar 25 2021, 4:27 PM

Description

Investigating T240312: Error with curly braces in selector (eg when using subquery or UNION), I came down to pywikibot:

Reproduction steps:

import pywikibot

def main():
    site = pywikibot.Site(url="https://www.wikidata.org/wiki/")
    page_title = "User:Jean-Frédéric/T240312"
    page = pywikibot.Page(site, page_title)
    all_templates_with_params = page.templatesWithParams()
    print(all_templates_with_params)


if __name__ == "__main__":
    main()

Expected results:

[(Page('Template:Property dashboard'), ['grouping_property=P131'<snip>]), (Page('Template:Property dashboard end'), [])]

Actual results:

[(Page('Template:Property dashboard end'), [])]

Related Objects
Search...

Status	Assigned	Task
Resolved	JeanFred	T240312 Error with curly braces in selector (eg when using subquery or UNION)
Open	None	T229723 Insufficient wikitext regex parser functions in textlib (tracking)
Resolved	None	T278454 templatesWithParams misses template where a parameter value has a curly brace
Resolved	Xqt	T106763 Mandatory dependency on mwparserfromhell
Resolved	Ladsgroup	T88069 Add pure python mwparserfromhell to nightlies

Event Timeline

JeanFred created this task.Mar 25 2021, 4:27 PM

Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. · View Herald TranscriptMar 25 2021, 4:27 PM

Looks somewhat similar to T207582: templatesWithParams() doesn't seem to get all templates in Hebrew

JeanFred added a parent task: T240312: Error with curly braces in selector (eg when using subquery or UNION).Mar 25 2021, 4:28 PM

JeanFred mentioned this in T240312: Error with curly braces in selector (eg when using subquery or UNION).Mar 25 2021, 4:31 PM

This is a known restriction of the parsing regex. to get the expected result please pip install mwparserfromhell. Here are the results:

Using parsing regex

>>> import pywikibot
>>> site = pywikibot.Site().data_repository()
>>> page = pywikibot.Page(site, 'User:Jean-Frédéric/T240312')
>>> temp = page.templatesWithParams()
>>> temp
[(Page('Template:Property dashboard end'), [])]
>>>

Using mwparserfromhell

>>> import pywikibot
>>> site = pywikibot.Site().data_repository()
>>> page = pywikibot.Page(site, 'User:Jean-Frédéric/T240312')
>>> temp = page.templatesWithParams()
>>> temp
[(Page('Template:Property dashboard'), ['grouping_property=P131', 'grouping_threshold=0', 'higher_grouping=wdt:P131', 'properties=P625,P18,P6375', 'property_threshold=0', 'selector_sparql=wdt:P17 wd:Q408; wdt:P31 ?type . { SELECT * WHERE { ?type wdt:P279 wd:Q7075 } }', 'stats_for_no_group=1']), (Page('Template:Property dashboard end'), [])]
>>>

Probably mwparserfromhell or wikitextparser should become mandatory for Pywikibot.

Xqt added a parent task: T229723: Insufficient wikitext regex parser functions in textlib (tracking).Mar 25 2021, 7:09 PM

JeanFred mentioned this in R2566:bcc4fe412784: Add mwparserfromhell to requirements to allow advanced SPAQL constructs.Mar 26 2021, 8:39 PM

@Xqt Thanks for the swift answer! Installed mwparserfromhell and works like a charm. Thanks!

Xqt added a subtask: T106763: Mandatory dependency on mwparserfromhell.Apr 12 2021, 4:45 PM

JJMC89 closed subtask T106763: Mandatory dependency on mwparserfromhell as Resolved.Apr 13 2021, 4:05 PM

JJMC89 closed this task as Resolved.Apr 13 2021, 4:08 PM

templatesWithParams misses template where a parameter value has a curly braceClosed, ResolvedPublicActions