Change Details

We have a [[ https://docs.google.com/document/d/1kVcMyPfmo2ttJZuzLmP9u8VWmv8nujxQelz5513mVLM/edit#heading=h.nbrfnlep7t7g | list ]] of terms to try against the template search dialog as we make changes. We would like an automated method of evaluating performance and progress. Acceptance criteria: [x] **Reads** a tsv file of (wiki_id, search term, expected results as json list) [x] **Generates** API queries simulating our search. For example, for the string `abcdef` we might have `https://en.wikipedia.org/w/api.php?action=query&format=json&formatversion=2&prop=info|pageprops&action=query&list=search&ppprop=disambiguation&redirects=true&srsearch=abcdef*&srnamespace=10&srlimit=10&srprop=redirecttitle` [x] The exact query generated should track the current and planned implementation of the feature in VisualEditor and TemplateWizard. [] Consider making this **pluggable**. [x] Supports running against multiple wikis in a run, according to the input column. [] Runs the queries in parallel, at a given maximum **concurrency**. Initially 4 (see also https://www.mediawiki.org/wiki/API:Etiquette). [] ~~**Scores** the results by counting how many of the expected results appear (in any order).~~ [] **Outputs** a tsv file of (wiki_id, search_term, score, expected results, actual results as json). [x] README [] at least one basic integration test. Code: https://gitlab.com/wmde/technical-wishes/search-checker

We have a [[ https://docs.google.com/document/d/1kVcMyPfmo2ttJZuzLmP9u8VWmv8nujxQelz5513mVLM/edit#heading=h.nbrfnlep7t7g | list ]] of terms to try against the template search dialog as we make changes. We would like an automated method of evaluating performance and progress. Acceptance criteria: [x] **Reads** a tsv file of (wiki_id, search term, expected results as json list) [x] **Generates** API queries simulating our search. For example, for the string `abcdef` we might have `https://en.wikipedia.org/w/api.php?action=query&format=json&formatversion=2&prop=info|pageprops&action=query&list=search&ppprop=disambiguation&redirects=true&srsearch=abcdef*&srnamespace=10&srlimit=10&srprop=redirecttitle` [x] The exact query generated should track the current and planned implementation of the feature in VisualEditor and TemplateWizard. [x] Consider making this **pluggable**. [x] Supports running against multiple wikis in a run, according to the input column. [x] Runs the queries in parallel, at a given maximum **concurrency**. Initially 4 (see also https://www.mediawiki.org/wiki/API:Etiquette). [] ~~**Scores** the results by counting how many of the expected results appear (in any order).~~ [x] **Outputs** a tsv file of (wiki_id, search_term, score, expected results, actual results as json). [x] README [x] at least one basic integration test. Code: https://gitlab.com/wmde/technical-wishes/search-checker

We have a [[ https://docs.google.com/document/d/1kVcMyPfmo2ttJZuzLmP9u8VWmv8nujxQelz5513mVLM/edit#heading=h.nbrfnlep7t7g | list ]] of terms to try against the template search dialog as we make changes. We would like an automated method of evaluating performance and progress. Acceptance criteria: [x] **Reads** a tsv file of (wiki_id, search term, expected results as json list) [x] **Generates** API queries simulating our search. For example, for the string `abcdef` we might have `https://en.wikipedia.org/w/api.php?action=query&format=json&formatversion=2&prop=info|pageprops&action=query&list=search&ppprop=disambiguation&redirects=true&srsearch=abcdef*&srnamespace=10&srlimit=10&srprop=redirecttitle` [x] The exact query generated should track the current and planned implementation of the feature in VisualEditor and TemplateWizard. [x] Consider making this **pluggable**. [x] Supports running against multiple wikis in a run, according to the input column. [x] Runs the queries in parallel, at a given maximum **concurrency**. Initially 4 (see also https://www.mediawiki.org/wiki/API:Etiquette). [] ~~**Scores** the results by counting how many of the expected results appear (in any order).~~ [x] **Outputs** a tsv file of (wiki_id, search_term, score, expected results, actual results as json). [x] README [x] at least one basic integration test. Code: https://gitlab.com/wmde/technical-wishes/search-checker