We've made a significant change to add article schemas to many pages across wikis. Given the scope of this change, the impact possible for third-parties, and other factors, it is worth investing in additional team QA explicitly. This task tracks that work.
Per T208763, schemas have been enabled for 25% of pages. Verify:
- Approximately 75% of main namespace pages are unaffected and do not have the schema.
- Schemas are enabled for bucketed main namespace pages
- Schemas are enabled even the main page (if bucketed).
- Schemas are not enabled for other namespaces such as talk and user.
- Schemas are understood by https://search.google.com/structured-data/testing-tool/u/0/. When all data is available for a given page, there should be no errors reported. When data is unavailable, such as short description or page image, the linkage should still be presented but with missing data omitted.
- Schema data linked appears correct for pages in the new treatment. E.g., the headline should match the associated Q item's short description and the last modified and first published timestamps should match the page.
- Messages from T207790 are used in the data.
- No new logstash or client errors occur.
- If an article image is referenced, it matches the page image (show under page info and the og:image meta HTML tag property).
- The data is valid JSON-LD as verified by https://json-ld.org/playground-dev/.
- The data is linked properly as verified by http://linter.structured-data.org. E.g. http://linter.structured-data.org/?url=https:%2F%2Fde.wikipedia.org%2Fapi%2Frest_v1%2Fpage%2Fhtml%2FDouglas_Adams.
- At least 5 examples of the new treatment from the beta cluster are recorded as comments on this task (see examples below for format expected).
- The new HTML script tag appears towards the bottom of the page, not the top and otherwise doesn't alter the HTML.
- Try to think of other things to check or try to break it locally.
- All of the above are tested on both en and non-en beta clusters. E.g., https://simple.wikipedia.beta.wmflabs.org/wiki/Main_Page or https://de.wikipedia.beta.wmflabs.org/wiki/Main_Page.
- All of the above are tested on both mobile and non-mobile sites.
Examples of the new treatment are:
<script type="application/ld+json">{"@context":"https:\/\/schema.org","@type":"Article","name":"Kitten","url":"https:\/\/en.wikipedia.org\/wiki\/Kitten","sameAs":"https:\/\/www.wikidata.org\/entity\/Q147","mainEntity":"https:\/\/www.wikidata.org\/entity\/Q147","author":{"@type":"Organization","name":"Contributors to Wikimedia projects"},"publisher":{"@type":"Organization","name":"Wikimedia Foundation, Inc.","logo":{"@type":"ImageObject","url":"https:\/\/www.wikimedia.org\/static\/images\/wmf-hor-googpub.png"}},"datePublished":"2002-07-31T13:37:08Z","dateModified":"2018-10-08T14:18:31Z","image":"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/thumb\/0\/06\/Kitten_in_Rizal_Park%2C_Manila.jpg\/1200px-Kitten_in_Rizal_Park%2C_Manila.jpg","headline":"young of a cat"}</script>
<script type="application/ld+json"> { "@context": "https://schema.org", "@type": "Article", "name": "Douglas Adams", "url": "https://de.wikipedia.org/wiki/Douglas_Adams", "sameAs": "https://www.wikidata.org/entity/Q42", "mainEntity": "https://www.wikidata.org/entity/Q42", "author": { "@type": "Organization", "name": "Contributors to Wikimedia projects" }, "publisher": { "@type": "Organization", "name": "Wikimedia Foundation, Inc.", "logo": { "@type": "ImageObject", "url": "https://www.wikimedia.org/static/images/wmf-hor-googpub.png" } }, "datePublished": "2002-05-27T18:26:23Z", "dateModified": "2018-09-28T20:16:12Z", "image": "https://upload.wikimedia.org/wikipedia/commons/c/c0/Douglas_adams_portrait_cropped.jpg", "headline": "British author and humorist (1952–2001)" } </script>
Acceptance criteria
- A point person / hero / steward has taken ownership of the overall testing
- The point person has ensured that several people (other than themselves) have looked at the task
- The point person should tick off all the test steps above that have been adequately tested
- All test steps related to the schema being enabled have been performed
- We have confirmed that no errors are occurring in logstash
- We have confirmed that the A/B sampling is working correctly.