Page MenuHomePhabricator

Perform full test suite using Wikimedia CI
Open, LowPublic

Description

Currently Wikimedia CI only runs tests pre-merge that do not use the network, and only against Python 2.7 and 3.4+. At T114421#2173558 @JanZerebecki suggests that the full test suite could be run using Wikimedia CI instead of Travis CI.

After merge, the sync to GitHub triggers execution of builds on Travis CI and Appveyor:

https://github.com/wikimedia/pywikibot/blob/master/.travis.yml

  • Python 2.7, 3.4, 3.5, 3.6, 3.7 and 3.8-dev
  • Beta, Test and Production Wikimedia sites including Wikisource, Wiktionary, Wikidata, Wikivoyage and Wikipedia
  • OAuth testing
  • Non-Wikimedia sites Wikia & Musicbrainz
  • coverage reports sent to Codecov.io
  • code redundancy reports sent to Codeclimate.com

(There are also unit test that run again specific sites because they need a specific configuration to test a feature, such as stewards.wikimedia.org is used to test private wikis.)

https://github.com/wikimedia/pywikibot/blob/master/.appveyor.yml

  • Python 2.7, 3.4, 3.5, 3.6, 3.7 and 3.8-dev
  • 32-bit and 64-bit
  • Test wiki
  • coverage reports sent to Codecov.io

Steps to integration tests against a specific remote wiki

  1. clone pywikibot-core ,
  2. create a user-config.py point variables family and mylang at the desired wiki (created using generate_user_files.py if necessary)
  3. then run the test suite using nose ; see https://github.com/wikimedia/pywikibot/tree/master/tests

tl;dr: Move our post-merge Travis-CI, Appveyor and Codecov tests to Wikimedia-CI

Details

Related Gerrit Patches:

Event Timeline

jayvdb created this task.Apr 8 2016, 10:57 AM
Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. · View Herald TranscriptApr 8 2016, 10:57 AM
jayvdb updated the task description. (Show Details)Apr 8 2016, 10:58 AM
Dalba awarded a token.Apr 10 2016, 6:13 AM
Magul claimed this task.Nov 17 2016, 7:59 PM
Xqt triaged this task as Low priority.May 28 2017, 2:24 PM
D3r1ck01 moved this task from Backlog to Needs Review on the Pywikibot board.Nov 5 2018, 11:32 AM
Dvorapa updated the task description. (Show Details)Feb 23 2019, 10:10 PM
Dvorapa updated the task description. (Show Details)
Dvorapa updated the task description. (Show Details)
Dvorapa updated the task description. (Show Details)Feb 23 2019, 10:28 PM
Dvorapa updated the task description. (Show Details)Feb 23 2019, 10:31 PM
Xqt removed Magul as the assignee of this task.Mar 5 2019, 4:14 AM
Xqt added a subscriber: Magul.

Change 513700 had a related patch set uploaded (by Dvorapa; owner: Dvorapa):
[pywikibot/core@master] [TEST] Test Pywikibot in Wikimedia CI (1/2)

https://gerrit.wikimedia.org/r/513700

Change 510927 had a related patch set uploaded (by Dvorapa; owner: Dvorapa):
[integration/config@master] [WIP] Test Pywikibot in Wikimedia CI (2/2)

https://gerrit.wikimedia.org/r/510927