Page MenuHomePhabricator
Create Task
Maniphest T227999

Full implementation of test runner
Open, Stalled, MediumPublic
Actions

Description

Tracking ticket for all phester features, planned or proposed.

Related Objects
Search...

StatusSubtypeAssignedTask
 StalledNoneT219873 Create a suite of end-to-end API test for MediaWiki core
 StalledNoneT227999 Full implementation of test runner
 ResolvedCCicalese_WMFT229474 Run Tests Locally
 OpenNoneT229476 Parallel Testing
 ResolvedCCicalese_WMFT229478 Run All Tests
 ResolvedCCicalese_WMFT229479 Machine-Readable Test Output
 ResolvedCCicalese_WMFT229480 Resources
 ResolvedCCicalese_WMFT229481 Fixtures
 ResolvedCCicalese_WMFT229483 Chaining
 ResolvedCCicalese_WMFT229485 Multi-Site Tests
 ResolvedCCicalese_WMFT229486 Parameterized Tests
 ResolvedCCicalese_WMFT229488 Validate Test Responses
 ResolvedCCicalese_WMFT229490 Multiple Agents
 ResolvedCCicalese_WMFT229491 Control HTTP Requests
 ResolvedCCicalese_WMFT229492 Unique Fake Values
 ResolvedCCicalese_WMFT229495 Redirect Support
 ResolvedCCicalese_WMFT229496 Configuration
 ResolvedCCicalese_WMFT229639 Known State
 ResolveddanielT230353 Create scripts to take and restore snapshots of a wiki database
 ResolvedCCicalese_WMFT229640 Example Tests
 ResolveddanielT229852 Create example tests set 2 (Daniel)
 Resolved• ClarakosiT229853 Create example tests set 1 (Clara)
 ResolveddanielT229854 Create a repository for integration tests and utility
 ResolvedCCicalese_WMFT229641 Action API Test Utilities
 Resolved• ClarakosiT229855 Create a utility for common functions for MediaWiki tests
 ResolvedCCicalese_WMFT229642 Minimal Testing Environment
 ResolveddanielT230202 Write documentation to setup SuperTest to run MediaWiki Tests
 ResolvedCCicalese_WMFT229643 Run API integration tests for all enabled extensions
 Resolved• ClarakosiT231910 Create a MediaWiki extension for generating a Mocha config that runs tests for all enabled extensions
 OpenNoneT231890 Wait for effects before continuing
 ResolveddanielT231822 API integration tests need a way to flush the job queue.
 OpenNoneT230211 Ensure that GET requests in API integration tests will always see the effect of previous POST requests.
 OpenNoneT231893 Run tests automatically when tests changed
 Resolved• holger.knustT230340 Set up CI for mediawiki/tools/api-testing
 ResolvedawightT233092 CI: Create a way to share a secret between MediaWiki and the testing framework.
 OpenNoneT236680 Enable API integration tests in CI for MediaWiki core
 OpenNoneT242482 WikimedaIncubator extension is incompatible with the autopatrol API tests added to MediaWiki core
 ResolvedJdforrester-WMFT242913 MW's new API tests are a breaking change which cause OpenStackManager and other extensions to fail to pass CI
 ResolvedJdforrester-WMFT243975 Run API integration tests suite in CI on core repo without extensions
 OpenNoneT243976 API integration tests should skip tests according to flags exposed by the SiteInfo API module
OpenNoneT243977 Expose flags for controlling API tests from the action API
Resolved• ClarakosiT243978 In CI, configure MediaWiki to enable API testing
 Resolved• nnikkhouiT254400 Remove ActionAPI and REST tests from api-testing node module
 ResolvedCCicalese_WMFT237105 As a developer, I can find documentation about the API Integration Test framework and how to use it
 ResolvedapaskulinT233737 Document MediaWiki integration tests

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 14 2019, 9:58 PM
CCicalese_WMF added subtasks: T227887: Phester: bind variables to session context, T227885: Phester: support session context, T227494: Phester: PHPUnit integration (experiment), T225791: Phester: Allow tests to be skipped, T225698: Phester: support for cookie jars, T225608: Phester: allow test for interactions spanning multiple sites.Jul 14 2019, 10:02 PM
CCicalese_WMF removed a subtask: T227885: Phester: support session context.
CCicalese_WMF added a subtask: T221088: Baseline implementation of Phester test runner.Jul 14 2019, 10:05 PM
CCicalese_WMF added subtasks: T225192: Phester: Support running the same tests with several sets of parameters (test cases), T224987: Phester: allow for retries, T224932: Phester: add support for cookies and sessions, T221096: Phester: parallel test execution, T221102: Phester: allow test suites to be filtered by tag, T221100: Phester: Add support for variables, T221098: Phester: support fixture files, T221094: Phester: discover tests specified by extensions, T221093: Phester: support JSON output, T221092: Phester: support HTML output, T221091: Phester: feature complete.Jul 14 2019, 10:13 PM
CCicalese_WMF removed a subtask: T221100: Phester: Add support for variables.Jul 14 2019, 10:19 PM
CCicalese_WMF added a subtask: T228101: Pick a test runner (our own or an existing one).Jul 15 2019, 8:14 PM
CCicalese_WMF added a subtask: T222103: Finalize file format for phester test definitions.Jul 15 2019, 9:06 PM
CCicalese_WMF triaged this task as Medium priority.Jul 16 2019, 3:41 AM
daniel closed subtask T221088: Baseline implementation of Phester test runner as Resolved.Jul 17 2019, 4:44 PM
daniel renamed this task from Extended implementation of Phester test runner to Full implementation of Phester test runner.Jul 23 2019, 5:56 PM
daniel updated the task description. (Show Details)
daniel removed a subtask: T221091: Phester: feature complete.Jul 24 2019, 3:49 PM
WDoranWMF moved this task from API Integration Tests to mop on the Platform Engineering board.Jul 26 2019, 7:09 PM
WDoranWMF edited projects, added Platform Team Initiatives (API Integration Tests); removed Platform Engineering (API Integration Tests).
CCicalese_WMF renamed this task from Full implementation of Phester test runner to Full implementation of test runner.Jul 30 2019, 2:26 PM
CCicalese_WMF added a project: Platform Team Workboards (Epics).Jul 31 2019, 8:29 PM
CCicalese_WMF moved this task from Epic Backlog to User Story Tasks being created on the Platform Team Workboards (Epics) board.
CCicalese_WMF added a subtask: T229492: Unique Fake Values.Jul 31 2019, 9:28 PM
CCicalese_WMF closed subtask T229478: Run All Tests as Resolved.Aug 2 2019, 2:37 AM
CCicalese_WMF closed subtask T229479: Machine-Readable Test Output as Resolved.
CCicalese_WMF closed subtask T229480: Resources as Resolved.
CCicalese_WMF closed subtask T229481: Fixtures as Resolved.
CCicalese_WMF closed subtask T229483: Chaining as Resolved.
CCicalese_WMF closed subtask T229485: Multi-Site Tests as Resolved.
CCicalese_WMF closed subtask T229486: Parameterized Tests as Resolved.
CCicalese_WMF closed subtask T229488: Validate Test Responses as Resolved.
CCicalese_WMF closed subtask T229490: Multiple Agents as Resolved.Aug 2 2019, 2:39 AM
CCicalese_WMF closed subtask T229491: Control HTTP Requests as Resolved.
CCicalese_WMF closed subtask T229492: Unique Fake Values as Resolved.
CCicalese_WMF closed subtask T229495: Redirect Support as Resolved.
CCicalese_WMF closed subtask T229496: Configuration as Resolved.
WMDE-leszek added a subscriber: WMDE-leszek.Aug 6 2019, 8:33 AM
CCicalese_WMF closed subtask T228874: Phester: support string interpolation as Invalid.Aug 12 2019, 6:35 PM
CCicalese_WMF closed subtask T228776: Phester: support step prototypes as Invalid.
CCicalese_WMF closed subtask T228884: Phester: provide a way to generate a unique value. as Invalid.
CCicalese_WMF closed subtask T228889: Phester: support for resources as Invalid.
CCicalese_WMF closed subtask T228894: Phester: list fixtures and the variables they expose as Invalid.
CCicalese_WMF closed subtask T221098: Phester: support fixture files as Invalid.Aug 12 2019, 6:38 PM
CCicalese_WMF closed subtask T224932: Phester: add support for cookies and sessions as Invalid.
CCicalese_WMF closed subtask T222103: Finalize file format for phester test definitions as Invalid.
CCicalese_WMF closed subtask T227887: Phester: bind variables to session context as Invalid.
CCicalese_WMF closed subtask T227494: Phester: PHPUnit integration (experiment) as Invalid.
CCicalese_WMF closed subtask T225791: Phester: Allow tests to be skipped as Invalid.
CCicalese_WMF closed subtask T225698: Phester: support for cookie jars as Invalid.
CCicalese_WMF closed subtask T225608: Phester: allow test for interactions spanning multiple sites as Invalid.
CCicalese_WMF closed subtask T224987: Phester: allow for retries as Invalid.Aug 12 2019, 6:40 PM
CCicalese_WMF closed subtask T221096: Phester: parallel test execution as Invalid.
CCicalese_WMF closed subtask T221102: Phester: allow test suites to be filtered by tag as Invalid.
CCicalese_WMF closed subtask T221094: Phester: discover tests specified by extensions as Invalid.
CCicalese_WMF closed subtask T221092: Phester: support HTML output as Invalid.
CCicalese_WMF closed subtask T221093: Phester: support JSON output as Invalid.
CCicalese_WMF closed subtask T225192: Phester: Support running the same tests with several sets of parameters (test cases) as Invalid.Aug 12 2019, 6:48 PM
CCicalese_WMF closed subtask T228101: Pick a test runner (our own or an existing one) as Resolved.
CCicalese_WMF edited parent tasks, added: T219873: Create a suite of end-to-end API test for MediaWiki core; removed: T219879: Create a test runner for end-to-end API tests (Phester).Aug 12 2019, 6:54 PM
CCicalese_WMF removed a subtask: T227887: Phester: bind variables to session context.
CCicalese_WMF removed a subtask: T227494: Phester: PHPUnit integration (experiment).Aug 12 2019, 6:57 PM
CCicalese_WMF removed a subtask: T225791: Phester: Allow tests to be skipped.
CCicalese_WMF removed a subtask: T225698: Phester: support for cookie jars.
CCicalese_WMF removed a subtask: T225608: Phester: allow test for interactions spanning multiple sites.
CCicalese_WMF removed a subtask: T224987: Phester: allow for retries.
CCicalese_WMF removed a subtask: T221088: Baseline implementation of Phester test runner.
CCicalese_WMF removed a subtask: T225192: Phester: Support running the same tests with several sets of parameters (test cases).Aug 12 2019, 6:59 PM
CCicalese_WMF removed a subtask: T221096: Phester: parallel test execution.
CCicalese_WMF removed a subtask: T221102: Phester: allow test suites to be filtered by tag.
CCicalese_WMF removed a subtask: T221094: Phester: discover tests specified by extensions.
CCicalese_WMF removed a subtask: T221092: Phester: support HTML output.
CCicalese_WMF removed a subtask: T221093: Phester: support JSON output.
CCicalese_WMF removed a subtask: T228101: Pick a test runner (our own or an existing one).Aug 12 2019, 7:03 PM
CCicalese_WMF removed a subtask: T222103: Finalize file format for phester test definitions.Aug 12 2019, 7:14 PM
CCicalese_WMF removed a subtask: T228776: Phester: support step prototypes.
CCicalese_WMF removed a subtask: T228874: Phester: support string interpolation.
CCicalese_WMF removed a subtask: T228884: Phester: provide a way to generate a unique value..Aug 12 2019, 7:16 PM
CCicalese_WMF removed a subtask: T228889: Phester: support for resources.
CCicalese_WMF removed a subtask: T228894: Phester: list fixtures and the variables they expose.
CCicalese_WMF removed a subtask: T221098: Phester: support fixture files.
CCicalese_WMF removed a subtask: T224932: Phester: add support for cookies and sessions.
CCicalese_WMF closed subtask T229641: Action API Test Utilities as Resolved.Aug 13 2019, 2:41 PM
CCicalese_WMF moved this task from User Story Tasks being created to Ready for Engineering on the Platform Team Workboards (Epics) board.Aug 14 2019, 2:28 PM
CCicalese_WMF moved this task from Ready for Engineering to Doing on the Platform Team Workboards (Epics) board.
CCicalese_WMF closed subtask T229642: Minimal Testing Environment as Resolved.Aug 14 2019, 5:21 PM
CCicalese_WMF closed subtask T229643: Run API integration tests for all enabled extensions as Resolved.Sep 12 2019, 7:15 PM
CCicalese_WMF closed subtask T231893: Run tests automatically when tests changed as Resolved.Oct 28 2019, 1:44 PM
CCicalese_WMF closed subtask T229639: Known State as Resolved.Oct 28 2019, 1:54 PM
CCicalese_WMF closed subtask T229640: Example Tests as Resolved.Oct 31 2019, 5:09 PM
CCicalese_WMF closed subtask T229474: Run Tests Locally as Resolved.Oct 31 2019, 5:32 PM
CCicalese_WMF removed a subtask: T229475: Monitoring.Nov 1 2019, 1:45 PM
CCicalese_WMF reopened subtask T231893: Run tests automatically when tests changed as Open.Nov 1 2019, 1:56 PM
CCicalese_WMF closed subtask T237105: As a developer, I can find documentation about the API Integration Test framework and how to use it as Resolved.Nov 20 2019, 10:19 PM
CCicalese_WMF moved this task from Doing to Epic Backlog on the Platform Team Workboards (Epics) board.Apr 7 2020, 6:53 PM
• eprodromou moved this task from Epic Backlog to Paused on the Platform Team Workboards (Epics) board.Apr 15 2020, 2:54 PM
Naike changed the task status from Open to Stalled.Jun 5 2020, 4:21 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL