Page MenuHomePhabricator

Flaky Cite cypress tests in ve-cite/veCiteIntegration.cy.js
Closed, ResolvedPublic

Description

Seen on CI for unrelated extensions

https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ContainerFilter/+/1011635
https://integration.wikimedia.org/ci/job/quibble-composer-mysql-php74-selenium-docker/14880/console

  Visual Editor Cite Integration
    (Attempt 1 of 3) should edit and verify reference content in Visual Editor
    (Attempt 2 of 3) should edit and verify reference content in Visual Editor
    1) should edit and verify reference content in Visual Editor


  0 passing (16s)
  1 failing

  1) Visual Editor Cite Integration
       should edit and verify reference content in Visual Editor:
     AssertionError: Timed out retrying after 4000ms: Expected to find content: 'Start editing' within the selector: '.oo-ui-buttonElement-button' but never did.
      at Context.eval (webpack://Cite/./cypress/e2e/tests/ve-cite/veCiteIntegration.cy.js:33:5)




  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      0                                                                                │
  │ Failing:      1                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  3                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     16 seconds                                                                       │
  │ Spec Ran:     ve-cite/veCiteIntegration.cy.js                                                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Screenshots)

  -  /workspace/log/Cite/ve-cite/veCiteIntegration.cy.js/Visual Editor Cite Integrati     (1280x720)
     on -- should edit and verify reference content in Visual Editor (failed).png                   
  -  /workspace/log/Cite/ve-cite/veCiteIntegration.cy.js/Visual Editor Cite Integrati     (1280x720)
     on -- should edit and verify reference content in Visual Editor (failed) (attemp               
     t 2).png                                                                                       
  -  /workspace/log/Cite/ve-cite/veCiteIntegration.cy.js/Visual Editor Cite Integrati     (1280x720)
     on -- should edit and verify reference content in Visual Editor (failed) (attemp               
     t 3).png                                                                                       


  (Video)

  -  Video output: /workspace/log/Cite/ve-cite/veCiteIntegration.cy.js.mp4


====================================================================================================

  (Run Finished)
tput: No value for $TERM and no -T specified


       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  backlinks.cy.js                          00:04        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  referencePreviews/referencePreviews      00:07        3        3        -        -        - │
  │    .cy.js                                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  ve-cite/reuseRefs.cy.js                   53ms        3        -        -        3        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  ve-cite/veCiteIntegration.cy.js          00:16        1        -        1        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  1 of 4 failed (25%)                      00:28       13        9        1        3        -

Event Timeline

(It is possible this is a real issue with the extension, not sure how to find the different)

Change 1012679 had a related patch set uploaded (by Awight; author: Awight):

[mediawiki/extensions/Cite@master] Skip tests causing trouble in the wild

https://gerrit.wikimedia.org/r/1012679

Change 1012679 merged by jenkins-bot:

[mediawiki/extensions/Cite@master] Skip tests causing trouble in the wild

https://gerrit.wikimedia.org/r/1012679

The "Start editing" piece doesn't exist any more since https://gerrit.wikimedia.org/r/1011114.

Most of the other examples are about a disabled menu item that can't be clicked, which is the issue described in T360026. We believe this is already fixed via https://gerrit.wikimedia.org/r/1011341.

https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74-docker/88844/console is the only outlier. Looks like the API call to create the page failed or never returned.

Change #1013023 had a related patch set uploaded (by WMDE-Fisch; author: Mareike Heuer):

[mediawiki/extensions/Cite@master] [Cypress] Unskip tests

https://gerrit.wikimedia.org/r/1013023

Change #1013023 merged by jenkins-bot:

[mediawiki/extensions/Cite@master] [Cypress] Unskip tests

https://gerrit.wikimedia.org/r/1013023

WMDE-Fisch claimed this task.