Page MenuHomePhabricator

Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily
Closed, ResolvedPublic

Description

I have noticed that we have a lot of Jenkins jobs running browser tests. That is nice. But, I have also noticed that some of the jobs are failing (red) for the last 30 days or so.

In order to have more time to focus on keeping the passing jobs passing (green), I would like to disable scenarios that are failing. I see no value in jobs that are constantly failing. It is all noise, no signal.

I will start submitting patches disabling scenarios that are failing. Feel free to fix the failing scenario and enable it to run daily again (in that order, please).

If you have any questions or comments, of if you need help in fixing the tests, please do let me know.

RepositoryTaskJenkins jobVagrant roleZuul
mediawiki/extensions/CentralAuthcentralauth
mediawiki/extensions/CentralNoticecentralnotice
mediawiki/extensions/CirrusSearchcirrussearch
mediawiki/core
mediawiki/extensions/Echoechotest, postmerge
mediawiki/extensions/Flowflowexperimental
mediawiki/extensions/Gathergathertest, postmerge
mediawiki/extensions/GettingStartedgettingstarted
mediawiki/extensions/Mathmath
mediawiki/extensions/MobileFrontendmobilefrontendtest, postmerge
mediawiki/extensions/MultimediaViewermultimediaviewertest, postmerge
mediawiki/extensions/PageTriagepagetriage
mediawiki/extensions/PdfHandlerpdfhandler
mediawiki/extensions/QuickSurveystest, postmerge
mediawiki/extensions/RelatedArticlesexperimental
mediawiki/extensions/VisualEditorvisualeditor
mediawiki/extensions/WikiLovewikilove
wmde/WikidataBrowserTestsT92619+wikidata

  • Related Objects

    StatusAssignedTask
    InvalidNone
    DuplicateNone
    Resolved• Jonas
    ResolvedTobi_WMDE_SW
    ResolvedJanZerebecki
    ResolvedTobi_WMDE_SW
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedhashar
    OpenNone
    OpenNone
    ResolvedNone
    Resolved• Jdlrobson
    Resolvedthcipriani
    Resolved• bd808
    Resolvedphuedx
    Resolvedphuedx
    ResolvedEBernhardson
    Resolvedbmansurov
    InvalidNone
    Resolved• Jdlrobson
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    ResolvedNone
    Resolvedhashar
    Declinedmatmarex
    Resolvedzeljkofilipin
    Resolveddduvall
    ResolvedVikassy
    ResolvedEsanders
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    OpenNone
    Resolvedzeljkofilipin
    DuplicateNone
    Resolvedhashar
    ResolvedTobi_WMDE_SW
    ResolvedWMDE-Fisch
    Resolvedthiemowmde
    ResolvedJanZerebecki
    Resolveddaniel
    Resolveddaniel
    ResolvedTobi_WMDE_SW
    Resolvedzeljkofilipin
    DuplicateNone
    Resolveddduvall
    InvalidJanZerebecki
    Declined• Jdlrobson
    DeclinedNone
    ResolvedJanZerebecki
    ResolvedTobi_WMDE_SW
    ResolvedTobi_WMDE_SW
    ResolvedTobi_WMDE_SW
    Resolved• Jonas
    ResolvedTobi_WMDE_SW
    ResolvedNone
    ResolvedTobi_WMDE_SW
    Resolvedadrianheine
    Duplicatezeljkofilipin
    Resolved• Jonas
    ResolvedNone
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    ResolvedNone
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolvedzeljkofilipin
    Resolveddduvall
    Resolved• Jdlrobson
    ResolvedJanZerebecki
    ResolvedNone

    Event Timeline

    There are a very large number of changes, so older changes are hidden. Show Older Changes

    Change 274360 had a related patch set uploaded (by Zfilipin):
    Delete MultimediaViewer IE 8 Selenium daily job

    https://gerrit.wikimedia.org/r/274360

    zeljkofilipin updated the task description. (Show Details)Mar 3 2016, 1:38 PM
    greg added a subscriber: greg.Mar 3 2016, 5:12 PM

    Change 274360 merged by jenkins-bot:
    Delete MultimediaViewer IE 8 Selenium daily job

    https://gerrit.wikimedia.org/r/274360

    Change 277224 had a related patch set uploaded (by Zfilipin):
    [BrowserTest] Increase the time Selenium waits for VisualEditor to load

    https://gerrit.wikimedia.org/r/277224

    Change 277224 merged by jenkins-bot:
    [BrowserTest] Increase the time Selenium waits for VisualEditor to load

    https://gerrit.wikimedia.org/r/277224

    zeljkofilipin moved this task from In-progress to Next on the Release-Engineering-Team board.
    zeljkofilipin removed zeljkofilipin as the assignee of this task.
    zeljkofilipin moved this task from Next to In Progress on the Browser-Tests-Infrastructure board.
    zeljkofilipin moved this task from Next to In-progress on the Release-Engineering-Team board.

    Change 287222 had a related patch set uploaded (by Zfilipin):
    Skip Summarize feature when running Selenium tests daily

    https://gerrit.wikimedia.org/r/287222

    Change 287222 merged by jenkins-bot:
    Skip Summarize feature when running Selenium tests daily

    https://gerrit.wikimedia.org/r/287222

    Change 288958 had a related patch set uploaded (by Zfilipin):
    Disable a couple of Cucumber scenarios that "Welcome to Wikipedia" popup breaks

    https://gerrit.wikimedia.org/r/288958

    Change 288967 had a related patch set uploaded (by Zfilipin):
    Disable Cucumber features that are broken in daily Jenkins jobs

    https://gerrit.wikimedia.org/r/288967

    Change 288977 had a related patch set uploaded (by Zfilipin):
    Fix Cucumber scenario that is broken in daily Jenkins jobs

    https://gerrit.wikimedia.org/r/288977

    Change 288980 had a related patch set uploaded (by Zfilipin):
    Disable Cucumber feature that is broken in daily Jenkins jobs

    https://gerrit.wikimedia.org/r/288980

    Change 288980 merged by jenkins-bot:
    Disable Cucumber feature that is broken in daily Jenkins jobs

    https://gerrit.wikimedia.org/r/288980

    Change 288977 merged by jenkins-bot:
    Fix Cucumber scenario that is broken in daily Jenkins jobs

    https://gerrit.wikimedia.org/r/288977

    Change 288967 merged by jenkins-bot:
    Disable Cucumber features that are broken in daily Jenkins jobs

    https://gerrit.wikimedia.org/r/288967

    Change 288958 merged by jenkins-bot:
    Disable Cucumber scenarios that are broken in daily Jenkins jobs

    https://gerrit.wikimedia.org/r/288958

    zeljkofilipin closed this task as Resolved.Jun 15 2016, 10:39 AM

    Since T134492: Ownership of Selenium tests is now resolved, each repository has an owner that is responsible for keeping the job for the repository green. I think this tracking task can be resolved. Remaining work can continue in other tasks.