Page MenuHomePhabricator
Paste P94722

RUNS=100 ./find_flaky_selenium_tests
ArchivedPublic

Authored by zeljkofilipin on Jul 3 2026, 3:31 PM.
Project Tags
None
Referenced Files
F91692921: RUNS=100 ./find_flaky_selenium_tests
Jul 3 2026, 3:31 PM
Subscribers
None
~/Documents/gitlab/zfilipin/quibble-local$ RUNS=100 ./find_flaky_selenium_tests
use VERBOSE=1 for full output
logs: log/silent/
OS: Linux 6.14.0-37-generic
CPU: Intel(R) Core(TM) i5-3470 CPU @ 3.20GHz (4 cores)
RAM: 15.6 GB
bash: 5.2.21(1)-release
git: git version 2.43.0
docker: Docker version 29.6.1, build 8900f1d
docker CPUs: 4
docker RAM: 15.6 GB
Running ./run_selenium_tests 100 times
run-1 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-2 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-3 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-4 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-5 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-6 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-7 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-8 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-9 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-10 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-11 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-12 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-13 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-14 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-15 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-16 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-17 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-18 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-19 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-20 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-21 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-22 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-23 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-24 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-25 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-26 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-27 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-28 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-29 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-30 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-31 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-32 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-33 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-34 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-35 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-36 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-37 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-38 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-39 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-40 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-41 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-42 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-43 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-44 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-45 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-46 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-47 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-48 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-49 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-50 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-51 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-52 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-53 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-54 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-55 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-56 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-57 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-58 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-59 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-60 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-61 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-62 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-63 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-64 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-65 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-66 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-67 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-68 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-69 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-70 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-71 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-72 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-73 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-74 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-75 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-76 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-77 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-78 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-79 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-80 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-81 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-82 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-83 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-84 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-85 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-86 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-87 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-88 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-89 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-90 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-91 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-92 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-93 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-94 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-95 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-96 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-97 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-98 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-99 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
run-100 run_selenium_tests .................................................................................................................................................................................................................................................................................................................................................................................................................................
========================================
= Test results across 100 runs
========================================
Flaky tests (passed in some runs, failed in others):
(none)
Consistently failing tests (failed in every run — likely real failures, not flakes):
(none)
Tests that passed in every run:
100 passed: chrome.149_0_7827_155.linux.Page: should be previewable
100 passed: chrome.149_0_7827_155.linux.Page: should be creatable
100 passed: chrome.149_0_7827_155.linux.Page: should be re creatable
100 passed: chrome.149_0_7827_155.linux.Page: should be editable
100 passed: chrome.149_0_7827_155.linux.Page: should have history
100 passed: chrome.149_0_7827_155.linux.Page: should be undoable
100 passed: chrome.149_0_7827_155.linux.Special:RecentChanges: shows page creation
100 passed: chrome.149_0_7827_155.linux.Page_admin_actions: should be deletable
100 passed: chrome.149_0_7827_155.linux.Page_admin_actions: should be restorable
100 passed: chrome.149_0_7827_155.linux.Page_admin_actions: should be protectable
100 passed: chrome.149_0_7827_155.linux.Temporary_user: should not see signup form fields relevant to named users
100 passed: chrome.149_0_7827_155.linux.Temporary_user_account_creation: should be able to create account
100 passed: chrome.149_0_7827_155.linux.User: should be able to create account
100 passed: chrome.149_0_7827_155.linux.User: should be able to log in
100 passed: chrome.149_0_7827_155.linux.User: named user should see extra signup form fields when creating an account
100 passed: chrome.149_0_7827_155.linux.User: should be able to block a user
100 passed: chrome.149_0_7827_155.linux.Special:SpecialPages: should not have Edit link
100 passed: chrome.149_0_7827_155.linux.User: should be able to log in without page object
100 passed: chrome.149_0_7827_155.linux.Main_page: should have edit link when using expect
100 passed: chrome.149_0_7827_155.linux.Main_page: should have edit link when using mocha
100 passed: chrome.149_0_7827_155.linux.Main_Page: should have edit link when using page object
100 passed: chrome.149_0_7827_155.linux.API: Main Page should exist
100 passed: chrome.149_0_7827_155.linux.API: Missing Page should not exist
100 passed: chrome.149_0_7827_155.linux.BlankPage: should have its title
Tests skipped in every run:
(none)
Per-run result files: log/find_flaky_selenium_tests/run-N/
========================================
= Results
========================================
PASSED:
run-1
run-2
run-3
run-4
run-5
run-6
run-7
run-8
run-9
run-10
run-11
run-12
run-13
run-14
run-15
run-16
run-17
run-18
run-19
run-20
run-21
run-22
run-23
run-24
run-25
run-26
run-27
run-28
run-29
run-30
run-31
run-32
run-33
run-34
run-35
run-36
run-37
run-38
run-39
run-40
run-41
run-42
run-43
run-44
run-45
run-46
run-47
run-48
run-49
run-50
run-51
run-52
run-53
run-54
run-55
run-56
run-57
run-58
run-59
run-60
run-61
run-62
run-63
run-64
run-65
run-66
run-67
run-68
run-69
run-70
run-71
run-72
run-73
run-74
run-75
run-76
run-77
run-78
run-79
run-80
run-81
run-82
run-83
run-84
run-85
run-86
run-87
run-88
run-89
run-90
run-91
run-92
run-93
run-94
run-95
run-96
run-97
run-98
run-99
run-100
All passed.