Page MenuHomePhabricator
Create Task
Maniphest T179188

Video recording for Selenium tests in Node.js
Closed, ResolvedPublic
Actions

Assigned To
zeljkofilipin
Authored By
zeljkofilipin
Oct 27 2017, 2:18 PM
Tags
Referenced Files
F16509400: User-should-be-able-to-log-in.mp4
Mar 31 2018, 12:40 PM
F16463592: selenium.mp4
Mar 30 2018, 12:44 PM
F16421058: selenium.mp4
Mar 29 2018, 11:09 AM
Subscribers
Addshore
Aklapper
gabriel-wmde
gerritbot
hashar
zeljkofilipin
zhuyifei1999
Tokens
"Party Time" token, awarded by zeljkofilipin."Like" token, awarded by gabriel-wmde."Mountain of Wealth" token, awarded by Jdlrobson.

Description

Status

Done.

Patches

🏝 422933: Selenium: record video of every test

How to test locally

Description

It was implemented in Ruby framework. There are two options:

  • Sauce Labs
  • Xvfb

There are tools similar to headless ruby gem:

Video is recorded via ffmpeg.

Links:

Details

SubjectRepoBranchLines +/-
selenium: video recording reportermediawiki/coremaster+148 -62
Selenium: record video of every testmediawiki/coremaster+79 -8
WIP killall ffmpegintegration/configmaster+1 -0
WIP Selenium: record videointegration/configmaster+1 -8
Selenium: update WebdriverIO configurationmediawiki/coremaster+109 -53
Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
zeljkofilipin updated the task description. (Show Details)Mar 21 2018, 12:45 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin updated the task description. (Show Details)Mar 21 2018, 1:51 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin updated the task description. (Show Details)Mar 21 2018, 3:02 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin rescinded a token.Mar 27 2018, 4:33 PM
zeljkofilipin awarded a token.
zeljkofilipin updated the task description. (Show Details)Mar 27 2018, 4:36 PM
zeljkofilipin added a subscriber: hashar.
zeljkofilipin updated the task description. (Show Details)Mar 28 2018, 3:32 PM
zeljkofilipin added a comment.EditedMar 28 2018, 4:11 PM
mediawiki/vagrant$ vagrant ssh
...

vagrant@vagrant:~$ cd /vagrant/mediawiki

vagrant@vagrant:/vagrant/mediawiki$ sudo apt-get install ffmpeg xvfb
...

vagrant@vagrant:/vagrant/mediawiki$ export DISPLAY=:94

vagrant@vagrant:/vagrant/mediawiki$ Xvfb "$DISPLAY" -screen 0 1280x1024x24 &
[1] 2053

vagrant@vagrant:/vagrant/mediawiki$ ffmpeg -f x11grab  -video_size 1280x1024 -i "$DISPLAY" -loglevel error -nostdin -pix_fmt yuv420p log/selenium.mp4 &
...

vagrant@vagrant:/vagrant/mediawiki$ npm run selenium
...

vagrant@vagrant:/vagrant/mediawiki$ killall ffmpeg Xvfb
  • open mediawiki/vagrant/mediawiki/log/selenium.mp4 on your desktop machine
zeljkofilipin rescinded a token.Mar 29 2018, 9:34 AM
zeljkofilipin awarded a token.
zeljkofilipin added a comment.EditedMar 29 2018, 10:33 AM

ffmpeg -f x11grab -video_size 1280x1024 -i "$DISPLAY" -loglevel error -nostdin -pix_fmt yuv420p log/selenium.mp4 &

[[ https://ffmpeg.org/ffmpeg.html | ffmpeg ]] a very fast video and audio converter that can also grab from a live audio/video source
[[ https://ffmpeg.org/ffmpeg.html#X11-grabbing | -f x11grab ]] grab the X11 display with ffmpeg
[[ http://ffmpeg.org/ffmpeg-utils.html#Video-size | -video_size 1280x1024 ]]
[[ https://ffmpeg.org/ffmpeg.html#Main-options | -i :99 ]] input file url
-loglevel error logs only errors
-nostdin allows running in the background (&)
-pix_fmt yuv420p QuickTime Player support, "Use -pix_fmt yuv420p for compatibility with outdated media players."
log/selenium.mp4 output file
& run in background

zeljkofilipin added a comment.Mar 29 2018, 11:09 AM

selenium.mp4482 KBDownload

zeljkofilipin updated the task description. (Show Details)Mar 29 2018, 11:17 AM
gerritbot subscribed.Mar 29 2018, 2:12 PM

Change 422933 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[mediawiki/core@master] WIP Selenium: record video

https://gerrit.wikimedia.org/r/422933

gerritbot added a project: Patch-For-Review.Mar 29 2018, 2:12 PM
gerritbot added a comment.Mar 29 2018, 3:14 PM

Change 422949 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] WIP Selenium: record video

https://gerrit.wikimedia.org/r/422949

zeljkofilipin added a comment.Mar 30 2018, 12:44 PM

Created testing job: mediawiki-core-qunit-selenium-jessie-422933. Video recording works! :)

selenium.mp41 MBDownload

gerritbot added a comment.Mar 30 2018, 2:41 PM

Change 423161 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[mediawiki/core@master] WIP Selenium: update WebdriverIO configuration

https://gerrit.wikimedia.org/r/423161

zeljkofilipin added a comment.Mar 31 2018, 12:40 PM
In T179188#4094387, @zeljkofilipin wrote:

Created testing job: mediawiki-core-qunit-selenium-jessie-422933. Video recording works! :)

selenium.mp41 MBDownload

The job is no longer needed, so I will delete it. The usual mediawiki-core-qunit-selenium-jessie job records videos. Example from mediawiki-core-qunit-selenium-jessie/18108:

User-should-be-able-to-log-in.mp4303 KBDownload

zeljkofilipin updated the task description. (Show Details)Mar 31 2018, 3:11 PM
zeljkofilipin rescinded a token.
zeljkofilipin awarded a token.
zeljkofilipin updated the task description. (Show Details)Mar 31 2018, 5:08 PM
zeljkofilipin updated the task description. (Show Details)Mar 31 2018, 5:48 PM
zhuyifei1999 subscribed.Mar 31 2018, 5:50 PM
gerritbot added a comment.Apr 2 2018, 12:15 PM

Change 423161 merged by jenkins-bot:
[mediawiki/core@master] Selenium: update WebdriverIO configuration

https://gerrit.wikimedia.org/r/423161

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2018-04-03 (1.31.0-wmf.28)).Apr 2 2018, 1:00 PM
gerritbot added a comment.Apr 10 2018, 5:13 PM

Change 422949 abandoned by Zfilipin:
WIP Selenium: record video

Reason:
implemented in https://gerrit.wikimedia.org/r/#/c/424592

https://gerrit.wikimedia.org/r/422949

zeljkofilipin rescinded a token.Apr 11 2018, 2:45 PM
zeljkofilipin awarded a token.
zeljkofilipin mentioned this in T191982: Blog posts about new Selenium framework features.Apr 11 2018, 2:50 PM
zeljkofilipin added a comment.Apr 11 2018, 3:16 PM

Updated documentation: Run the Selenium tests and record video of each test.

zeljkofilipin updated the task description. (Show Details)Apr 11 2018, 3:20 PM
zeljkofilipin updated the task description. (Show Details)Apr 11 2018, 4:02 PM
zeljkofilipin updated the task description. (Show Details)Apr 11 2018, 4:11 PM
zeljkofilipin updated the task description. (Show Details)Apr 11 2018, 4:15 PM
zeljkofilipin updated the task description. (Show Details)Apr 11 2018, 4:22 PM

The last video (User-should-be-able-to-change-preferences.mp4) is not saved correctly in Jenkins. All other files are saved correctly. It works fine in mediawiki-vagrant. I am not sure how to fix that. :/

@hashar, do you have any ideas?

zeljkofilipin updated the task description. (Show Details)Apr 12 2018, 11:33 AM
gerritbot added a comment.Apr 12 2018, 11:38 AM

Change 425788 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] WIP killall ffmpeg

https://gerrit.wikimedia.org/r/425788

zeljkofilipin rescinded a token.Apr 13 2018, 9:54 AM
zeljkofilipin awarded a token.
zeljkofilipin added a comment.Apr 13 2018, 11:38 AM
In T179188#4123859, @zeljkofilipin wrote:

The last video (User-should-be-able-to-change-preferences.mp4) is not saved correctly in Jenkins. All other files are saved correctly. It works fine in mediawiki-vagrant. I am not sure how to fix that. :/

I have tried to fix the CI problem with 425788, but it did not help. 🤔

gerritbot added a comment.Apr 13 2018, 11:42 AM

Change 425788 abandoned by Zfilipin:
WIP killall ffmpeg

https://gerrit.wikimedia.org/r/425788

zeljkofilipin mentioned this in T191537: MediaWiki core's selenium tests flaky when run as part of mwext-mw-selenium-node-composer-jessie job.Apr 13 2018, 6:52 PM
zeljkofilipin mentioned this in T193157: Quibble does not install ffmpeg.Apr 26 2018, 11:58 AM
zeljkofilipin moved this task from Deep work 🌊 to Q1 👔 on the User-zeljkofilipin board.May 18 2018, 1:09 PM
zeljkofilipin removed zeljkofilipin as the assignee of this task.Jun 4 2018, 2:46 PM

Not working on it at the moment. Will resume soon.

zeljkofilipin moved this task from In-progress to Backlog on the Release-Engineering-Team (Kanban) board.Jun 4 2018, 4:34 PM
zeljkofilipin added a parent task: T198389: Q1 Selenium framework improvements.Jun 28 2018, 3:55 PM
zeljkofilipin mentioned this in T198389: Q1 Selenium framework improvements.
zeljkofilipin added a project: MediaWiki-Core-Tests.Jun 28 2018, 4:04 PM
zeljkofilipin moved this task from Inbox to Selenium on the MediaWiki-Core-Tests board.Jun 28 2018, 4:06 PM
zeljkofilipin moved this task from Q1 👔 to Backlog 🪒 on the User-zeljkofilipin board.Jun 28 2018, 5:05 PM
Addshore subscribed.Aug 8 2018, 9:01 AM

I would love this for debugging T201337

Addshore mentioned this in T201337: Quibble & WikibaseLexeme: selenium, TypeError: Cannot read property 'value' of undefined.Aug 8 2018, 11:15 AM
zeljkofilipin claimed this task.Aug 8 2018, 11:27 AM
zeljkofilipin moved this task from Backlog to In-progress on the Release-Engineering-Team (Kanban) board.
zeljkofilipin moved this task from Backlog 🪒 to Deep work 🌊 on the User-zeljkofilipin board.
zeljkofilipin added a subtask: T193157: Quibble does not install ffmpeg.Aug 9 2018, 3:06 PM
zeljkofilipin updated the task description. (Show Details)Aug 9 2018, 3:52 PM
zeljkofilipin updated the task description. (Show Details)
hashar closed subtask T193157: Quibble does not install ffmpeg as Resolved.Aug 28 2018, 7:40 AM
zeljkofilipin updated the task description. (Show Details)Aug 30 2018, 8:43 AM
zeljkofilipin updated the task description. (Show Details)Aug 30 2018, 11:49 AM
zeljkofilipin updated the task description. (Show Details)
Addshore added a comment.Sep 6 2018, 10:27 AM

We have some more seemingly random failures going on with https://gerrit.wikimedia.org/r/c/mediawiki/extensions/AdvancedSearch/+/455170/18 and again videos would be super awesome!

gabriel-wmde awarded a token.Sep 6 2018, 10:32 AM
gabriel-wmde subscribed.
gerritbot added a comment.Sep 25 2018, 11:21 AM

Change 462656 had a related patch set uploaded (by Zfilipin; owner: Hashar):
[mediawiki/core@master] selenium: video recording reporter

https://gerrit.wikimedia.org/r/462656

zeljkofilipin lowered the priority of this task from High to Medium.Sep 25 2018, 11:26 AM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin mentioned this in T206624: Q2 Selenium framework improvements.Oct 10 2018, 12:22 PM
gerritbot added a comment.Oct 16 2018, 10:23 PM

Change 422933 merged by jenkins-bot:
[mediawiki/core@master] Selenium: record video of every test

https://gerrit.wikimedia.org/r/422933

ReleaseTaggerBot added a project: MW-1.33-notes (1.33.0-wmf.1; 2018-10-23).Oct 16 2018, 11:01 PM
zeljkofilipin closed this task as Resolved.Oct 17 2018, 10:10 AM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin rescinded a token.Oct 17 2018, 10:15 AM
zeljkofilipin awarded a token.
hashar reopened this task as Open.Oct 18 2018, 8:02 AM

Reusing this task. The Jenkins job selenium-daily-beta-MediaWiki fails due to lack of ffmpeg:

[chrome #0-0] 1) BlankPage "before each" hook:
[chrome #0-0] spawn ffmpeg ENOENT
[chrome #0-0] Error: spawn ffmpeg ENOENT

The job uses docker-registry.wikimedia.org/releng/npm-browser-test:0.3.1, we would want to add the ffmpeg package into it.

zeljkofilipin removed zeljkofilipin as the assignee of this task.Oct 24 2018, 12:08 PM
zeljkofilipin moved this task from In-progress to Backlog on the Release-Engineering-Team (Kanban) board.
zeljkofilipin moved this task from Deep work 🌊 to Q1 👔 on the User-zeljkofilipin board.
zeljkofilipin mentioned this in T210516: selenium-daily-beta-MediaWiki fails with `spawn ffmpeg ENOENT`.Nov 27 2018, 4:15 PM
zeljkofilipin closed this task as Resolved.Nov 27 2018, 4:17 PM
zeljkofilipin claimed this task.
In T179188#4676596, @hashar wrote:

The Jenkins job selenium-daily-beta-MediaWiki fails due to lack of ffmpeg:

Thanks, reported as T210516.

zeljkofilipin mentioned this in T210518: Update Selenium/Node.js/Target Custom MediaWiki.Nov 27 2018, 4:28 PM
gerritbot added a comment.Jan 8 2019, 2:06 PM

Change 462656 abandoned by Hashar:
selenium: video recording reporter

https://gerrit.wikimedia.org/r/462656

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits