Estimate synthesis time
Closed, ResolvedPublic0 Estimated Story Points
Actions

Description

Measure how long time it takes to synthesize utterances using the TTS engines currently available on the development server. This should give an idea of what will be needed from the servers when scaling up to more users.

Details

	Subject	Repo	Branch	Lines +/-
	Speechoid/Wikispeech benchmark maintenance script	mediawiki/extensions/Wikispeech	master	+480 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T264842 Deploy Wikispeech in production
Open	None	T180015 ☂ Deploy Wikispeech on beta cluster
Open	None	T264748 ☂ Speechoid WMF deployment
Resolved	• kalle	T264403 ☂ Benchmark maintenance script
Resolved	• kalle	T247282 Estimate synthesis time

Event Timeline

Sebastian_Berlin-WMSE created this task.Mar 10 2020, 8:50 AM

Sebastian_Berlin-WMSE moved this task from Unsorted to Code hygiene and deployment requirements [MW Extension] on the Wikispeech-Text-to-Speech board.Mar 11 2020, 12:56 PM

Lokal_Profil mentioned this in T247317: Estimate disk space usage of audio files.Mar 11 2020, 12:57 PM

Lokal_Profil moved this task from Incoming to Backlog on the Wikispeech-Jobrunner board.

Sebastian_Berlin-WMSE set the point value for this task to 8.Apr 16 2020, 10:12 AM

Sebastian_Berlin-WMSE moved this task from Backlog to Sprint on the Wikispeech-Jobrunner board.

Sebastian_Berlin-WMSE edited projects, added Wikispeech-Jobrunner (Sprint); removed Wikispeech-Jobrunner.

• kalle added a project: User-kalle.Apr 21 2020, 7:42 AM

Results from manual testing:

Synthesizing about 120 words, one semi large paragraph of text, takes about 7 seconds on my laptop. It consumes 3 CPUs (out of 6 CPUs according to /proc/cpuinfo) for most of the time, indicating it somehow does this multi threaded, even though there is nothing regarding this in the Mary documentation. It might just be the JVM that automatically handle this. Setting up rate limit using HAProxy correct (see T247390) might make this speedier under heavy load at 2 connections at the time compared to, lets say, 10 connections that have to share all CPUs running at 100% each.

Testing on dev server is blocked by T249220

• kalle moved this task from Backlog to In progress on the Wikispeech-Jobrunner (Sprint) board.Apr 26 2020, 8:25 PM

• kalle changed the point value for this task from 8 to 7.Apr 30 2020, 8:27 AM

• kalle moved this task from 😘 Review to 🤠 This week on the User-kalle board.May 1 2020, 12:49 AM

Lokal_Profil changed the point value for this task from 7 to 10.May 14 2020, 8:34 AM

• kalle moved this task from 🤠 This week to 🥴 Backlog on the User-kalle board.May 17 2020, 11:58 AM

• kalle moved this task from 🥴 Backlog to 🤠 This week on the User-kalle board.Jun 9 2020, 8:16 AM

• kalle moved this task from In progress to Backlog on the Wikispeech-Jobrunner (Sprint) board.Jun 11 2020, 8:29 AM

Base on the Barack Obama article. Exists in many languages and is long enough.

• kalle moved this task from 🤠 This week to 🥴 Backlog on the User-kalle board.Jun 23 2020, 8:12 AM

• kalle moved this task from Sprint to Proposed for next sprint on the Wikispeech-Jobrunner board.Jul 9 2020, 10:53 AM

• kalle edited projects, added Wikispeech-Jobrunner; removed Wikispeech-Jobrunner (Sprint).

• kalle moved this task from 🥴 Backlog to 🤠 This week on the User-kalle board.Jul 27 2020, 9:17 AM

• kalle moved this task from Proposed for next sprint to Sprint on the Wikispeech-Jobrunner board.Jul 27 2020, 9:20 AM

• kalle edited projects, added Wikispeech-Jobrunner (Sprint); removed Wikispeech-Jobrunner.

• kalle moved this task from 🤠 This week to 🥴 Backlog on the User-kalle board.Aug 14 2020, 2:06 PM

Sebastian_Berlin-WMSE moved this task from Sprint to Proposed for next sprint on the Wikispeech-Jobrunner board.Aug 20 2020, 9:14 AM

Sebastian_Berlin-WMSE edited projects, added Wikispeech-Jobrunner; removed Wikispeech-Jobrunner (Sprint).

Sebastian_Berlin-WMSE mentioned this in T261296: Identify remaining blockers for beta.Sep 3 2020, 8:06 AM

Lokal_Profil moved this task from Proposed for next sprint to Sprint on the Wikispeech-Jobrunner board.Sep 3 2020, 9:32 AM

Lokal_Profil edited projects, added Wikispeech-Jobrunner (Sprint); removed Wikispeech-Jobrunner.

• kalle moved this task from Backlog to In progress on the Wikispeech-Jobrunner (Sprint) board.Oct 1 2020, 11:15 AM

• kalle moved this task from 🥴 Backlog to 🤠 This week on the User-kalle board.Oct 2 2020, 9:46 AM

• kalle added a parent task: T264403: ☂ Benchmark maintenance script.

• kalle moved this task from 🤠 This week to 🤔 Awaits action on the User-kalle board.Oct 3 2020, 2:14 PM

• kalle changed the point value for this task from 10 to 0.Oct 15 2020, 9:49 AM

• kalle changed the point value for this task from 0 to 1.Oct 15 2020, 9:52 AM

Change 631719 had a related patch set uploaded (by Karl Wettin (WMSE); owner: Karl Wettin (WMSE)):
[mediawiki/extensions/Wikispeech@master] Speechoid/Wikispeech benchmark maintenance script

https://gerrit.wikimedia.org/r/631719

gerritbot added a project: Patch-For-Review.Oct 19 2020, 12:36 PM

Change 631719 merged by jenkins-bot:
[mediawiki/extensions/Wikispeech@master] Speechoid/Wikispeech benchmark maintenance script

https://gerrit.wikimedia.org/r/631719

• kalle mentioned this in rEWIS9767d60acc2d: Speechoid/Wikispeech benchmark maintenance script.Oct 28 2020, 3:06 PM

Maintenance_bot removed a project: Patch-For-Review.Oct 28 2020, 3:11 PM

• kalle moved this task from 🤔 Awaits action to 🤯 Done on the User-kalle board.Oct 29 2020, 8:15 AM

Lokal_Profil moved this task from In progress to Done on the Wikispeech-Jobrunner (Sprint) board.Oct 29 2020, 8:17 AM

Lokal_Profil changed the point value for this task from 1 to 0.

Sebastian_Berlin-WMSE closed this task as Resolved.Oct 29 2020, 12:54 PM