Page MenuHomePhabricator
Create Task
Maniphest T315477

Create benchmark suite for function-* services
Closed, ResolvedPublic
Actions

Description

A synthetic benchmark suite to give insights on performance stats for the function-orchestrator/evaluator services.

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
Update function-schemata sub-module to HEAD (d41dee3)Jforrestermediawiki/extensions/WikiLambdamaster+1 -1
Update function-schemata sub-module to HEAD (d41dee3)Jforrestermediawiki/tools/wikilambda-climaster+1 -1
Update function-schemata sub-module to HEAD (d41dee3)Jforrestermediawiki/services/function-orchestratormaster+1 -1
Update function-schemata sub-module to HEAD (d41dee3)Jforrestermediawiki/services/function-evaluatormaster+3 -3
Update function-schemata sub-module to HEAD (d41dee3)Cory Massaromediawiki/services/function-evaluatormaster+1 -1
Add a benchmark suite for schema functionalities.Mary Yangmediawiki/services/function-schematamaster+221 -16
Add initial benchmark suite for orchestate with mocks.Mary Yangmediawiki/services/function-orchestratormaster+479 -145
Customize query in gerrit

Related Objects

Event Timeline

• maryyang created this task.Aug 17 2022, 7:02 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 17 2022, 7:02 PM
• maryyang added a subscriber: cmassaro.Aug 17 2022, 7:05 PM

HI @cmassaro, we are thinking of having a benchmarking tool to monitor performance stats. Roughly speaking, do you know any key parts of the function-* services that could use monitoring?

gerritbot added a comment.Sep 10 2022, 2:26 AM

Change 831170 had a related patch set uploaded (by Mary Yang; author: Mary Yang):

[mediawiki/services/function-orchestrator@master] Add initial benchmark suite for orchestate with mocks.

https://gerrit.wikimedia.org/r/831170

gerritbot added a project: Patch-For-Review.Sep 10 2022, 2:26 AM
gerritbot added a comment.Sep 17 2022, 3:52 AM

Change 831170 merged by jenkins-bot:

[mediawiki/services/function-orchestrator@master] Add initial benchmark suite for orchestate with mocks.

https://gerrit.wikimedia.org/r/831170

• maryyang mentioned this in rMSFO51addca292f9: Add initial benchmark suite for orchestate with mocks..Sep 17 2022, 3:52 AM
Maintenance_bot removed a project: Patch-For-Review.Sep 17 2022, 4:30 AM
gerritbot added a comment.Oct 6 2022, 5:54 AM

Change 839276 had a related patch set uploaded (by Mary Yang; author: Mary Yang):

[mediawiki/services/function-schemata@master] Add a benchmark suite for schema functionalities.

https://gerrit.wikimedia.org/r/839276

gerritbot added a project: Patch-For-Review.Oct 6 2022, 5:54 AM
gerritbot added a comment.Oct 7 2022, 1:20 PM

Change 839276 merged by jenkins-bot:

[mediawiki/services/function-schemata@master] Add a benchmark suite for schema functionalities.

https://gerrit.wikimedia.org/r/839276

Jdforrester-WMF mentioned this in rMSFSd41dee3c9117: Add a benchmark suite for schema functionalities..Oct 7 2022, 1:20 PM
Maintenance_bot removed a project: Patch-For-Review.Oct 7 2022, 1:31 PM
gerritbot added a comment.Oct 7 2022, 2:34 PM

Change 840147 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840147

gerritbot added a project: Patch-For-Review.Oct 7 2022, 2:34 PM

Change 840148 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/services/function-orchestrator@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840148

gerritbot added a comment.Oct 7 2022, 2:39 PM

Change 840149 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/services/function-evaluator@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840149

gerritbot added a comment.Oct 7 2022, 6:17 PM

Change 840205 had a related patch set uploaded (by Cory Massaro; author: Cory Massaro):

[mediawiki/services/function-evaluator@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840205

gerritbot added a comment.Oct 7 2022, 6:17 PM

Change 840206 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/tools/wikilambda-cli@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840206

gerritbot added a comment.Oct 7 2022, 6:23 PM

Change 840205 abandoned by Jforrester:

[mediawiki/services/function-evaluator@master] Update function-schemata sub-module to HEAD (d41dee3)

Reason:

https://gerrit.wikimedia.org/r/840205

gerritbot added a comment.Oct 7 2022, 6:29 PM

Change 840148 merged by jenkins-bot:

[mediawiki/services/function-orchestrator@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840148

gerritbot added a comment.Oct 7 2022, 6:30 PM

Change 840149 merged by jenkins-bot:

[mediawiki/services/function-evaluator@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840149

Jdforrester-WMF mentioned this in rMSFO28dcc93ce059: Update function-schemata sub-module to HEAD (d41dee3).Oct 7 2022, 6:30 PM
Jdforrester-WMF mentioned this in rMSFE5926cf41dc8f: Update function-schemata sub-module to HEAD (d41dee3).
gerritbot added a comment.Oct 18 2022, 12:05 AM

Change 840206 merged by jenkins-bot:

[mediawiki/tools/wikilambda-cli@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840206

gerritbot added a comment.Oct 18 2022, 12:07 AM

Change 840147 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (d41dee3)

https://gerrit.wikimedia.org/r/840147

Jdforrester-WMF mentioned this in rMTWCe597ff3ed782: Update function-schemata sub-module to HEAD (d41dee3).Oct 18 2022, 12:50 AM
Jdforrester-WMF closed this task as Resolved.Nov 21 2022, 8:34 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits