Create Rate Limit in Evaluator/Orchestrator
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	cmassaro
	Jun 6 2023, 7:59 PM

Description

Since a single orchestration event can occasion multiple calls to the evaluator, we should rate limit how many calls a single orchestrator call can make to the evaluator at once.

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

add x-request-id to Avro schema
populate Avro-serialized evaluator request with req[ 'x-request-id' ]
advance Avro schema version in orchestrator
limit simultaneous calls for a single request ID in the evaluator
limit simultaneous calls to execute for a single request ID in the orchestrator

Completion checklist

Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Back-end_Task/Bug_completion_checklist

Details

	Subject	Repo	Branch	Lines +/-
	Update function-schemata sub-module to HEAD (5cc2fc7)	mediawiki/extensions/WikiLambda	master	+1 -1
	Update function-schemata sub-module to HEAD (19f2a6d)	mediawiki/extensions/WikiLambda	master	+1 -1

Customize query in gerrit

Title	Reference	Author	Source Branch	Dest Branch
Update function-schemata sub-module to HEAD (5f40813)	repos/abstract-wiki/wikifunctions/function-evaluator!29	jforrester	sync-function-schemata	main
Update function-schemata sub-module to HEAD (5f40813)	repos/abstract-wiki/wikifunctions/wikilambda-cli!12	jforrester	sync-function-schemata	main
Add rate limiter in the evaluator.	repos/abstract-wiki/wikifunctions/function-evaluator!23	apine	apine-rate-limit	main
BREAKING CHANGE: Update function-schemata sub-module to HEAD (63aa93e)	repos/abstract-wiki/wikifunctions/function-orchestrator!35	apine	apine-sync-function-schemata	main
Limit call stack size in the orchestrator when the number of operations associated with a single function call exceeds a threshold.	repos/abstract-wiki/wikifunctions/function-orchestrator!34	apine	apine-rate-limit	main
Add errors for rate limits in backend services.	repos/abstract-wiki/wikifunctions/function-schemata!19	apine	apine-rate-limits	main
Update function-schemata sub-module to HEAD (19f2a6d)	repos/abstract-wiki/wikifunctions/wikilambda-cli!10	jforrester	sync-function-schemata	main
Update function-schemata sub-module to HEAD (19f2a6d)	repos/abstract-wiki/wikifunctions/function-evaluator!21	apine	sync-function-schemata	main
Update function-schemata sub-module to HEAD (19f2a6d)	repos/abstract-wiki/wikifunctions/function-orchestrator!28	apine	sync-function-schemata	main
Advance Avro schema version to 0.0.5 and Add request-id to Invariants	repos/abstract-wiki/wikifunctions/function-orchestrator!26	apine	apine-request-id	main
Add requestID to Avro schema.	repos/abstract-wiki/wikifunctions/function-schemata!16	apine	apine-serialization	main

Related Objects
Search...

Status	Subtype	Assigned	Task
Open	BUG REPORT	None	T344206 Special:MathStatus exception error on Wikifunctions
Resolved		Jdforrester-WMF	T342865 Post-creation work for wikifunctionswiki
Resolved		BTullis	T289316 Prepare and check storage layer for Wikifunctions.org (new public content wiki)
Resolved		Jdforrester-WMF	T275945 Create Wikifunctions.org
Resolved		Jdforrester-WMF	T299176 Phase Theta – Root task
Resolved		cmassaro	T299596 Add security limits to the Wikifunctions system to maintain availability and load factors
Resolved		cmassaro	T338272 Create Rate Limit in Evaluator/Orchestrator