Currently, we use api-ro with a Host header of meta.wikimedia.org to get stream configs from the action API. We should use the Envoy service proxy endpoint 'mwapi-async'.
Description
Description
Details
Details
Customize query in gerrit
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| Bump eventutilities to 0.6.0 | repos/data-engineering/mediawiki-event-enrichment!53 | otto | eventutilities-0.6.0 | main | |
| http_process_function - Handle both http and https requests | repos/data-engineering/eventutilities-python!51 | otto | http_adapter | main |
Related Objects
Related Objects
- Mentioned Here
- T333120: Migrate internal traffic to k8s
Event Timeline
Comment Actions
Actually (depending on the request volume) you may want to use mw-api-int-asyncdirectly, see T333120: Migrate internal traffic to k8s
Comment Actions
From MW event enrichment? Very low. Really only on job startup. Other jobs in the future may be more dynamic, but they'd only need updates after MW config deployments. E.g. for dynamically configured eventgate instances, we cache and expire configs every 5 minutes.
Comment Actions
Hm, actually tho, mediawiki-page-content-change-enrichment does more than just request stream config from MW. Stream config only happens on job startup, but the point of this job is to ask MW for the new page content on every edit. Other jobs may do similar things.
In those cases, the request volume is similar to the rate of changes to pages, so ~30 / second.
Comment Actions
Change 917934 had a related patch set uploaded (by Ottomata; author: Ottomata):
[operations/deployment-charts@master] page_content_change - use mwapi-async envoy listener for MW api requests
Comment Actions
Change 917934 merged by jenkins-bot:
[operations/deployment-charts@master] page_content_change - use mwapi-async envoy listener for MW api requests
Comment Actions
otto opened https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-python/-/merge_requests/51
http_process_function - Handle both http and https requests
Comment Actions
otto merged https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-python/-/merge_requests/51
http_process_function - Handle both http and https requests
Comment Actions
otto opened https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/53
Bump eventutilities to 0.6.0
Comment Actions
otto merged https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/53
Bump eventutilities to 0.6.0
Comment Actions
Change 917948 had a related patch set uploaded (by Ottomata; author: Ottomata):
[operations/deployment-charts@master] page_content_change - bump image version to v1.15.0
Comment Actions
Change 917948 merged by Ottomata:
[operations/deployment-charts@master] page_content_change - bump image version to v1.15.0