Page MenuHomePhabricator
Create Task
Maniphest T330814

Misc - Clean up and techdebt
Closed, ResolvedPublic
Actions

Description

This ticket is to act as an Epic for collecting Engineering clean up tickets and tech debt.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT330814 Misc - Clean up and techdebt
 ResolvedAlex.lep.spT329833 Update ksqldb image version
 InvalidNoneT329519 Draft: Expose ksqldb metrics for Prometheus
Resolved• REsquito-WMFT327897 [investigation] Add logging for errors (timebox ~ 5 day(s))
Resolved• ROdonnell-WMFT332713 Enhance Logging for Auth API
 Resolved• ROdonnell-WMFT332712 Enhance Logging in Main API
 Resolved• REsquito-WMFT330836 Remove Redis instance for Snapshots Service
 ResolvedProtsack.stephanT330837 Add concurrency to subscriber package
 ResolvedTim.abdullinT330838 Remove delete events from snapshots
 ResolvedTim.abdullinT331205 Make sure following messages don't end up in dead letter queue
 ResolvedProtsack.stephanT331571 Move dashboard repo from old group to new
 ResolvedNoneT331628 Draft: Fix recursive submodules conflicts in structured-data service
 ResolvedSpike• ROdonnell-WMFT332154 [investigation] Feature Flags (Time box ~ 4 day(s))
 Resolved• REsquito-WMFT334206 [POC] Feature flag implementation (Timebox ~ 2 days(s))
 ResolvedTim.abdullinT332170 Stopped after 10 redirects messages in DLQ
 InvalidNoneT332394 Handling of connection reset by peer errors in DLQ
 ResolvedProtsack.stephanT332696 Create a dashboard for API usage
 ResolvedLDlulisa-WMFT332701 Handle 503 and 500 error message in DLQ
 ResolvedAlex.lep.spT334233 Move Grafana workspaces setup to IaC
 ResolvedBUG REPORTAlex.lep.spT334469 Error services are not being re-deployed
 ResolvedAlex.lep.spT335355 Downscale and destroy V1 infrastructure
 DeclinedAlex.lep.spT335501 Move critical IAC resources from V1 to V2
 ResolvedLDlulisa-WMFT335496 Handle page not found error messages in DLQ
 ResolvedAlex.lep.spT335950 Traffic Optimization
 ResolvedProtsack.stephanT336518 Update schema helper to account for caching issues
 ResolvedProtsack.stephanT336523 Figure out schema version updates in Realtime API
 ResolvedAlex.lep.spT337924 Update infrastructure for topic management
 ResolvedAlex.lep.spT337932 Add an ability to measure costs for separate services inside the WME clusters
 ResolvedAlex.lep.spT337934 Investigate separating out openai-plugin infra to their own repo [timebox: 3 days]
 DeclinedNoneT338313 Remove ksqlDB from Realtime API
 InvalidNoneT340533 [Investigation] Missing pages in eowiki dump
 ResolvedProtsack.stephanT341789 Move github repositories to WME account
InvalidNoneT341990 UAT stream disconnected
 InvalidNoneT343927 Explore and implement a way to keep the realtime connection alive
 ResolvedBUG REPORTNoneT342529 Namespace not supported messages in DLQ
 ResolvedBUG REPORTProtsack.stephanT342855 Can't deploy website to the environment
 ResolvedLDlulisa-WMFT343924 Remove revision-score dependency from event-bridge
 ResolvedE.EnabuleleT343974 Remove ORES usage from structured data service
 ResolvedprabhatT344789 Remove URL string argument from GetCategories and GetTemplate funcs
 ResolvedprabhatT345367 Production deploy ORES and revision-score deprecation
 ResolvedLDlulisa-WMFT343326 Integrate liftwing revertrisk:language-agnostic in our article
 ResolvedE.EnabuleleT342999 Re-run test for liftwing language-agnostic revertrisk API from aws
 ResolvedProtsack.stephanT342766 Runbook for bulk ingestion process
 InvalidNoneT344335 Automated monthly bulk ingestion runs
 ResolvedBUG REPORTE.EnabuleleT343976 DLQ monitor lambda provides fake alters
 Resolved• REsquito-WMFT339970 Create event objects properly to track messages within our system
 ResolvedprabhatT342874 Measure event lag in the realtime feed
 ResolvedE.EnabuleleT345468 Log events that exceed the p999 latency in structured-data
 InvalidNoneT344334 Create an alarm if we are blocked by 429s

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 1 2023, 12:57 AM
HShaikh added a subtask: T329833: Update ksqldb image version.Mar 1 2023, 12:59 AM
HShaikh added a subtask: T329519: Draft: Expose ksqldb metrics for Prometheus .
HShaikh added a subtask: T327897: [investigation] Add logging for errors (timebox ~ 5 day(s)) .Mar 1 2023, 1:01 AM
Protsack.stephan closed subtask T329519: Draft: Expose ksqldb metrics for Prometheus as Invalid.Mar 1 2023, 8:37 AM
HShaikh added a project: Epic.Mar 1 2023, 3:25 PM
HShaikh added a subtask: T330836: Remove Redis instance for Snapshots Service.Mar 1 2023, 3:43 PM
HShaikh added a subtask: T330837: Add concurrency to subscriber package.
HShaikh added a subtask: T330838: Remove delete events from snapshots.Mar 1 2023, 3:53 PM
Tim.abdullin changed the status of subtask T330838: Remove delete events from snapshots from Open to In Progress.Mar 2 2023, 4:13 PM
Protsack.stephan added a subtask: T331205: Make sure following messages don't end up in dead letter queue.Mar 4 2023, 7:07 PM
Tim.abdullin changed the status of subtask T331205: Make sure following messages don't end up in dead letter queue from Open to In Progress.Mar 6 2023, 4:41 PM
Protsack.stephan added a subtask: T331571: Move dashboard repo from old group to new.Mar 8 2023, 9:41 PM
Tim.abdullin added a subtask: T331628: Draft: Fix recursive submodules conflicts in structured-data service.Mar 9 2023, 2:19 PM
Protsack.stephan closed subtask T331628: Draft: Fix recursive submodules conflicts in structured-data service as Resolved.Mar 14 2023, 5:51 PM
Protsack.stephan added a subtask: T332154: [investigation] Feature Flags (Time box ~ 4 day(s)).Mar 15 2023, 1:02 PM
Protsack.stephan added a subtask: T332170: Stopped after 10 redirects messages in DLQ.
Protsack.stephan added a subtask: T332394: Handling of connection reset by peer errors in DLQ.Mar 17 2023, 2:08 PM
Protsack.stephan added a subtask: T332696: Create a dashboard for API usage.Mar 21 2023, 1:27 PM
Protsack.stephan added a subtask: T332701: Handle 503 and 500 error message in DLQ.Mar 21 2023, 1:49 PM
• REsquito-WMF added a subtask: T332713: Enhance Logging for Auth API.Mar 22 2023, 8:37 AM
• REsquito-WMF added a subtask: T332712: Enhance Logging in Main API.
Tim.abdullin changed the status of subtask T332170: Stopped after 10 redirects messages in DLQ from Open to In Progress.Mar 27 2023, 5:00 PM
Tim.abdullin changed the status of subtask T332394: Handling of connection reset by peer errors in DLQ from Open to In Progress.Apr 5 2023, 11:27 AM
Protsack.stephan added a subtask: T334233: Move Grafana workspaces setup to IaC.Apr 6 2023, 3:36 PM
Protsack.stephan added a subtask: T334469: Error services are not being re-deployed.Apr 11 2023, 2:54 PM
Protsack.stephan updated the task description. (Show Details)Apr 11 2023, 4:50 PM
Protsack.stephan changed the status of subtask T332394: Handling of connection reset by peer errors in DLQ from In Progress to Open.Apr 11 2023, 5:19 PM
Protsack.stephan removed a subtask: T332713: Enhance Logging for Auth API.Apr 11 2023, 6:51 PM
Protsack.stephan removed a subtask: T332712: Enhance Logging in Main API.
Tim.abdullin changed the status of subtask T329833: Update ksqldb image version from Open to In Progress.Apr 12 2023, 8:05 AM
Protsack.stephan added a subtask: T335355: Downscale and destroy V1 infrastructure.Apr 25 2023, 1:25 PM
Protsack.stephan added a subtask: T335496: Handle page not found error messages in DLQ.Apr 27 2023, 12:33 PM
Protsack.stephan added a subtask: T335950: Traffic Optimization.May 4 2023, 1:36 PM
Protsack.stephan added a subtask: T336518: Update schema helper to account for caching issues.May 11 2023, 3:46 PM
Protsack.stephan added a subtask: T336523: Figure out schema version updates in Realtime API.May 11 2023, 4:08 PM
Protsack.stephan added a subtask: T337924: Update infrastructure for topic management.Jun 1 2023, 12:14 PM
Protsack.stephan added a subtask: T337932: Add an ability to measure costs for separate services inside the WME clusters.Jun 1 2023, 12:55 PM
Protsack.stephan added a subtask: T337934: Investigate separating out openai-plugin infra to their own repo [timebox: 3 days].Jun 1 2023, 1:39 PM
Protsack.stephan added a subtask: T338313: Remove ksqlDB from Realtime API.Jun 7 2023, 11:54 AM
Protsack.stephan added a subtask: T340533: [Investigation] Missing pages in eowiki dump.Jun 27 2023, 9:37 AM
JArguello-WMF closed subtask T336518: Update schema helper to account for caching issues as Resolved.Jul 11 2023, 12:55 PM
JArguello-WMF closed subtask T335496: Handle page not found error messages in DLQ as Resolved.
JArguello-WMF closed subtask T332701: Handle 503 and 500 error message in DLQ as Resolved.
JArguello-WMF closed subtask T336523: Figure out schema version updates in Realtime API as Resolved.Jul 11 2023, 12:59 PM
Protsack.stephan added a subtask: T341789: Move github repositories to WME account .Jul 13 2023, 12:55 PM
JArguello-WMF closed subtask T335950: Traffic Optimization as Resolved.Jul 14 2023, 3:34 PM
JArguello-WMF closed subtask T335355: Downscale and destroy V1 infrastructure as Resolved.
JArguello-WMF closed subtask T332170: Stopped after 10 redirects messages in DLQ as Resolved.
JArguello-WMF closed subtask T331205: Make sure following messages don't end up in dead letter queue as Resolved.
JArguello-WMF closed subtask T330836: Remove Redis instance for Snapshots Service as Resolved.
JArguello-WMF closed subtask T332696: Create a dashboard for API usage as Resolved.
JArguello-WMF closed subtask T331571: Move dashboard repo from old group to new as Resolved.
JArguello-WMF closed subtask T330837: Add concurrency to subscriber package as Resolved.
JArguello-WMF closed subtask T329833: Update ksqldb image version as Resolved.
JArguello-WMF closed subtask T327897: [investigation] Add logging for errors (timebox ~ 5 day(s)) as Resolved.
JArguello-WMF closed subtask T332154: [investigation] Feature Flags (Time box ~ 4 day(s)) as Resolved.
JArguello-WMF closed subtask T330838: Remove delete events from snapshots as Resolved.
Protsack.stephan added a subtask: T341990: UAT stream disconnected.Jul 18 2023, 1:07 PM
Protsack.stephan added a subtask: T342529: Namespace not supported messages in DLQ.Jul 24 2023, 10:51 AM
JArguello-WMF closed subtask T334469: Error services are not being re-deployed as Resolved.Jul 24 2023, 5:38 PM
JArguello-WMF closed subtask T337924: Update infrastructure for topic management as Resolved.
JArguello-WMF closed subtask T337934: Investigate separating out openai-plugin infra to their own repo [timebox: 3 days] as Resolved.Jul 27 2023, 5:39 AM
JArguello-WMF closed subtask T337932: Add an ability to measure costs for separate services inside the WME clusters as Resolved.
Protsack.stephan added a subtask: T342855: Can't deploy website to the environment.Jul 27 2023, 12:15 PM
JArguello-WMF changed the status of subtask T342855: Can't deploy website to the environment from Open to In Progress.Jul 31 2023, 12:25 PM
JArguello-WMF closed subtask T342855: Can't deploy website to the environment as Resolved.Aug 4 2023, 2:23 PM
Protsack.stephan added a subtask: T343924: Remove revision-score dependency from event-bridge.Aug 10 2023, 12:05 PM
Protsack.stephan added a subtask: T342766: Runbook for bulk ingestion process.Aug 10 2023, 12:16 PM
Protsack.stephan added a subtask: T343976: DLQ monitor lambda provides fake alters.Aug 10 2023, 12:50 PM
Protsack.stephan added a subtask: T339970: Create event objects properly to track messages within our system.Aug 10 2023, 1:19 PM
Protsack.stephan added a subtask: T344334: Create an alarm if we are blocked by 429s.Aug 16 2023, 12:23 PM
Protsack.stephan added a subtask: T344335: Automated monthly bulk ingestion runs.Aug 16 2023, 12:42 PM
Protsack.stephan removed a subtask: T344335: Automated monthly bulk ingestion runs.
JArguello-WMF closed subtask T342766: Runbook for bulk ingestion process as Resolved.Aug 17 2023, 1:41 PM
JArguello-WMF closed subtask T343976: DLQ monitor lambda provides fake alters as Resolved.Aug 22 2023, 1:16 PM
JArguello-WMF closed subtask T343924: Remove revision-score dependency from event-bridge as Resolved.Sep 5 2023, 1:14 PM
JArguello-WMF closed subtask T341789: Move github repositories to WME account as Resolved.Sep 21 2023, 3:04 PM
JArguello-WMF closed subtask T339970: Create event objects properly to track messages within our system as Resolved.
JArguello-WMF closed subtask T334233: Move Grafana workspaces setup to IaC as Resolved.
JArguello-WMF closed subtask T342529: Namespace not supported messages in DLQ as Resolved.Nov 8 2024, 2:21 PM
JArguello-WMF subscribed.Jan 22 2025, 5:37 PM

WE have a dedicated tech debt column now so I am closing this task

JArguello-WMF closed this task as Resolved.Jan 22 2025, 5:38 PM
JArguello-WMF removed a project: Epic.
KMontalva-WMF closed subtask T338313: Remove ksqlDB from Realtime API as Declined.May 29 2025, 9:10 AM
RThomas-WMF closed subtask T341990: UAT stream disconnected as Invalid.Aug 26 2025, 9:41 AM
JArguello-WMF closed subtask T344334: Create an alarm if we are blocked by 429s as Invalid.May 15 2026, 5:47 PM
JArguello-WMF closed subtask T332394: Handling of connection reset by peer errors in DLQ as Invalid.
JArguello-WMF closed subtask T340533: [Investigation] Missing pages in eowiki dump as Invalid.May 29 2026, 1:28 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits