People lbowmaker

lbowmaker (Luke Bowmaker)
User

Projects (7)
View All

Data Engineering and Event Platform Team
Group
Event-Platform
Tag
Sprint 1
Milestone
Sprint 2
Milestone
Sprint 3
Milestone

Calendar

User Details

User Since: Sep 21 2021, 7:38 PM (104 w, 6 d)
Availability: Available
LDAP User: Unknown
MediaWiki User: LBowmaker (WMF) [ Global Accounts ]

Recent Activity
View All

Yesterday

lbowmaker moved T347282: eventutilites-python: improve consistency guarantees of async process functions from Event Platform Backlog to Sprint 3 on the Data Engineering and Event Platform Team board.

Mon, Sep 25, 12:33 PM · Data Engineering and Event Platform Team (Sprint 3), Event-Platform, Data-Engineering

lbowmaker created Data Engineering and Event Platform Team (Sprint 3).

Mon, Sep 25, 12:31 PM

Mon, Sep 18

lbowmaker added a comment to T346684: Enable canary events for mediawiki.revision-visibility-change.

@xcollazo, @Ottomata - is a wikitech-l announcement sufficient (like we did for page_change)? We could work on drafting something like that.

Mon, Sep 18, 7:29 PM · Data Engineering and Event Platform Team

lbowmaker moved T345195: [SPIKE] Can we identify indicators to inform an SLO for event emission and intake? from SDS3.3 - Data Quality to Sprint 2 on the Data Engineering and Event Platform Team board.

Mon, Sep 18, 4:38 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

Fri, Sep 15

lbowmaker moved T346280: [SPIKE] Document Current Logging, Monitoring and Data Quality Checks for webrequests from Data Eng Backlog to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 15, 4:26 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T326002: EventGate occasionally fails to ingest specific schemas from Data Eng Backlog to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 15, 2:31 PM · Patch-For-Review, MW-1.41-notes (1.41.0-wmf.28; 2023-09-26), Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform, Data Pipelines

Wed, Sep 13

lbowmaker updated subscribers of T345912: SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents.

Wed, Sep 13, 8:59 PM · Epic, Data Engineering and Event Platform Team

lbowmaker updated the task description for T346280: [SPIKE] Document Current Logging, Monitoring and Data Quality Checks for webrequests.

Wed, Sep 13, 8:32 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker created T346280: [SPIKE] Document Current Logging, Monitoring and Data Quality Checks for webrequests.

Wed, Sep 13, 8:32 PM · Data Engineering and Event Platform Team (Sprint 2)

Tue, Sep 12

lbowmaker moved T338792: Implement PoC Event-Driven Data Pipeline for Revert Risk Model Scores using Event Platform Capabilities from Radar to Sprint 2 on the Data Engineering and Event Platform Team board.

Tue, Sep 12, 6:00 PM · Data Engineering and Event Platform Team (Sprint 2), Epic, Wikimedia Enterprise, Data-Engineering, Machine-Learning-Team, Event-Platform

lbowmaker moved T338792: Implement PoC Event-Driven Data Pipeline for Revert Risk Model Scores using Event Platform Capabilities from Next Up to Radar (External Teams) on the Data Engineering and Event Platform Team (Sprint 2) board.

Tue, Sep 12, 6:00 PM · Data Engineering and Event Platform Team (Sprint 2), Epic, Wikimedia Enterprise, Data-Engineering, Machine-Learning-Team, Event-Platform

lbowmaker moved T346084: eventutilities-python: Gitlab CI pipeline should use memory optimized runners. from Event Platform Backlog to Sprint 2 on the Data Engineering and Event Platform Team board.

Tue, Sep 12, 5:57 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker moved T346085: [BUG] eventutilites-python: fix type checking CI job from Event Platform Backlog to Sprint 2 on the Data Engineering and Event Platform Team board.

Tue, Sep 12, 5:57 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker added a comment to T338792: Implement PoC Event-Driven Data Pipeline for Revert Risk Model Scores using Event Platform Capabilities.

@AikoChou - we have been talking with the Enterprise engineering team recently about implementing this (also explaining the various platform components we built).

Tue, Sep 12, 11:24 AM · Data Engineering and Event Platform Team (Sprint 2), Epic, Wikimedia Enterprise, Data-Engineering, Machine-Learning-Team, Event-Platform

Mon, Sep 11

lbowmaker added a project to T346046: [Search Update Pipeline] Source streams for private wikis: Data Engineering and Event Platform Team.

Mon, Sep 11, 9:28 PM · Data Engineering and Event Platform Team, Discovery-Search (Current work), Data-Engineering, CirrusSearch

lbowmaker updated subscribers of T341893: Stop and remove oozie services.

@JAllemandou - ok to deprecate now?

Mon, Sep 11, 8:59 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Platform-SRE

lbowmaker moved T340673: Update Airflow Documentation from Data Eng Backlog to Airflow Migration on the Data Engineering and Event Platform Team board.

Mon, Sep 11, 7:18 PM · Data Engineering and Event Platform Team, Data Pipelines

lbowmaker moved T345914: Define Flink k8s operator SLO from SDS3.3 - Data Quality to Sprint 2 on the Data Engineering and Event Platform Team board.

Mon, Sep 11, 3:42 PM · Data-Platform-SRE, Event-Platform, Data-Engineering, Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T341893: Stop and remove oozie services from Next Up to Radar (External Teams) on the Data Engineering and Event Platform Team (Sprint 2) board.

Mon, Sep 11, 3:41 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Platform-SRE

lbowmaker moved T341893: Stop and remove oozie services from Data Eng Backlog to Sprint 2 on the Data Engineering and Event Platform Team board.

Mon, Sep 11, 3:41 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Platform-SRE

lbowmaker added a project to T341893: Stop and remove oozie services: Data Engineering and Event Platform Team.

Mon, Sep 11, 3:41 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Platform-SRE

lbowmaker moved T345835: Make MW_history_check job fail at airflow level when an error occur from In Review to Ready to Deploy on the Data Engineering and Event Platform Team (Sprint 2) board.

Mon, Sep 11, 3:35 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T344616: Implement retry mechanism for refine jobs from In Review to Ready to Deploy on the Data Engineering and Event Platform Team (Sprint 2) board.

Mon, Sep 11, 3:35 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T307959: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content from Sprint 2 to Event Platform Backlog on the Data Engineering and Event Platform Team board.

Mon, Sep 11, 3:33 PM · Data Engineering and Event Platform Team, Data-Engineering, Event-Platform, Epic

lbowmaker moved T333011: Define Migration/Deprecation Plan for Hue from Data Eng Backlog to Sprint 2 on the Data Engineering and Event Platform Team board.

Mon, Sep 11, 3:28 PM · Data Engineering and Event Platform Team (Sprint 2), Data Pipelines (Sprint 14)

lbowmaker moved T297231: Sending Apache Spark metrics to PushGateway from Data Eng Backlog to SDS3.3 - Data Quality on the Data Engineering and Event Platform Team board.

Mon, Sep 11, 1:08 PM · Data Engineering and Event Platform Team (Sprint 2), Observability-Metrics

lbowmaker added a project to T297231: Sending Apache Spark metrics to PushGateway: Data Engineering and Event Platform Team.

Mon, Sep 11, 1:08 PM · Data Engineering and Event Platform Team (Sprint 2), Observability-Metrics

Fri, Sep 8

lbowmaker added a subtask for T345912: SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents: T309717: Event Utilities partially downloads schemas.

Fri, Sep 8, 1:49 PM · Epic, Data Engineering and Event Platform Team

lbowmaker added a parent task for T309717: Event Utilities partially downloads schemas: T345912: SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents.

Fri, Sep 8, 1:49 PM · Data-Engineering

lbowmaker archived Data Engineering and Event Platform Team (Sprint 0).

Fri, Sep 8, 1:31 PM

lbowmaker moved T345805: Enable snappy compression for Flink Kafka producers from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:31 PM · Event Metrics, Data Engineering and Event Platform Team (Sprint 2)

lbowmaker edited projects for T340673: Update Airflow Documentation, added: Data Engineering and Event Platform Team; removed Data Engineering and Event Platform Team (Sprint 1).

Fri, Sep 8, 1:30 PM · Data Engineering and Event Platform Team, Data Pipelines

lbowmaker moved T344511: Enum with an entry of `null` should fail jsonschema-tools validation from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:30 PM · Data Engineering and Event Platform Team (Sprint 2), Event-Platform, Data-Engineering, Patch-For-Review

lbowmaker moved T345805: Enable snappy compression for Flink Kafka producers from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:30 PM · Event Metrics, Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T345657: [SPIKE] Should we enable compression on kafka jumbo? from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:30 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker moved T344511: Enum with an entry of `null` should fail jsonschema-tools validation from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:30 PM · Data Engineering and Event Platform Team (Sprint 2), Event-Platform, Data-Engineering, Patch-For-Review

lbowmaker moved T345657: [SPIKE] Should we enable compression on kafka jumbo? from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:30 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker moved T344071: Correctly detect pageviews from Wikipedia KaiOS app from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:29 PM · Data Engineering and Event Platform Team (Sprint 2), Inuka-Team (Kanban), Product-Analytics, KaiOS-Wikipedia-app

lbowmaker moved T307959: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:29 PM · Data Engineering and Event Platform Team, Data-Engineering, Event-Platform, Epic

lbowmaker moved T344688: Increase Max Message Size in Kafka Jumbo from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:29 PM · Patch-For-Review, Data Engineering and Event Platform Team (Sprint 2), Data-Platform-SRE, Data-Engineering, Event-Platform

lbowmaker moved T307959: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:29 PM · Data Engineering and Event Platform Team, Data-Engineering, Event-Platform, Epic

lbowmaker moved T336744: Harmonize tags across Airflow dags from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:29 PM · Data Engineering and Event Platform Team (Sprint 2), Data Products (Sprint 00), Data Pipelines (Sprint 14)

lbowmaker moved T336744: Harmonize tags across Airflow dags from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:29 PM · Data Engineering and Event Platform Team (Sprint 2), Data Products (Sprint 00), Data Pipelines (Sprint 14)

lbowmaker moved T344071: Correctly detect pageviews from Wikipedia KaiOS app from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:29 PM · Data Engineering and Event Platform Team (Sprint 2), Inuka-Team (Kanban), Product-Analytics, KaiOS-Wikipedia-app

lbowmaker moved T344688: Increase Max Message Size in Kafka Jumbo from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:29 PM · Patch-For-Review, Data Engineering and Event Platform Team (Sprint 2), Data-Platform-SRE, Data-Engineering, Event-Platform

lbowmaker moved T345835: Make MW_history_check job fail at airflow level when an error occur from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:29 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T345193: Document the onboarding journey on Event Platfrom from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:28 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker moved T345390: eventutilities-python: cookicutter template example should be updated from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:28 PM · Data Engineering and Event Platform Team (Sprint 2), Event-Platform, Data-Engineering

lbowmaker moved T345193: Document the onboarding journey on Event Platfrom from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:28 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker moved T345390: eventutilities-python: cookicutter template example should be updated from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:28 PM · Data Engineering and Event Platform Team (Sprint 2), Event-Platform, Data-Engineering

lbowmaker moved T345835: Make MW_history_check job fail at airflow level when an error occur from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:28 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T344616: Implement retry mechanism for refine jobs from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:28 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T344616: Implement retry mechanism for refine jobs from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:28 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T318863: Event Platform and DataHub Integration from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:26 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Catalog, Event-Platform

lbowmaker moved T318863: Event Platform and DataHub Integration from Next Up to In progress on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:26 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Catalog, Event-Platform

lbowmaker moved T335862: Implement job to generate Dump XML files from Next Up to In progress on the Data Engineering and Event Platform Team (Sprint 2) board.

Fri, Sep 8, 1:26 PM · Data Products (Sprint 01), Data Engineering and Event Platform Team (Sprint 2), Patch-For-Review, Data Pipelines (Sprint 14)

lbowmaker moved T335862: Implement job to generate Dump XML files from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:25 PM · Data Products (Sprint 01), Data Engineering and Event Platform Team (Sprint 2), Patch-For-Review, Data Pipelines (Sprint 14)

lbowmaker moved T331283: [NEEDS GROOMING] Store Flink HA metadata in Zookeeper from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:25 PM · Data Engineering and Event Platform Team (Sprint 2), Discovery-Search, Event-Platform, serviceops-radar, Data-Engineering

lbowmaker moved T333011: Define Migration/Deprecation Plan for Hue from Sprint 1 to Data Eng Backlog on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:23 PM · Data Engineering and Event Platform Team (Sprint 2), Data Pipelines (Sprint 14)

lbowmaker moved T340463: [Airflow] P.O.C. on Iceberg sensor using Iceberg table to keep status of updates from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:23 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T345806: mediawiki.page_content_change.v1 topic should be partitioned. from Sprint 1 to Sprint 2 on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:23 PM · Data-Engineering, Event-Platform, Data Engineering and Event Platform Team (Sprint 2)

lbowmaker closed T342399: mw-page-content-change-enrich: filter out events larger than max.request.size as Resolved.

Fri, Sep 8, 1:22 PM · Data Engineering and Event Platform Team (Sprint 1), Event-Platform, Data-Engineering

lbowmaker closed T345147: [BUG] mediawiki-event-enrichment: labels.rev_id log entry does not record revision id as Resolved.

Fri, Sep 8, 1:21 PM · Data Engineering and Event Platform Team (Sprint 1)

lbowmaker closed T336817: Release mediawiki.page_change.v1 stream, a subtask of T325303: Deploy mediawiki-page-content-change-enrichment to wikikube k8s, as Resolved.

Fri, Sep 8, 1:21 PM · Event-Platform (Sprint 14 B), Patch-For-Review, Epic, Data-Engineering-Planning

lbowmaker closed T336817: Release mediawiki.page_change.v1 stream as Resolved.

Fri, Sep 8, 1:21 PM · Data Engineering and Event Platform Team (Sprint 1), MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), Event-Platform (Sprint 14 B), Patch-For-Review

lbowmaker closed T341277: mediawiki page_content_change should generate new meta.id field as Resolved.

Fri, Sep 8, 1:20 PM · Data Engineering and Event Platform Team (Sprint 1), Data-Engineering, Event-Platform

lbowmaker closed T342258: mw-page-content-change-enrich: alert on SLIs degradation only on active DC as Resolved.

Fri, Sep 8, 1:20 PM · Data Engineering and Event Platform Team (Sprint 1), Data-Engineering, Event-Platform

lbowmaker closed T344854: Email notifications of new MediaWiki history snapshot availabilty as Resolved.

Fri, Sep 8, 1:19 PM · Data Engineering and Event Platform Team (Sprint 1), Product-Analytics, Data-Engineering

lbowmaker moved T345917: [NEEDS GROOMING][SPIKE] Define how we can validate that mw.page_content_change is complete from Data Eng Backlog to SDS3.3 - Data Quality on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:18 PM · Data Engineering and Event Platform Team

lbowmaker created T345917: [NEEDS GROOMING][SPIKE] Define how we can validate that mw.page_content_change is complete.

Fri, Sep 8, 1:18 PM · Data Engineering and Event Platform Team

lbowmaker moved T345914: Define Flink k8s operator SLO from Data Eng Backlog to SDS3.3 - Data Quality on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:15 PM · Data-Platform-SRE, Event-Platform, Data-Engineering, Data Engineering and Event Platform Team (Sprint 2)

lbowmaker created T345914: Define Flink k8s operator SLO.

Fri, Sep 8, 1:14 PM · Data-Platform-SRE, Event-Platform, Data-Engineering, Data Engineering and Event Platform Team (Sprint 2)

lbowmaker moved T333013: Apache Iceberg Migration from Parent Tasks/Epics to Apache Iceberg Migration on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:08 PM · Data Engineering and Event Platform Team, Epic, Data Pipelines

lbowmaker moved T345912: SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents from Parent Tasks/Epics to SDS3.3 - Data Quality on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:08 PM · Epic, Data Engineering and Event Platform Team

lbowmaker moved T345195: [SPIKE] Can we identify indicators to inform an SLO for event emission and intake? from Event Platform Backlog to SDS3.3 - Data Quality on the Data Engineering and Event Platform Team board.

Fri, Sep 8, 1:06 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker added a subtask for T345912: SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents: T345195: [SPIKE] Can we identify indicators to inform an SLO for event emission and intake?.

Fri, Sep 8, 1:05 PM · Epic, Data Engineering and Event Platform Team

lbowmaker added a parent task for T345195: [SPIKE] Can we identify indicators to inform an SLO for event emission and intake?: T345912: SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents.

Fri, Sep 8, 1:05 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform

lbowmaker created T345912: SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents.

Fri, Sep 8, 1:02 PM · Epic, Data Engineering and Event Platform Team

Mon, Sep 4

lbowmaker moved T338065: Implement mechanism for automatic Iceberg data deletion and optimization from Data Eng Backlog to Sprint 2 on the Data Engineering and Event Platform Team board.

Mon, Sep 4, 8:43 PM · Data Engineering and Event Platform Team (Sprint 2), Data Pipelines

Aug 25 2023

lbowmaker updated the task description for T336817: Release mediawiki.page_change.v1 stream.

Aug 25 2023, 11:52 AM · Data Engineering and Event Platform Team (Sprint 1), MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), Event-Platform (Sprint 14 B), Patch-For-Review

Aug 24 2023

lbowmaker moved T336817: Release mediawiki.page_change.v1 stream from In Review to Done on the Data Engineering and Event Platform Team (Sprint 1) board.

Aug 24 2023, 5:35 PM · Data Engineering and Event Platform Team (Sprint 1), MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), Event-Platform (Sprint 14 B), Patch-For-Review

Aug 23 2023

lbowmaker updated the task description for T333011: Define Migration/Deprecation Plan for Hue.

Aug 23 2023, 4:24 PM · Data Engineering and Event Platform Team (Sprint 2), Data Pipelines (Sprint 14)

Aug 22 2023

mpopov awarded T333011: Define Migration/Deprecation Plan for Hue a Evil Spooky Haunted Tree token.

Aug 22 2023, 6:30 PM · Data Engineering and Event Platform Team (Sprint 2), Data Pipelines (Sprint 14)

lbowmaker removed a project from T344690: [Spike] Quantify pages and revisions as relevant to dumps: Data Engineering and Event Platform Team (Sprint 1).

Aug 22 2023, 5:45 PM · Data Products (Sprint 01), Data Pipelines (Sprint 14)

lbowmaker removed a project from T344691: [Spike] Understand how "large" pages (with lots of revisions) are problematic when writing XML to Hadoop: Data Engineering and Event Platform Team (Sprint 1).

Aug 22 2023, 5:44 PM · Data Products (Sprint 00), Data Pipelines (Sprint 14)

lbowmaker edited projects for T344693: Understand Hadoop OutputFormat and how to solve the problem, added: Data Products (Sprint 0); removed Data Products (Sprint 00), Data Engineering and Event Platform Team (Sprint 1).

Aug 22 2023, 5:43 PM · Dumps 2.0, Data Products, Data Pipelines (Sprint 14)

lbowmaker created T344688: Increase Max Message Size in Kafka Jumbo .

Aug 22 2023, 1:06 PM · Patch-For-Review, Data Engineering and Event Platform Team (Sprint 2), Data-Platform-SRE, Data-Engineering, Event-Platform

Aug 21 2023

lbowmaker added a comment to T333011: Define Migration/Deprecation Plan for Hue.

Write up deprecation announcement

Aug 21 2023, 3:38 PM · Data Engineering and Event Platform Team (Sprint 2), Data Pipelines (Sprint 14)

lbowmaker claimed T333011: Define Migration/Deprecation Plan for Hue.

Aug 21 2023, 3:37 PM · Data Engineering and Event Platform Team (Sprint 2), Data Pipelines (Sprint 14)

lbowmaker assigned T318863: Event Platform and DataHub Integration to tchin.

Aug 21 2023, 3:23 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Catalog, Event-Platform

lbowmaker moved T318863: Event Platform and DataHub Integration from Next Up to In progress on the Data Engineering and Event Platform Team (Sprint 1) board.

Aug 21 2023, 3:23 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Catalog, Event-Platform

lbowmaker edited projects for T318863: Event Platform and DataHub Integration, added: Data Engineering and Event Platform Team (Sprint 1); removed Data Engineering and Event Platform Team.

Aug 21 2023, 3:22 PM · Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Data-Catalog, Event-Platform

lbowmaker removed a project from T341229: ProduceCanaryEvents job should be scheduled by Airflow: Data Engineering and Event Platform Team (Sprint 1).

Aug 21 2023, 3:20 PM · Data-Engineering

lbowmaker removed a project from T326002: EventGate occasionally fails to ingest specific schemas: Data Engineering and Event Platform Team (Sprint 1).

Aug 21 2023, 3:20 PM · Patch-For-Review, MW-1.41-notes (1.41.0-wmf.28; 2023-09-26), Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform, Data Pipelines

lbowmaker created T344616: Implement retry mechanism for refine jobs.

Aug 21 2023, 3:20 PM · Data Engineering and Event Platform Team (Sprint 2)

lbowmaker reassigned T336817: Release mediawiki.page_change.v1 stream from WDoranWMF to gmodena.

Aug 21 2023, 3:09 PM · Data Engineering and Event Platform Team (Sprint 1), MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), Event-Platform (Sprint 14 B), Patch-For-Review

lbowmaker edited projects for T331283: [NEEDS GROOMING] Store Flink HA metadata in Zookeeper, added: Data Engineering and Event Platform Team (Sprint 1); removed Data Engineering and Event Platform Team.

Aug 21 2023, 3:05 PM · Data Engineering and Event Platform Team (Sprint 2), Discovery-Search, Event-Platform, serviceops-radar, Data-Engineering

lbowmaker moved T326002: EventGate occasionally fails to ingest specific schemas from Sprint 2 to Sprint 1 on the Data Engineering and Event Platform Team board.

Aug 21 2023, 3:01 PM · Patch-For-Review, MW-1.41-notes (1.41.0-wmf.28; 2023-09-26), Data Engineering and Event Platform Team (Sprint 2), Data-Engineering, Event-Platform, Data Pipelines

Aug 18 2023

lbowmaker moved T307959: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content from Next Up to In progress on the Data Engineering and Event Platform Team (Sprint 1) board.

Aug 18 2023, 11:57 AM · Data Engineering and Event Platform Team, Data-Engineering, Event-Platform, Epic

lbowmaker edited projects for T307959: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content, added: Data Engineering and Event Platform Team (Sprint 1); removed Data Engineering and Event Platform Team.

Aug 18 2023, 11:57 AM · Data Engineering and Event Platform Team, Data-Engineering, Event-Platform, Epic