Page MenuHomePhabricator
Create Task
Maniphest T336817

Release mediawiki.page_change.v1 stream
Closed, ResolvedPublic
Actions

Description

We are ready!

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

Ottomata created this task.May 16 2023, 9:19 PM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptMay 16 2023, 9:19 PM
Ottomata edited projects, added Event-Platform; removed Event-Platform (Sprint 14 A), Epic.May 16 2023, 9:19 PM
gerritbot added a comment.May 16 2023, 9:21 PM

Change 920378 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] Declare mediawiki.page_change.v1 stream and produce from Eventbus

https://gerrit.wikimedia.org/r/920378

gerritbot added a project: Patch-For-Review.May 16 2023, 9:21 PM
Ottomata updated the task description. (Show Details)May 16 2023, 9:21 PM
gerritbot added a comment.May 16 2023, 9:26 PM

Change 920379 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] page_content_change - Consume from mediawiki.page_change.v1

https://gerrit.wikimedia.org/r/920379

Ottomata triaged this task as High priority.May 16 2023, 9:26 PM
Ottomata updated the task description. (Show Details)
Ottomata removed subscribers: JMeybohm, akosiaris.
Ottomata moved this task from Backlog to Sprint 14 A on the Event-Platform board.May 16 2023, 9:29 PM
Ottomata edited projects, added Event-Platform (Sprint 14 A); removed Event-Platform.
Ottomata moved this task from Next Up to In progress on the Event-Platform (Sprint 14 A) board.
Ottomata mentioned this in T325303: Deploy mediawiki-page-content-change-enrichment to wikikube k8s.May 16 2023, 9:33 PM
Ottomata mentioned this in T333468: Use the mediawiki.revision_score_drafttopic stream instead of mediawiki.revision-score.May 16 2023, 9:41 PM
Maintenance_bot edited projects, added Data-Engineering; removed Data-Engineering-Planning.May 16 2023, 10:30 PM
JArguello-WMF awarded a token.May 17 2023, 1:11 PM
gerritbot added a comment.May 17 2023, 2:04 PM

Change 920378 merged by jenkins-bot:

[operations/mediawiki-config@master] Declare mediawiki.page_change.v1 stream and produce from Eventbus

https://gerrit.wikimedia.org/r/920378

Stashbot added a comment.May 17 2023, 2:14 PM

Mentioned in SAL (#wikimedia-operations) [2023-05-17T14:14:39Z] <otto@deploy1002> Synchronized wmf-config/ext-EventStreamConfig.php: wgEventStreams - Declare mediawiki.page_change.v1 stream - T336817 (duration: 07m 30s)

Stashbot added a comment.May 17 2023, 2:27 PM

Mentioned in SAL (#wikimedia-operations) [2023-05-17T14:27:15Z] <ottomata> rolling restart of eventgate-main to pick up new mediawiki.page_change.v1 stream config - T336817

Stashbot added a comment.May 17 2023, 2:33 PM

Mentioned in SAL (#wikimedia-operations) [2023-05-17T14:33:34Z] <ottomata> EventBus: produce to mediawiki.page_change.v1 stream - T336817

Ottomata updated the task description. (Show Details)May 17 2023, 2:35 PM
gerritbot added a comment.May 17 2023, 2:36 PM

Change 920379 merged by jenkins-bot:

[operations/deployment-charts@master] page_content_change - Consume from mediawiki.page_change.v1

https://gerrit.wikimedia.org/r/920379

Stashbot added a comment.May 17 2023, 2:39 PM

Mentioned in SAL (#wikimedia-operations) [2023-05-17T14:39:38Z] <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: wgEventStreams - EventBus: produce to mediawiki.page_change.v1 stream - T336817 (duration: 06m 20s)

Ottomata updated the task description. (Show Details)May 18 2023, 1:02 PM
Ottomata moved this task from In progress to In Review on the Event-Platform (Sprint 14 A) board.
gerritbot added a comment.May 31 2023, 5:58 PM

Change 924998 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] EventStreamConfig - page_change - Remove unused streams and settings

https://gerrit.wikimedia.org/r/924998

gerritbot added a comment.Jun 1 2023, 4:30 PM

Change 924998 merged by jenkins-bot:

[operations/mediawiki-config@master] EventStreamConfig - page_change - Remove unused streams and settings

https://gerrit.wikimedia.org/r/924998

Stashbot added a comment.Jun 1 2023, 4:44 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-01T16:44:56Z] <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: no-op: Remove undeeded wgEventBusStreamNamesMap override setting - T336817 (duration: 08m 18s)

Stashbot added a comment.Jun 1 2023, 4:55 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-01T16:55:36Z] <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: revert: Remove undeeded wgEventBusStreamNamesMap override setting. Recent EventBus changes are not deployed yet? - T336817 (duration: 07m 24s)

Ottomata updated the task description. (Show Details)Jun 2 2023, 7:30 PM
JArguello-WMF edited projects, added Event-Platform (Sprint 14 B); removed Event-Platform (Sprint 14 A).Jun 5 2023, 11:42 AM
JArguello-WMF moved this task from Next Up to In Review on the Event-Platform (Sprint 14 B) board.
Stashbot added a comment.Jun 5 2023, 5:26 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-05T17:26:33Z] <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: no-op: Remove undeeded wgEventBusStreamNamesMap override setting (take 2) - T336817 (duration: 09m 25s)

Stashbot added a comment.Jun 5 2023, 5:50 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-05T17:50:03Z] <otto@deploy1002> Synchronized wmf-config/ext-EventStreamConfig.php: no-op: Remove unused page_change rc streams - T336817 (duration: 20m 11s)

gerritbot added a comment.Jun 5 2023, 6:14 PM

Change 927245 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] EventStreamConfig - revert page_change changes, somehow this broke

https://gerrit.wikimedia.org/r/927245

gerritbot added a comment.Jun 5 2023, 6:18 PM

Change 927245 merged by jenkins-bot:

[operations/mediawiki-config@master] EventStreamConfig - revert page_change changes, somehow this broke

https://gerrit.wikimedia.org/r/927245

Stashbot added a comment.Jun 5 2023, 6:30 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-05T18:30:46Z] <otto@deploy1002> Synchronized wmf-config/ext-EventStreamConfig.php: revert - Remove unused page_change rc streams - T336817 (duration: 11m 23s)

Stashbot added a comment.Jun 5 2023, 6:52 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-05T18:52:09Z] <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: no-op: revert - remove undeeded wgEventBusStreamNamesMap override setting (take 2) - T336817 (duration: 11m 54s)

Ottomata added a comment.Jun 5 2023, 6:56 PM

I tried deploying 'cleanup by removing wgEventBusStreamNamesMap override in mediawiki-config' again today, and once again broke mediawiki.page_change.v1 production. I don't know why this broke things, I tested on mwdebug and it seemed like it worked fine?

Will have to be more careful and do some local and/or beta testing before I try again.

xcollazo subscribed.Jun 6 2023, 8:11 PM
gerritbot added a comment.Jun 12 2023, 10:51 PM

Change 929430 had a related patch set uploaded (by Ottomata; author: Ottomata):

[mediawiki/extensions/EventBus@master] Remove duplicate default setting for PAGE_CHANGE_STREAM_NAME_DEFAULT

https://gerrit.wikimedia.org/r/929430

Ottomata added a comment.Jun 12 2023, 10:54 PM

^ is why my previous attempts failed!

gerritbot added a comment.Jun 12 2023, 11:10 PM

Change 929430 merged by Ottomata:

[mediawiki/extensions/EventBus@master] Remove duplicate default setting for PAGE_CHANGE_STREAM_NAME_DEFAULT

https://gerrit.wikimedia.org/r/929430

ReleaseTaggerBot added a project: MW-1.41-notes (1.41.0-wmf.13; 2023-06-13).Jun 13 2023, 1:00 AM
Ottomata added a comment.Jun 13 2023, 2:04 PM

I'm going to wait for https://gerrit.wikimedia.org/r/929430 to roll out with wmf.13 this week. Next week I'll continue the cleanup.

gerritbot added a comment.Jun 20 2023, 3:58 PM

Change 931638 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] wgEventBusStreamNamesMap - Remove page_change stream name override

https://gerrit.wikimedia.org/r/931638

Ottomata updated the task description. (Show Details)Jun 20 2023, 4:00 PM
gerritbot added a comment.Jun 20 2023, 4:04 PM

Change 931638 merged by jenkins-bot:

[operations/mediawiki-config@master] wgEventBusStreamNamesMap - Remove page_change stream name override

https://gerrit.wikimedia.org/r/931638

gerritbot added a comment.Jun 20 2023, 4:05 PM

Change 931642 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] wgEventStreams - remove unused 'rc' stream names for page_change related streams

https://gerrit.wikimedia.org/r/931642

Stashbot added a comment.Jun 20 2023, 4:17 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-20T16:17:33Z] <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: wgEventBusStreamNamesMap - Remove page_change stream name override - T336817 (duration: 07m 42s)

gerritbot added a comment.Jun 20 2023, 4:19 PM

Change 931642 merged by jenkins-bot:

[operations/mediawiki-config@master] wgEventStreams - remove unused 'rc' stream names for page_change related streams

https://gerrit.wikimedia.org/r/931642

gerritbot added a comment.Jun 20 2023, 4:24 PM

Change 931646 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] evenstreams - publicly expose mediawiki.page_change.v1 stream

https://gerrit.wikimedia.org/r/931646

Ottomata added a comment.Jun 20 2023, 4:27 PM

Let's get privacy review on this one. https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/931646

Sending an email to privacy@wikimedia.org...

Stashbot added a comment.Jun 20 2023, 4:28 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-20T16:28:35Z] <otto@deploy1002> Synchronized wmf-config/ext-EventStreamConfig.php: wgEventStreams - remove unused rc stream names for page_change related streams - T336817 (duration: 07m 35s)

Ottomata updated the task description. (Show Details)Jun 20 2023, 4:34 PM
gerritbot added a comment.Jun 20 2023, 9:23 PM

Change 931689 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] wgEventStreams - use eventgate-analytics-external for canary events of page_content_change

https://gerrit.wikimedia.org/r/931689

gerritbot added a comment.Jun 20 2023, 9:26 PM

Change 931689 merged by jenkins-bot:

[operations/mediawiki-config@master] wgEventStreams - use eventgate-analytics-external for canary events of page_content_change

https://gerrit.wikimedia.org/r/931689

Stashbot added a comment.Jun 20 2023, 9:36 PM

Mentioned in SAL (#wikimedia-operations) [2023-06-20T21:36:53Z] <otto@deploy1002> Synchronized wmf-config/ext-EventStreamConfig.php: wgEventStreams - page_content_change should use eventgate-analytics-external for canary events - T336817 (duration: 07m 22s)

JArguello-WMF moved this task from Incoming (new tickets) to Event Platform Backlog on the Data-Engineering board.Jun 29 2023, 10:28 PM
JArguello-WMF added a project: Data Engineering and Event Platform Team (Sprint 0).Jun 30 2023, 3:56 PM
JArguello-WMF moved this task from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 0) board.
JArguello-WMF removed a project: Data-Engineering.Jun 30 2023, 4:00 PM
Ottomata updated the task description. (Show Details)Jul 6 2023, 2:18 PM
JAllemandou reassigned this task from Ottomata to WDoranWMF.Jul 10 2023, 5:37 PM
lbowmaker moved this task from Sprint 0 to Sprint 1 on the Data Engineering and Event Platform Team board.Jul 25 2023, 12:25 PM
lbowmaker edited projects, added Data Engineering and Event Platform Team (Sprint 1); removed Data Engineering and Event Platform Team (Sprint 0).
lbowmaker moved this task from Next Up to In Review on the Data Engineering and Event Platform Team (Sprint 1) board.
lbowmaker reassigned this task from WDoranWMF to gmodena.Aug 21 2023, 3:08 PM
lbowmaker added a subscriber: WDoranWMF.
gerritbot added a comment.Aug 21 2023, 7:02 PM

Change 951178 had a related patch set uploaded (by Gmodena; author: Gmodena):

[mediawiki/services/eventstreams@master] Expose mediawiki.page_change.v1 publicly.

https://gerrit.wikimedia.org/r/951178

gerritbot added a comment.Aug 21 2023, 8:06 PM

Change 951178 abandoned by Gmodena:

[mediawiki/services/eventstreams@master] Expose mediawiki.page_change.v1 publicly.

Reason:

Wrong configs. Should expose via helmfile.d instead.

https://gerrit.wikimedia.org/r/951178

gerritbot added a comment.Aug 22 2023, 7:24 AM

Change 951426 had a related patch set uploaded (by Gmodena; author: Gmodena):

[operations/deployment-charts@master] Expose mediawiki.page_change.v1 publicly.

https://gerrit.wikimedia.org/r/951426

gerritbot added a comment.Aug 23 2023, 6:06 AM

Change 951426 merged by jenkins-bot:

[operations/deployment-charts@master] Expose mediawiki.page_change.v1 publicly.

https://gerrit.wikimedia.org/r/951426

gmodena updated the task description. (Show Details)Aug 23 2023, 1:46 PM
lbowmaker moved this task from In Review to Done on the Data Engineering and Event Platform Team (Sprint 1) board.Aug 24 2023, 5:34 PM
lbowmaker updated the task description. (Show Details)Aug 25 2023, 11:52 AM
lbowmaker closed this task as Resolved.Sep 8 2023, 1:21 PM
gerritbot added a comment.Oct 23 2023, 1:57 PM

Change 931646 abandoned by Ottomata:

[operations/deployment-charts@master] evenstreams - publicly expose mediawiki.page_change.v1 stream

Reason:

Done in https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/951426/

https://gerrit.wikimedia.org/r/931646

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL