Page MenuHomePhabricator
Create Task
Maniphest T365395

Postfix outbound rollout sequence, mx-out
Closed, ResolvedPublic
Actions

Description

This rollout plan is based roughly on volume and order of importance:

  • Internal development services
    • Gitlab
    • Gerrit
    • Phabricator
  • Mediawiki servers
  • Fundraising tech
  • Hiera default
  • Hunt for stragglers

Details

Related Changes in Gerrit:
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

jhathaway created this task.May 20 2024, 7:46 PM
jhathaway triaged this task as Medium priority.May 20 2024, 8:33 PM
gerritbot added a comment.May 20 2024, 9:20 PM

Change #1034158 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] gitlab: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1034158

gerritbot added a project: Patch-For-Review.May 20 2024, 9:20 PM
jhathaway updated the task description. (Show Details)May 20 2024, 9:44 PM
Jelto added a project: collaboration-services.May 21 2024, 9:53 AM
Jelto moved this task from Incoming to Consultation on the collaboration-services board.
gerritbot added a comment.May 21 2024, 3:04 PM

Change #1034158 merged by JHathaway:

[operations/puppet@production] gitlab: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1034158

Maintenance_bot removed a project: Patch-For-Review.May 21 2024, 3:32 PM
gerritbot added a comment.May 21 2024, 8:48 PM

Change #1034583 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] postfix: dkim sign subdomains of wikimedia.org

https://gerrit.wikimedia.org/r/1034583

gerritbot added a project: Patch-For-Review.May 21 2024, 8:48 PM
gerritbot added a comment.May 21 2024, 8:52 PM

Change #1034583 merged by JHathaway:

[operations/puppet@production] postfix: dkim sign subdomains of wikimedia.org

https://gerrit.wikimedia.org/r/1034583

jhathaway updated the task description. (Show Details)May 21 2024, 9:20 PM
Maintenance_bot removed a project: Patch-For-Review.May 21 2024, 9:30 PM
gerritbot added a comment.May 21 2024, 9:32 PM

Change #1034593 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] gerrit: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1034593

gerritbot added a project: Patch-For-Review.May 21 2024, 9:32 PM
gerritbot added a comment.May 22 2024, 2:23 PM

Change #1034593 merged by JHathaway:

[operations/puppet@production] gerrit: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1034593

Maintenance_bot removed a project: Patch-For-Review.May 22 2024, 2:31 PM
jhathaway updated the task description. (Show Details)May 22 2024, 8:39 PM
gerritbot added a comment.May 22 2024, 9:42 PM

Change #1035050 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] phabricator: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1035050

gerritbot added a project: Patch-For-Review.May 22 2024, 9:42 PM
gerritbot added a comment.May 23 2024, 3:30 PM

Change #1035050 merged by JHathaway:

[operations/puppet@production] phabricator: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1035050

Maintenance_bot removed a project: Patch-For-Review.May 23 2024, 3:32 PM
jhathaway updated the task description. (Show Details)May 29 2024, 5:11 PM
gerritbot added a comment.May 30 2024, 9:24 PM

Change #1037621 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] phab: query for inbound mail servers

https://gerrit.wikimedia.org/r/1037621

gerritbot added a project: Patch-For-Review.May 30 2024, 9:24 PM
jhathaway updated the task description. (Show Details)May 31 2024, 6:46 PM
gerritbot added a comment.Jun 3 2024, 9:39 PM

Change #1038442 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] role::mail::mx: tag servers with mx_in

https://gerrit.wikimedia.org/r/1038442

gerritbot added a comment.Jun 3 2024, 9:41 PM

Change #1038442 merged by JHathaway:

[operations/puppet@production] role::mail::mx: tag servers with mx_in

https://gerrit.wikimedia.org/r/1038442

gerritbot added a comment.Jun 4 2024, 6:50 PM

Change #1038887 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] devtools: update puppetmaster and pubkey

https://gerrit.wikimedia.org/r/1038887

gerritbot added a comment.Jun 4 2024, 6:57 PM

Change #1038887 merged by JHathaway:

[operations/puppet@production] devtools: update puppetmaster and pubkey

https://gerrit.wikimedia.org/r/1038887

gerritbot added a comment.Jun 5 2024, 4:23 PM

Change #1039245 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] mw1365: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1039245

gerritbot added a comment.Jun 5 2024, 4:31 PM

Change #1037621 merged by Dzahn:

[operations/puppet@production] phab: query for inbound mail servers

https://gerrit.wikimedia.org/r/1037621

gerritbot added a comment.Jun 5 2024, 4:46 PM

Change #1039248 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] phab: fix ferm ensure

https://gerrit.wikimedia.org/r/1039248

gerritbot added a comment.Jun 5 2024, 4:51 PM

Change #1039248 merged by Dzahn:

[operations/puppet@production] phab: fix ferm ensure

https://gerrit.wikimedia.org/r/1039248

gerritbot added a comment.Jun 5 2024, 5:02 PM

Change #1038844 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] Revert "Revert "Revert "Revert "phabricator: Move outbound email to mx-out{1001,2001}.wikimedia.org""""

https://gerrit.wikimedia.org/r/1038844

gerritbot added a comment.Jun 5 2024, 5:06 PM

Change #1038844 merged by JHathaway:

[operations/puppet@production] Revert "Revert "Revert "Revert "phabricator: Move outbound email to mx-out{1001,2001}.wikimedia.org""""

https://gerrit.wikimedia.org/r/1038844

jhathaway updated the task description. (Show Details)Jun 5 2024, 5:12 PM
Dwisehaupt subscribed.Jun 5 2024, 8:23 PM

@jhathaway Question about the routing of mail with these hosts. Currently the civicrm host receives mail from mx1001/mx2001. The inbound mail is dmarc and VERP responses to @donate.wikimedia.org

Will this inbound mail be coming from the new mx-out hosts or is there some other pathway?

jhathaway updated the task description. (Show Details)Jun 5 2024, 8:34 PM
jhathaway added a comment.Jun 5 2024, 8:38 PM
In T365395#9865652, @Dwisehaupt wrote:

@jhathaway Question about the routing of mail with these hosts. Currently the civicrm host receives mail from mx1001/mx2001. The inbound mail is dmarc and VERP responses to @donate.wikimedia.org

Will this inbound mail be coming from the new mx-out hosts or is there some other pathway?

At present inbound mail will still come from mx1001/mx2001. The mx-out boxes are tasked only with handling outbound mail. There are additional mx-in boxes which will handle incoming email and replace the mx1001/mx2001 boxes. Those boxes should begin rolling out next week.

gerritbot added a comment.Jun 6 2024, 2:33 PM

Change #1039245 merged by JHathaway:

[operations/puppet@production] mw1365: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1039245

gerritbot added a comment.Jun 6 2024, 2:40 PM

Change #1039737 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/deployment-charts@master] mw-debug: change mail_host

https://gerrit.wikimedia.org/r/1039737

gerritbot added a comment.Jun 7 2024, 2:29 PM

Change #1039737 merged by JHathaway:

[operations/deployment-charts@master] mw-debug: change mail_host

https://gerrit.wikimedia.org/r/1039737

Maintenance_bot removed a project: Patch-For-Review.Jun 7 2024, 2:30 PM
Dwisehaupt closed subtask T366740: Update fundraising mail settings to use new production mx hosts as Resolved.Jun 11 2024, 5:35 PM
Dwisehaupt updated the task description. (Show Details)
gerritbot added a comment.Jun 11 2024, 7:43 PM

Change #1041758 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] mediawiki: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1041758

gerritbot added a project: Patch-For-Review.Jun 11 2024, 7:43 PM
gerritbot added a comment.Jun 11 2024, 7:59 PM

Change #1041763 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/deployment-charts@master] mw: change mail_host

https://gerrit.wikimedia.org/r/1041763

gerritbot added a comment.Jun 12 2024, 4:01 PM

Change #1041758 merged by JHathaway:

[operations/puppet@production] mediawiki: Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1041758

gerritbot added a comment.Jun 12 2024, 4:03 PM

Change #1041763 merged by jenkins-bot:

[operations/deployment-charts@master] mw: change mail_host

https://gerrit.wikimedia.org/r/1041763

jhathaway updated the task description. (Show Details)Jun 12 2024, 4:24 PM
Maintenance_bot removed a project: Patch-For-Review.Jun 12 2024, 4:45 PM
jhathaway closed subtask T366113: Update SPF records as needed as Resolved.Jun 14 2024, 2:02 PM
gerritbot added a comment.Jun 20 2024, 3:07 PM

Change #1048021 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] Revert "mediawiki: Move outbound email to mx-out{1001,2001}.wikimedia.org"

https://gerrit.wikimedia.org/r/1048021

gerritbot added a project: Patch-For-Review.Jun 20 2024, 3:07 PM
gerritbot added a comment.Jun 20 2024, 3:55 PM

Change #1048021 merged by JHathaway:

[operations/puppet@production] Revert "mediawiki: Move outbound email to mx-out{1001,2001}.wikimedia.org"

https://gerrit.wikimedia.org/r/1048021

Maintenance_bot removed a project: Patch-For-Review.Jun 20 2024, 4:32 PM
jhathaway updated the task description. (Show Details)Jul 2 2024, 9:01 PM
gerritbot added a comment.Jul 3 2024, 4:24 PM

Change #1051803 had a related patch set uploaded (by JHathaway; author: JHathaway):

[operations/puppet@production] Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1051803

gerritbot added a project: Patch-For-Review.Jul 3 2024, 4:24 PM
gerritbot added a comment.Jul 3 2024, 9:22 PM

Change #1051803 merged by JHathaway:

[operations/puppet@production] Move outbound email to mx-out{1001,2001}.wikimedia.org

https://gerrit.wikimedia.org/r/1051803

jhathaway updated the task description. (Show Details)Jul 3 2024, 9:25 PM
Platonides mentioned this in T369341: Some VRTS emails to Gmail accounts fail the SPF check.Jul 7 2024, 2:27 AM
Maintenance_bot removed a project: Patch-For-Review.Jul 9 2024, 8:44 PM
jhathaway closed this task as Resolved.Jul 14 2024, 10:54 PM
jhathaway updated the task description. (Show Details)
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits