mailman and decide if migration is needed
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Dzahn
	Aug 18 2015, 1:22 AM

Description

check each of the directories in /var/lib/mailman and decide whether we need to care about anything to import or not

archives
bin -> /usr/lib/mailman/bin
cgi-bin -> /usr/lib/cgi-bin/mailman
cron -> /usr/lib/mailman/cron
data
icons -> /usr/share/images/mailman
lists
locks -> /var/lock/mailman
logs -> /var/log/mailman
mail -> /usr/lib/mailman/mail
Mailman -> /usr/lib/mailman/Mailman
messages
qfiles
scripts -> /usr/lib/mailman/scripts
spam
templates -> /etc/mailman
templatesgarbage
templatesmoregarbage
tmp

Details

	Subject	Repo	Branch	Lines +/-
	mailman: mini script to rsync lists	operations/puppet	production	+24 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	faidon	T84041 Replace all instances of lighttpd with nginx
Resolved	faidon	T84053 mailman - replace lighttpd
Resolved	LSobanski	T111653 Encrypt all the things
Resolved	faidon	T82576 Enable STARTTLS (both inbound and outbound) on lists
Resolved	JanZerebecki	T55259 Add Forward Secrecy to all HTTPS sites
Resolved	Dzahn	T90351 Improve SSL of lists.wikimedia.org
Resolved	Dzahn	T83541 Upgrade Exim to >=4.73
Duplicate	None	T97492 Upgrade to Mailman 3.0
Resolved	Dzahn	T110141 TTL back up to normal 1H
Resolved	• MZMcBride	T27231 Mailman mailing list archiver truncates if a line begins with "From"
Resolved	None	T66818 Mitigate strict DMARC policy on the mailing lists
Resolved	Dzahn	T80945 Get rid of all Ubuntu Lucid (10.04) installs
Resolved	Dzahn	T82698 shutdown sodium after mailman has migrated to jessie VM
Resolved	Dzahn	T105756 Mailman Upgrade (Jessie & Mailman 2.x) and migration to a VM
Resolved	Dzahn	T109399 go through all directories in /var/lib/mailman and decide if migration is needed

Event Timeline

Dzahn created this task.Aug 18 2015, 1:22 AM

Dzahn claimed this task.

Dzahn raised the priority of this task from to High.

Dzahn updated the task description. (Show Details)

Dzahn added projects: acl*sre-team, Wikimedia-Mailing-lists.

Dzahn added subscribers: ori, • MZMcBride, Dzahn and 5 others.

archives; yes
bin; no
cgi-bin; no
cron; no
data; to my knowledge - not necessary. Just stored site password, list creator password and version. Ideally, all should be different (and lists need them to be changed after import)
icons; no
lists; yes
locks; no (symlink)
logs; no (symlink)
mail; not to my knowledge; [verify] (symlink)
Mailman; no
messages; no
qfiles; yes
scripts; no
spam; unsure, need to verify usage definitely.
templates; managed by puppet.
templates*; no reason for them to exist.
tmp; usage unknown. verify on sodium its usage.

• JohnLewis moved this task from Backlog to Jessie/Upgrade (2.x) on the Wikimedia-Mailing-lists board.Aug 18 2015, 6:09 PM

data is not needed if we do things right. As in actually reset passwords and so on.

mail as a symlink is not needed.

spam should be checked before migration. I feel its what spamd might use to train its filters.

tmp is what it says - temp.

"tmp" is not from mailman, it looks like people created it

it has stuff like "temp_backup_of_exim_logs-ask_jgreen", "make_sense_of_exim_log" and "exim4.conf.faidon-test"

data - i think it's a good time to change the site and list creator passwords anyways, list admin passwords are not affected, they get copied with the list configs

archives and lists - covered by the import script, ack

qfiles - NOT covered so far, do we really want to rsync them?

spam - yea, individual .msg files here with mail that got marked as spam, probably won't care

data - eh, yea, this has also a bunch of .pck files starting in "heldmsg-" - really not sure yet how to handle these messages that are held and waiting for moderation

Below is my final compiled list of what should and shouldn't go.

archives; yes
bin; no
cgi-bin; no
cron; no
data; only heldmsg-*!
icons; no
lists; yes
locks; no
logs; no
mail; no
Mailman; no
messages; no
qfiles; yes
scripts; no
spam; no
templates; managed by puppet.
templates*; no
tmp; no

Dzahn closed this task as Resolved.Aug 21 2015, 7:24 PM

Dzahn mentioned this in T109467: write migration plan for mailman.Aug 22 2015, 12:15 AM

Dzahn mentioned this in T110129: rsync all configs and archives one more time.Aug 24 2015, 11:24 PM

Change 233888 had a related patch set uploaded (by Dzahn):
mailman: mini script to rsync lists

https://gerrit.wikimedia.org/r/233888

gerritbot added a project: Patch-For-Review.Aug 26 2015, 12:21 AM