Page MenuHomePhabricator

contacts.wikimedia.org drupal unpuppetized / retire contacts
Closed, ResolvedPublic

Description

While encouraging db1001 clients to use dbproxy1001 I noticed contacts.wikimedia.org mysql config is unpuppetized with hard coded database host names.

T84158 suggests contacts.wikimedia.org might just go away soon... if not, it would be nice to fix the config.

Event Timeline

Springle raised the priority of this task from to Needs Triage.
Springle updated the task description. (Show Details)
Springle added a project: acl*sre-team.
Springle added subscribers: Springle, Dzahn, Jgreen.

I can't seem to find the string "db1001" in the docroot of contacts. Do you know where it is already?

It has already been manually changed to dbproxy1001.

$ sudo grep -nr dbproxy1001 * | awk -F ':' '{print $1 ":" $2}'
sites/default/civicrm.settings.php:59
sites/default/civicrm.settings.php:80
sites/default/settings.php:92
sites/default/settings.php:251

ah, gotcha. thanks. yea, i'm not sure how much to puppetize here since we might get rid of it as you already pointed out, but for now i'm at least going to do the main config files and put the password into private repo.

Dzahn triaged this task as Medium priority.Feb 26 2015, 7:06 PM

Change 194786 had a related patch set uploaded (by Dzahn):
WIP: role and module for contacts

https://gerrit.wikimedia.org/r/194786

< quiddity> mutante, I've emailed anna koval, who might know.
< abartov> mutante: AFAIK, the Edu team now uses Asana to manage their contacts, and it is likely their Civi instance is disused. But obviously, you'll need to confirm with them.

< quiddity> mutante, I've emailed anna koval, who might know.
< abartov> mutante: AFAIK, the Edu team now uses Asana to manage their contacts, and it is likely their Civi instance is disused. But obviously, you'll need to confirm with them.

^ True.

What I recall being told by LiAnna Davis before she left WMF was that most of the Ed Team's Civi contacts were US/Canada people, and so not particularly useful to our current scope of work -- that being the global education programs. I do not even have access to contacts.wikimedia.org. And to my knowledge, no one else on my team is currently using Civi either.

Please let me know if there is additional information/context that I can provide.

I do not even have access to contacts.wikimedia.org. And to my knowledge, no one else on my team is currently using Civi either.

Ah, hi @AKoval_WMF! Thanks a lot for that reply.

Yes, so basically this is to find out if it would be ok with you and your team if we discontinue this service entirely and shut it down. Can we say it has been completely replaced by Asana?

Would you want us to provide some kind of dump of the data in there or is that covered as well?

I'm asking because if it's still used we would really have to get into installing major upgrades and managing this software.

Yes, for our purposes now, Asana has replaced Civi.

However, I'm sure we'd appreciate a data dump just in case I'm wrong about that! :)

Also, it's my understanding that the Fundraising team may still use Civi; you could verify with Caitlin Virtue.

Thank you. I believe the Fundraising team uses an entirely seperate installation of CiviCRM, i will confirm though.

@Jgreen ^ the fundraising civicrm has nothing to do with contact civi on zirconium, correct? i'm pretty sure, just to have the confirmation here on ticket.

Fundraising has never had anything to do with contacts.wikimedia.org. they do use civicrm software, but it's a totally unrelated instance, having absolutely nothing to do with this one--different hostname, different database, different servers, different cluster altogether. If this instance suddenly disappeared nobody in fundraising would even notice.

Change 197219 had a related patch set uploaded (by Dzahn):
disable contacts website

https://gerrit.wikimedia.org/r/197219

Change 197219 merged by Dzahn:
disable contacts website

https://gerrit.wikimedia.org/r/197219

I disabled (but did not delete) the service for now and left a message at the address instead to contact me if anyone still expects it. It can be re-enabled easily (for a reasonable grace period).

Change 194786 abandoned by Dzahn:
WIP: role and module for contacts

Reason:
contacts is disabled

https://gerrit.wikimedia.org/r/194786

mailed wikitech-l and engineering-l about retiring this service

Dzahn renamed this task from contacts.wikimedia.org drupal unpuppetized to contacts.wikimedia.org drupal unpuppetized / retire contacts .Mar 23 2015, 4:31 PM

we need to provide a dump of the data and give it to @AKoval_WMF

Change 205457 had a related patch set uploaded (by Dzahn):
contacts: remove role from zirconium and delete it

https://gerrit.wikimedia.org/r/205457

I have created dumps of the 2 (!) databases using mysqldump. One is "contacts_drupal" and the other "contacts_civicrm" (because CiviCRM ran on top of Drupal). They are not very large.

7.9M -rw-rw-r-- 1 dzahn wikidev 7.8M Apr 23 19:47 contacts_civicrm_20150423.sql.gz
412K -rw-rw-r-- 1 dzahn wikidev 405K Apr 23 19:47 contacts_drupal_20150423.sql.gz

@akosiaris what's a good place to put these to ensure they are backed up but stay private? should i make a puppet change that adds a specific new directory to backup sets or just use an existing place?

Change 206174 had a related patch set uploaded (by Dzahn):
backup: add new fileset for contacts.wm

https://gerrit.wikimedia.org/r/206174

Change 206176 had a related patch set uploaded (by Dzahn):
contacts: remove Apache, add Backup

https://gerrit.wikimedia.org/r/206176

Change 206174 merged by Dzahn:
backup: add new fileset for contacts.wm

https://gerrit.wikimedia.org/r/206174

Change 206176 merged by Dzahn:
contacts: remove Apache, add Backup

https://gerrit.wikimedia.org/r/206176

confirmed zirconium is now a backup host and shows up on the bacula director and there is a new fileset that backs up the database dump files i created

Change 205457 abandoned by Dzahn:
contacts: remove role from zirconium and delete it

Reason:
removed apache site and added backup role instead

https://gerrit.wikimedia.org/r/205457

manually added bacula job to archive pool to keep it for longer than 60 days

Yes, for our purposes now, Asana has replaced Civi.
However, I'm sure we'd appreciate a data dump just in case I'm wrong about that! :)

@AKoval_WMF I made a dump of the database and copy of the Civi installation files and ensured they are backed up by our backup server. So if you guys wanted to request these to actually import things we would be able to restore them on demand any time but we can clean up the former civi server. Good?

Change 206413 had a related patch set uploaded (by Dzahn):
varnish: delete contacts from misc-web config

https://gerrit.wikimedia.org/r/206413

Change 206415 had a related patch set uploaded (by Dzahn):
delete contacts.wikimedia.org

https://gerrit.wikimedia.org/r/206415

Change 206413 merged by Dzahn:
varnish: delete contacts from misc-web config

https://gerrit.wikimedia.org/r/206413

Change 206421 had a related patch set uploaded (by Dzahn):
contacts: delete Apache template, adjust role

https://gerrit.wikimedia.org/r/206421

Change 206421 merged by Dzahn:
contacts: delete Apache template, adjust role

https://gerrit.wikimedia.org/r/206421

Change 206415 merged by Dzahn:
delete contacts.wikimedia.org

https://gerrit.wikimedia.org/r/206415

Change 207280 had a related patch set uploaded (by Dzahn):
contacts: remove role from node and delete it

https://gerrit.wikimedia.org/r/207280

Change 207280 merged by Dzahn:
contacts: remove role from node and delete it

https://gerrit.wikimedia.org/r/207280

Change 207281 had a related patch set uploaded (by Dzahn):
backup: remove fileset for contacts again

https://gerrit.wikimedia.org/r/207281

Change 207281 merged by Dzahn:
backup: remove fileset for contacts again

https://gerrit.wikimedia.org/r/207281

I confirmed files exists in backup (bconsole on helium) and then deleted them from zirconium.

the entire document root as well as the Apache config and SQL dump

@Springle

on db1001/dbprox1001: the databases "contacts_civicrm" and "contacts_drupal" can now be dropped entirely. we have dump files in backup and everything else has been removed.

jcrespo subscribed.

I have dropped the databases from the full m1 hierarchy of live data (db1001, db1016 and db2010).

DROP DATABASE contacts_civicrm;
DROP DATABASE contacts_drupal;

I also have dropped pdns and designate on the same hosts as per T92693.

Reassigning in case you want to check it or more steps are needed in order to complete the task, otherwise close.

@jcrespo thank you very much. should be all done then.