Page MenuHomePhabricator

Complete migration of all Bugzilla users and their data
Closed, DeclinedPublic

Description

old-bugzilla can't be removed until 100 % users have been actually created on Phabricator and have completed their migration (see https://www.mediawiki.org/wiki/Phabricator/Help#Creating_your_account ). Otherwise we have no way to know and contact previous subscribers and they have no way to recover lost subscriptions when they register in Phabricator.

Event Timeline

Nemo_bis raised the priority of this task from to Medium.
Nemo_bis updated the task description. (Show Details)
Nemo_bis removed a project: Tracking-Neverending.
Nemo_bis set Security to None.
Nemo_bis added subscribers: Krenair, Qgil, Aklapper and 3 others.
Aklapper raised the priority of this task from Medium to Needs Triage.Apr 7 2015, 9:40 AM

old-bugzilla can't be removed until 100 % users have been actually created on Phabricator

Realistically speaking, this will never happen and I strongly disagree with this statement.

Otherwise we have no way to know and contact previous subscribers

Please be explicit what you mean. That Bugzilla allows you to see email addresses to contact previous subscribers? Email data related to accounts could theoretically be dumped instead of migrated.

and they have no way to recover lost subscriptions when they register in Phabricator.

Technically I'm not sure if that really requires any Bugzilla API to be around, instead of taking that data from the database. The latter would not necessarily require old-bugzilla as a web interface to be available.

I think we discussed somewhere already that complete migration of Bugzilla users was not a goal. Many of those "users" consist in a single and deprecated email address that not even the former owner can access to. "we have no way to know and contact previous subscribers and they have no way to recover lost subscriptions" was a reality well before Phabricator was in the horizon.

Aklapper removed a project: acl*sre-team.
JohnLewis claimed this task.

Not an objective as per Quim and therefore not a blocker for the removal of bugzilla.

@Nemo_bis please provide a rationale for reopening it otherwise I'll re close it tomorroe.

As explained by Quim already here and in T896#939523, people not accessing (or not being able to access) their email accounts is not related to the migration from Bugzilla to Phabricator. That fact is just more visible since the migration.

We're not in a hurry to shut down bugzilla, so please let the discussion about requirements open so that more people can participate.

@Nemo_bis: Please do not reopen without providing arguments. See previous comments. Reopening tickets without providing any argumentation that picks up and discusses previously given counter-arguments isn't welcome and might look like edit-warring.
Currently there's no plans to work on the proposal in this task as given arguments have not convinced anybody else, so I would appreciate if Phabricator could be used for planning by having tasks reflect their actual current state (instead of keeping this task open without any given reasons and making getting an overview of the real work left way harder). Thank you.

Arguments were already given and not addressed, just dismissed.

@Nemo_bis: You did not reply to T95266#1185061, T95266#1185310, T95266#1218248 and I see no signs of "dismissing" here, just edit-warring...

Right, I'm closing this (yet again) for the same reason listed multiple times.

Please do not reopen this issue (as this is extremely annoying and pointless as Andre said above) unless an actual technical reason requires it *and* the follow questions are answered otherwise this will likely be seen as disruptive:

  • Why is a database dump not technically acceptable/viable for recovering old account data?
  • Why is an impossible to accomplish task (for technical and presumably legal reasons) a necessity for the deprecation and removal of an unused service?
  • Is all required information (comments, actions etc.) imported to Phabricator regardless of whether they are attributed correctly or not?

This seems more like a social issue as well that needs to be resolved purely on a social level with no technical work if the issue is requirements.

Kind of wondering if there are also some misconceptions involved:

Claiming accounts in Phab (and previous activity imported from BZ) is not related to BZ being available/online.
BZ is not accessed from Phabricator during the account claiming process. Claiming contributions from Bugzilla depends on a separate database, unrelated to whether Bugzilla itself is online or offline.

Kind of wondering if there are also some misconceptions involved:

Claiming accounts in Phab (and previous activity imported from BZ) is not related to BZ being available/online.
BZ is not accessed from Phabricator during the account claiming process. Claiming contributions from Bugzilla depends on a separate database, unrelated to whether Bugzilla itself is online or offline.

Thanks for explaining. This is good to know and it alleviates the concern I saw here. @Nemo_bis: is this explanation sufficient?

is this explanation sufficient?

No.

Claiming accounts in Phab (and previous activity imported from BZ) is not related to BZ being available/online.

It is, because if bugzilla is offline I can't contact users manually where phabricator fails to notify them.

It is, because if bugzilla is offline I can't contact users manually where phabricator fails to notify them.

So this seems like a more social issue than a technical one. Also the database dump will be available for a while before bugzilla is removed, won't that solve the issue as opposed to keeping bugzilla online for ever, letting it become exploitable and then all private data being leaked if a serious security issue is found in Bugzilla?

I don't know how simple and feasible this task would be but...

  1. Extract all email addresses from old-bugzilla.
  2. Extract all email addresses from Wikimedia Phabricator.
  3. Remove the email addresses in both lists in order to get those that have no related Phabricator account.
  4. Create a one-time mailing list in Mailman and mass-subscribe all the email addresses there.
  5. Send a one and only email to that list, notifying about old-bugzilla being archived for good, and these email addresses (visible until now) being removed for privacy reasons, inviting them to join Phabricator to claim their tasks, etc.

As said above, I expect a majority of these email addresses to be obsolete today. Among the technically valid email addresses, if someone doesn't see or doesn't care about this last call, they probably won't care about joining Wikimedia Phabricator right now.

I don't know how simple and feasible this task would be but...

  1. Extract all email addresses from old-bugzilla.

On the bugs DB: SELECT login_name FROM profiles WHERE disable_mail != 1 AND disabledtext = "";

  1. Extract all email addresses from Wikimedia Phabricator.

On the phabricator_user DB: SELECT address from user_email; (just for the records, there are also isPrimary and isVerified columns)

  1. Remove the email addresses which are in both lists in order to get those that have no related Phabricator account.

Pseudo-query as this is probably cross-server, but could always import results of above queries into a local DB:
SELECT login_name FROM bugs.profiles WHERE login_name NOT IN (SELECT address from phabricator_user.user_email)

  1. Create a one-time mailing list in Mailman and mass-subscribe all the email addresses there.

I'm missing Mailman skills to tell if I could a) mass-subscribe a given list of email addresses without b) triggering confirmation emails or such.

  1. Create a one-time mailing list in Mailman and mass-subscribe all the email addresses there.

I'm missing Mailman skills to tell if I could a) mass-subscribe a given list of email addresses without b) triggering confirmation emails or such.

You can to both however I feel a throw away list is not really useful and I would not create such a list myself.

I'm proposing the Mailman list just to avoid the ugly method of BCCing hundreds of email addresses in batch emails. Anything sending those emails in a way that won't be caught by spam folders (at least not by design) would be good.

Anything sending those emails in a way that won't be caught by spam folders (at least not by design) would be good.

A script sending custom/context-sensitive messages one at a time, from a wikimedia.org email address, would be an alternative; we (well, Manuel) did such things in the past e.g. for events mailings.

It could pick the latest report filed (or touched) by the user and mention it as reason to login/register on phabricator. The Reply-To would ideally point to an appropriate OTRS queue.

Of course invites/notifications are just a first step, but one must start somewhere.

Aklapper claimed this task.
Aklapper added a subscriber: Nemo_bis.

This is good to know and it alleviates the concern I saw here. @Nemo_bis: is this explanation sufficient?

No reply; February 2016; no replies to T95266#1185061, T95266#1185310 etc. Hence declining this task.