Page MenuHomePhabricator

Move wmfdata to a more standard location
Closed, ResolvedPublic

Description

Now that wmfdata is pretty broadly used project, it should be transferred from my personal GitHub account to a more standard location.

Originally, this was going to be Gerrit, but in June 2020, the Release Engineering announced a migration to GitLab. It will be more than a year until the migration is completed, but still, it no longer seems worth moving to Gerrit.

The main options now are:

  1. Leave it in my personal repo until we can transfer it to GitLab
  2. Transfer it to the Wikimedia Research organization on GitHub, which will be much easier than moving to GitLab or Gerrit but will still require users to migrate to a new URL.

Event Timeline

nshahquinn-wmf created this task.
nshahquinn-wmf moved this task from Triage to Current Quarter on the Product-Analytics board.
nshahquinn-wmf renamed this task from Move wmfdata to a standard Gerrit repository to Move wmfdata to a more standard location.Jun 30 2020, 11:49 AM
nshahquinn-wmf updated the task description. (Show Details)
nshahquinn-wmf updated the task description. (Show Details)

Neil, let's move this to GitHub asap. I can help. :)

Also, how do you feel about publishing releases to PyPI?

I'd like to include wmfdata in the default anaconda conda env I am working on in T251006: Create anaconda .deb package with stacked conda user envs, and installing either from PyPI, or at least from github/wikimedia feels better then adding a dependency on your github account. :)

Neil, let's move this to GitHub asap. I can help. :)

Also, how do you feel about publishing releases to PyPI?

It would certainly make handling updates easier, but it feels like it would be polluting a public resource with something that literally only functions inside our production cluster.

I'd like to include wmfdata in the default anaconda conda env I am working on in T251006: Create anaconda .deb package with stacked conda user envs, and installing either from PyPI, or at least from github/wikimedia feels better then adding a dependency on your github account. :)

Well, it does feel like this should be in a more standard place. But unless we move to a distribution mechanism like PyPI that isn't tied to the repo location, there's a pretty substantial cost every time we switch repo locations. Since we will want to move it to GitLab within the next year or so, it feels like unnecessary disruption to do another move right now.

Of course, I do want to change my GitHub username to nshahquinn, and I can't do that while people are depending on the URL of my repo.

I discussed this with @Ottomata, and it looks like I have all the permissions needed to move things to a GitHub repo in the wikimedia organization. That will make things more official, and the impact should be limited because GitHub should make everything redirect smoothly. I should notify all our users beforehand anyway.

The repo has been moved to wikimedia/wmfdata-python on GitHub! Users should not notice any difference, since all the URLs redirect to the new location, meaning the old pip commands and the update check still work.

I'm leaving this open until I update the code and the documentation to specify the new code location.

I've done those code and doc updates and released them as version 1.0.4.