Page MenuHomePhabricator
Feed Advanced Search

Jun 27 2017

Albertinisg added a comment to T168217: Find out (and fix) why we have a higher number of identity entries than before switching to new Bitergia DB scheme.

https://wikimedia.biterg.io:443/goto/3423b26f9958ae594cbfcc88d7778ba8 lists currently 79 established devs as "Last Attracted Developers" in June 2017 who have been active for way way longer in our community. I assume that is another artifact of this problem.

Jun 27 2017, 5:07 PM · Developer-Advocacy (Jul-Sep 2017), wikimedia.biterg.io

Jun 26 2017

Albertinisg added a comment to T168217: Find out (and fix) why we have a higher number of identity entries than before switching to new Bitergia DB scheme.

! In T168217#3377790, @Aklapper wrote:
Do you plan to fix this? If not I could also save you time by using the SQL query results to mass-merge them in the JSON dump file.

Jun 26 2017, 3:18 PM · Developer-Advocacy (Jul-Sep 2017), wikimedia.biterg.io
Albertinisg added a comment to T151161: Have "Last Attracted Developers" information for Gerrit automatically updated / Integrate new demography panels in GrimoireLab product.

@Aklapper we've updated

Jun 26 2017, 10:54 AM · Developer-Advocacy (Oct-Dec 2018), wikimedia.biterg.io

Jun 21 2017

Qgil awarded T151634: When indexing new users, identify identical email addresses and merge identities accordingly in the DB a Like token.
Jun 21 2017, 7:57 AM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io
Aklapper awarded T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance a Love token.
Jun 21 2017, 12:24 AM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

Jun 20 2017

Albertinisg added a comment to T151634: When indexing new users, identify identical email addresses and merge identities accordingly in the DB.

The issue should be solved after the migration. As the uuids has changed, I cannot reproduce it. Let me know if you still can reproduce the issue and I'll work on it. If not, feel free to close it :)

Jun 20 2017, 3:47 PM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io
Albertinisg added a comment to T168217: Find out (and fix) why we have a higher number of identity entries than before switching to new Bitergia DB scheme.
  • The DB dump on Jun 16, 2017 includes 1502 duplicated uuids with source=phabricator - see the results of SELECT username, source, COUNT(*) FROM identities WHERE source = "phabricator" GROUP BY username, source HAVING COUNT(*) > 1;. Most of them (but not all, e.g. 790c99c07cd1529297e537505d157bc76c2938e7 and 49c861497d82e38502bcd00be6e7818c72f39427 is a name change due to marriage) have the very same username but one has an empty name while the other has not.

@Albertinisg: I can batch-merge these uuids but sounds like a potential bug you may want to investigate if interested. (Not a high priority for us though.)

Jun 20 2017, 3:36 PM · Developer-Advocacy (Jul-Sep 2017), wikimedia.biterg.io
Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

The dump is being uploaded everyday at midnight. Working in parallel in T168217: Find out (and fix) why we have a higher number of identity entries than before switching to new Bitergia DB scheme. I'll keep this open until the feature to automatically update the indexes and show the changes in the dashboard is ready.

Jun 20 2017, 9:49 AM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

Jun 16 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

@Aklapper Github db dump file updated to the latest version by https://github.com/Bitergia/mediawiki-identities/commit/6596aca9e13c1c9e366418eb51af0ca06b7595c5

Jun 16 2017, 11:43 AM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

Jun 8 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

All right so, I've generated new indexes with the latest changes and the identities file I'm about to push in Github, and overall it looks good (just IRC is still on its way). Now the file contains around 50k less duplicated identities :)

Jun 8 2017, 10:02 AM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

Jun 6 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

I'm not sure I fully understand. :) Is "the database" the (soon to be updated) JSON dump file in GitHub? Does "up to date" means there will be regular updated DB dumps into that JSON file on GitHub, but if I pushed changes via sortinghat into that JSON dump file, they will not automatically be reflected in production on wikimedia.biterg.io? If so, I'd say that's what this very task is already about.

Jun 6 2017, 9:52 AM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

Jun 2 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

I also want to inform you that, even though the database will be up to date, the identities in the dashboard will not be updated automatically. This is a work in progress, and if you want, we can keep you updated of that in other ticket or here.

Jun 2 2017, 2:40 PM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io
Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

I will explain you the procedure I will follow for this. The file you were editing comes from the legacy dashboard, so now we are using different sources. Here is the matching:

wikimedia:irc --> supybot
wikimedia:its --> bugzilla
wikimedia:its_1 --> phabricator
wikimedia:mediawiki --> mediawiki
wikimedia:mls --> pipermail
wikimedia:scm --> git
wikimedia:scr --> gerrit

And the procedure will be:

Jun 2 2017, 2:36 PM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

Jun 1 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

Great!! I'll wait for that and keep you updated of the process

Jun 1 2017, 3:31 PM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

May 31 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

This might not be related at all, but...
last update in the file https://github.com/Bitergia/mediawiki-identities/wikimedia-affiliations.json was on April 7th.
Taking that file and importing it into a fresh DB in MariaDB on Fedora 25 via sortinghat load wikimedia-affiliations.json, all uuid's get changed, a la

+ 00000ba7f563234e5f239e912f2df1521695122e (old fa0f23d092d9f963b13b7393633ffc905daabd60) loaded

So now I manually need to find all id's I wanted to update, and first manually update the sortinghat commands I was about to run to update the DB.
Meh. I hope that does not happen always now. And I wonder what's the reason. And if I should just go ahead and push my changes into the GitHub file (once I've updated the uuid's in the list of sortinghat commands to change entries in the DB).

May 31 2017, 1:30 PM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io

May 18 2017

Qgil awarded T157709: On the "Git" dashboard, filtering on one organization still lists authors who are with another organization a Like token.
May 18 2017, 12:52 PM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io

May 9 2017

Albertinisg added a comment to T157709: On the "Git" dashboard, filtering on one organization still lists authors who are with another organization.

User is now merged and index up to date: https://wikimedia.biterg.io/goto/e402bc401b1c41a37031d903bd0c424a

May 9 2017, 8:39 PM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io
Albertinisg added a comment to T157709: On the "Git" dashboard, filtering on one organization still lists authors who are with another organization.

Hey @Aklapper, I've been digging into this and I found what's going on with this user. There are some e-mail address our tool don't merge automatically. In this case, the matching wasn't done due to the e-mail format. The tool avoids some kind of addresses like the ones who end in localhost or like this one.

May 9 2017, 5:09 PM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io

May 8 2017

Qgil awarded T161308: Only display organizations defined in Wikimedia's DB (disable assuming orgs via hostnames in email addresses) a Like token.
May 8 2017, 1:09 PM · Developer-Advocacy (Apr-Jun 2017), Regression, wikimedia.biterg.io
Qgil awarded T161241: Author names that include commata or "and" are split into separate identities in the frontend a Like token.
May 8 2017, 1:08 PM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io

May 6 2017

Albertinisg added a comment to T161207: Numerous Gerrit (draft) patchsets cannot be accessed: "Cannot display change because it has no revisions.".

The Gerrit drafts seems to be working all fine now. In T157898#3124564 @Albertinisg mentioned wikimedia.biterg.io had trouble fetching them. Do they work now?

May 6 2017, 10:38 AM · wikimedia.biterg.io, Gerrit
Albertinisg added a comment to T157709: On the "Git" dashboard, filtering on one organization still lists authors who are with another organization.

That's true, I see this identity is not properly merged in the db:

unique identity 1571e940a2fba27a0633b78ea182c3271b0026b7
May 6 2017, 10:18 AM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io

May 4 2017

Albertinisg claimed T161241: Author names that include commata or "and" are split into separate identities in the frontend.

Issue fixed, see https://wikimedia.biterg.io:443/goto/42815da25b8d3bf1eb2dbb9081fe3139

May 4 2017, 4:48 PM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io
Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

@Aklapper the issue itself should be fixed now. However, as we are still not updating the database automatically, I think we can keep the issue open, or close it and continue in T161235: https://wikimedia.biterg.io shows 2017 contributors who are not listed in mediawiki-identities/wikimedia-affiliations.json, as we are expecting there the same behavior. What do you think?

May 4 2017, 3:47 PM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io
Albertinisg added a comment to T157709: On the "Git" dashboard, filtering on one organization still lists authors who are with another organization.

@Aklapper , after the changes made in the DB the issue is gone, and those users are not listed as Independent anymore. Note that the user ^demon is now Chad Horohoe (as we also modified the preferences for the profile name). Please, close it if you consider it fixed!

May 4 2017, 3:43 PM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io
Albertinisg added a comment to T161308: Only display organizations defined in Wikimedia's DB (disable assuming orgs via hostnames in email addresses).

Sorry for the long delay into this. The list of organizations is now updated and the list displayed is the one from the Wikimedia DB file (or the list you wrote here).

May 4 2017, 3:30 PM · Developer-Advocacy (Apr-Jun 2017), Regression, wikimedia.biterg.io

Apr 12 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

I merged https://github.com/Bitergia/mediawiki-identities/commit/50ab30725ea9d6eb03487bb9eb1849965a4d8d1c on 2017-02-09 for T157569. That change added numerous additional organizations, plus enrolled nearly 500 accounts into those orgs.

We've re-generated the database and migrate to our latest software version, so the changes should be all applied now.

@Albertinisg: Hmm, I'm afraid not...? See user with the ID 3dfcaa955728028d150de81cf3e10a003b39bef2 and their organization in wikimedia-affiliations.json.
Now search for that user only: https://wikimedia.biterg.io:443/goto/eb5fd6a8cac70ce8bca3526d7c030365 will incorrectly display "Organization: Independent".
Now search for that org only: https://wikimedia.biterg.io:443/goto/d602418725c536c5ab50e1b6aedc89e7 will display no results.

Or going to https://wikimedia.biterg.io:443/goto/063b6ccbfaa28126733d154f572712c3 (filter: Org=Independent) and looking at the list of "Submitters" I see Hashar in that list, but uuid 024c5043e1c9d13f31c4b1d69d3be47c86c03d0b in wikimedia-affiliations.json says "organization": "Wikimedia Foundation". Same for Ejegg (07c18c8e0323f2b846510b0c63aa5184ad1af1a8), or jforrester (0848fcd3d184007080330da369b363292812c126).

Ok I see the issue here. This should be fixed when we remove the organizations we loaded by mistake and fix the affiliations.

Apr 12 2017, 12:56 PM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io
Albertinisg added a comment to T161308: Only display organizations defined in Wikimedia's DB (disable assuming orgs via hostnames in email addresses).

@Albertinisg: Thanks for looking into this. Would it be possible to change the conf to strictly stick to only those 17 organizations that are in Wikimedia's DB?

Apr 12 2017, 12:53 PM · Developer-Advocacy (Apr-Jun 2017), Regression, wikimedia.biterg.io

Apr 11 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

I merged https://github.com/Bitergia/mediawiki-identities/commit/50ab30725ea9d6eb03487bb9eb1849965a4d8d1c on 2017-02-09 for T157569. That change added numerous additional organizations, plus enrolled nearly 500 accounts into those orgs.

Apr 11 2017, 12:25 AM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io
Albertinisg added a comment to T159229: "Email senders" widget empty though "Mailing Lists" widget states that there are email senders.

We updated the profiles of every identity based on the data source. The issue we had here was an empty field, so the name of the user couldn't be displayed. It should be fixed now!

Apr 11 2017, 12:06 AM · Developer-Advocacy (Apr-Jun 2017), wikimedia.biterg.io
Albertinisg added a comment to T161308: Only display organizations defined in Wikimedia's DB (disable assuming orgs via hostnames in email addresses).

After reading the comments I've removed several organizations based in the previous tickets. You were right, we did load a standard organizations file we have, and those organizations were on that file.

Apr 11 2017, 12:02 AM · Developer-Advocacy (Apr-Jun 2017), Regression, wikimedia.biterg.io

Mar 29 2017

Albertinisg added a comment to T161682: Maniphest statistics show implausible numbers of submitted reports.

This is a clear bug. I've been digging into it and I've found we have an issue with the [[mw:User:This, that and the other] identity.

Mar 29 2017, 11:46 AM · wikimedia.biterg.io

Mar 28 2017

Albertinisg added a comment to T161519: Maniphest: Parser does not split projects by comma separator?.

I will check it out!

Mar 28 2017, 12:51 PM · wikimedia.biterg.io

Mar 27 2017

Albertinisg added a comment to T161519: Maniphest: Parser does not split projects by comma separator?.

Thanks for the report. You were right, we were using a wrong field. We've modified so now projects are well displayed:

Mar 27 2017, 10:24 PM · wikimedia.biterg.io
Albertinisg added a comment to T138002: Deployment of Maniphest panel.

@Aklapper we've updated the dashboard today adding finally the information of Maniphest. You can check it in:

Mar 27 2017, 1:35 PM · Developer-Advocacy (Jan-Mar-2017), wikimedia.biterg.io

Mar 23 2017

Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.
  • there are also some orgs that we don't have in our DB, such as "Debian GNU/Linux". Looks like some configuration change which is a regression of T100189#1580919 ? Do you want to track reverting that in another task?
  • "Last Attracted Developers" on https://wikimedia.biterg.io/app/kibana#/dashboard/Git-Demographics also looks funny - it says I started contributing today and has some authors listed without any "first commit date". Again, do you want to track that in another task?

Whatever is better for you. I will report it also internally so we can start tracking how to solve it :)

Mar 23 2017, 1:34 PM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io
Albertinisg added a comment to T157898: Provide Hatstall to fix syncing / updating of identities on the wikimedia.biterg.io production instance.

Hi @Aklapper , I'm Alberto from the Bitergia team. I just want to make you a short summary of the status of the dashboard right now, because we are struggling at retrieving some data sources :-(

Mar 23 2017, 11:09 AM · Developer-Advocacy (Apr-Jun-2018), wikimedia.biterg.io