Jul 7 2017
This is fixed in the current version in production. The fixed is based on the title of the widget where the keyword 'days' is specified.
Mar 20 2017
@Aklapper we have to work in two ways with this analysis:
- Improve the performance of the analysis (it's quite slow nowadays...)
- Add other data sources as Gerrit. You may discuss this with @Lcanasdiaz and give some priority if this is important to your needs.
Dec 21 2016
@Aklapper , @Lcanasdiaz we were indeed missing changesets. The point is that tables in Kibana are ordered by a given metric and in this case this was the column "changeset". However this has to be ordered by the open date or the days open.
Nov 24 2016
Nov 23 2016
In that widget we're counting days.
Sep 16 2016
I see the issue, in the new platform we're losing some packages when uploading the data. Issues in our infrastructure that we already had and known bug.
Indeed, according to korma, the number of changesets make sense after that huge increase. Those are at the level of 1 or 2K.
Jun 12 2016
@Qgil , during the last meeting we already had some introductory time with Andre related to the new functionalities of the dashboard.
Hi there, sorry for the delay.
Feb 26 2016
After the meeting we all agreed that this seemed to be a good approach. So, we're adding this into the project to daily update the dataset.
Feb 25 2016
Just to mention that this contains the top 10 oldest changesets per organization for all of them. We can use another limit if you prefer to have a bigger list.
Work in progress. I've finally added the feature to the code at https://github.com/VizGrimoire/GrimoireLib/commit/9568489b5196fd6da4ae96d5b7d2f61a64960bed
@Aklapper, I just sent to you an email with such info. As this contains some email addresses, I preferred to to this by direct message.
Jan 25 2016
Jan 22 2016
Kudos to @Lcanasdiaz !
Jan 19 2016
As we can see in http://korma.wmflabs.org/browser/data/json/gerrit.wikimedia.org_mediawiki_extensions_ThrottleOverride-scr-rep-evolutionary.json, there are not more 'nan' values in these specific metrics.
Dec 22 2015
After having a look at the data, it's clear that nowadays that info was updated, but we were able to reproduce the error.
Dec 1 2015
I'm having a look at the data. If there's an id with loads of merges, this is usually an id to be added to the sortinghat blackiist.
Do you want to keep the activity of those old mailing lists?
So far, the process has been focused on automating the list of Git repositories to be analyzed and later to remove the upstream ones.
You also need to remove a specific line in a cofig file. More info in the pull request.
Ok, Korma data show that there are 1166 git repositories in the list of repos at http://korma.wmflabs.org/browser/scm-repos.html and same number in the total number of git repositories at http://korma.wmflabs.org/browser/scm.html.
Nov 16 2015
This weird issue is related to the fact that not all of the developers are listed, but the most important ones in terms of activity per data source.
This seems to be an error in unicode as you suggest.
I guess @Lcanasdiaz can provide a better answer than me :).
Re-assigning this to @Lcanasdiaz. This is a bug in the product.
Reassigning this to @Lcanasdiaz. This is a clear product issue.
Similar issue as T116484: Explain / sort out / fix SCR repository number mismatch on korma. Re-assigning this to @Lcanasdiaz.
This seems to be an error when counting activity in empty repositories. There may exist Gerrit repositories with no activity even when they are tracked by the Gerrit server.
Reassigning this to @Lcanasdiaz as he'll work on this task.
As far as I remember, you modified that HTML source code and moved the graphs section to the scr.html page.
Nov 12 2015
@Aklapper, my only concern is about the git repositories that are not part of Gerrit but still are required in the list of repositories for historical reasons. In gerrit, the list of repositories is updated according to info provided by the gerrit server. If git repositories do not follow this convention, then how can we add and remove new/old repos?
Data were updated now. The issue with Git is that this is still not automated. I remember some discussion about having all of the repos of gerrit + some repos not found in gerrit. I'm afraid that until this is not clear we can not proceed with the automation of Git repositories.
Oct 20 2015
Ok, channels are updated.
@Qgil, is there any difference in the list of "Oldest open Gerrit changesets without code review" in http://korma.wmflabs.org/browser/scr-backlog.html if compared to what you need except that affiliation is not included.
This depends on your needs. I mean, as we're not automatically retrieving IRC channels information, we can keep as many channels as you want.
Oct 19 2015
@Aklapper, what I've done so far is to manually add them to the infrastructure (this is indeed a script deleting, removing, adding URLs, tar.gz, etc) and I wanted to add that list of TRACKED channels once the process if finished and correct (still running).
Based on info provided by @Aklapper, I've added all of them, but mediawiki that was already in the list.
And regarding to the rest of IRC channels. Do we have logs for all of them?
Data are updated and smoothly running.
I've commented on the GitHub repo.
I confirm this issue.
As mentioned by @Qgil, there's an error with the WIP's. Those were not filtered.
The three charts are now found in each of the repositories.
@Aklapper, how can we automatically retrieve the list of Git repositories available from some place in the mediawiki infrastructure?
Oct 6 2015
Ok, for this, there's a bitbucket account with that info daily updated. That would be the JSON file to import and play with that. So far Quim has access to this, do you need that?
Ok, let's go for this solution :). I'll keep you updated!
Oct 1 2015
Sep 29 2015
As similarly done for gerrit, I've added the current list of Git repositories analyzed so far in Korma .
Sep 28 2015
Sep 24 2015
@Aklapper, I can update numbers tomorrow if needed. Please, let me know!
Some method notes, just in case you liked to reproduce the analysis:
Numbers for today. Data were updated up to 2:00 am CEST.
Sep 22 2015
Ok, this has been updated from "companies" to "organizations". Closing this task. Kudos to quan @ bitergia :).
Hi again, some improved numbers after some minor filtering process:
Some numbers to have some context.
Sep 18 2015
Sep 17 2015
Ok, I'll update the task description to add the 'waiting for review' requirement. It is now clear to me how to proceed. Thanks!
@Qgil, if we want to measure 'Median age of open changesets authored by volunteers in the last three months', it may make sense to measure all of the changesets that are not merged nor abandoned.
Sep 16 2015
Sure @Aklapper, I'll start working on the queries. However, I'd like to be sure we're still using the same filters for the data.