This is fixed in the current version in production. The fixed is based on the title of the widget where the keyword 'days' is specified.

@Aklapper we have to work in two ways with this analysis:

1. Improve the performance of the analysis (it's quite slow nowadays...)
2. Add other data sources as Gerrit. You may discuss this with @Lcanasdiaz and give some priority if this is important to your needs.

@Aklapper , @Lcanasdiaz we were indeed missing changesets. The point is that tables in Kibana are ordered by a given metric and in this case this was the column "changeset". However this has to be ordered by the open date or the days open.

In that widget we're counting days.

I see the issue, in the new platform we're losing some packages when uploading the data. Issues in our infrastructure that we already had and known bug.

Indeed, according to korma, the number of changesets make sense after that huge increase. Those are at the level of 1 or 2K.

@Qgil , during the last meeting we already had some introductory time with Andre related to the new functionalities of the dashboard.

Hi there, sorry for the delay.

After the meeting we all agreed that this seemed to be a good approach. So, we're adding this into the project to daily update the dataset.

Just to mention that this contains the top 10 oldest changesets per organization for all of them. We can use another limit if you prefer to have a bigger list.

Work in progress. I've finally added the feature to the code at https://github.com/VizGrimoire/GrimoireLib/commit/9568489b5196fd6da4ae96d5b7d2f61a64960bed

@Aklapper, I just sent to you an email with such info. As this contains some email addresses, I preferred to to this by direct message.

Thanks for the issue @jayvdb !. I'm reassigning this to @Lcanasdiaz as he'll be in charge of it finally.

Kudos to @Lcanasdiaz !

As we can see in http://korma.wmflabs.org/browser/data/json/gerrit.wikimedia.org_mediawiki_extensions_ThrottleOverride-scr-rep-evolutionary.json, there are not more 'nan' values in these specific metrics.

After having a look at the data, it's clear that nowadays that info was updated, but we were able to reproduce the error.

I'm having a look at the data. If there's an id with loads of merges, this is usually an id to be added to the sortinghat blackiist.

Do you want to keep the activity of those old mailing lists?

So far, the process has been focused on automating the list of Git repositories to be analyzed and later to remove the upstream ones.

You also need to remove a specific line in a cofig file. More info in the pull request.

Ok, Korma data show that there are 1166 git repositories in the list of repos at http://korma.wmflabs.org/browser/scm-repos.html and same number in the total number of git repositories at http://korma.wmflabs.org/browser/scm.html.

This weird issue is related to the fact that not all of the developers are listed, but the most important ones in terms of activity per data source.

This seems to be an error in unicode as you suggest.

I guess @Lcanasdiaz can provide a better answer than me :).

Re-assigning this to @Lcanasdiaz. This is a bug in the product.

Reassigning this to @Lcanasdiaz. This is a clear product issue.

Similar issue as T116484: Explain / sort out / fix SCR repository number mismatch on korma. Re-assigning this to @Lcanasdiaz.

This seems to be an error when counting activity in empty repositories. There may exist Gerrit repositories with no activity even when they are tracked by the Gerrit server.

Reassigning this to @Lcanasdiaz as he'll work on this task.

As far as I remember, you modified that HTML source code and moved the graphs section to the scr.html page.

@Aklapper, my only concern is about the git repositories that are not part of Gerrit but still are required in the list of repositories for historical reasons. In gerrit, the list of repositories is updated according to info provided by the gerrit server. If git repositories do not follow this convention, then how can we add and remove new/old repos?

Data were updated now. The issue with Git is that this is still not automated. I remember some discussion about having all of the repos of gerrit + some repos not found in gerrit. I'm afraid that until this is not clear we can not proceed with the automation of Git repositories.

Ok, channels are updated.

@Qgil, is there any difference in the list of "Oldest open Gerrit changesets without code review" in http://korma.wmflabs.org/browser/scr-backlog.html if compared to what you need except that affiliation is not included.

This depends on your needs. I mean, as we're not automatically retrieving IRC channels information, we can keep as many channels as you want.

@Qgil, instead of having there the backlog list, what do you think about adding a new entry to the Gerrit Backlog panel at http://korma.wmflabs.org/browser/scr-backlog.html?

@Aklapper, what I've done so far is to manually add them to the infrastructure (this is indeed a script deleting, removing, adding URLs, tar.gz, etc) and I wanted to add that list of TRACKED channels once the process if finished and correct (still running).

Based on info provided by @Aklapper, I've added all of them, but mediawiki that was already in the list.

And regarding to the rest of IRC channels. Do we have logs for all of them?

Data are updated and smoothly running.

I've commented on the GitHub repo.

I confirm this issue.

As mentioned by @Qgil, there's an error with the WIP's. Those were not filtered.

The three charts are now found in each of the repositories.

@Aklapper, how can we automatically retrieve the list of Git repositories available from some place in the mediawiki infrastructure?

According to comments by @jgbarah and @Acs, this ticket is not a bug. Closing this.

Ok, for this, there's a bitbucket account with that info daily updated. That would be the JSON file to import and play with that. So far Quim has access to this, do you need that?

Ok, let's go for this solution :). I'll keep you updated!

@Aklapper, @Qgil, the issue here is how to have access to the information.

@Aklapper, according to the process previously defined, this is a task that can be easily done by you or @Qgil.

As similarly done for gerrit, I've added the current list of Git repositories analyzed so far in Korma [1].

Hi there,

@Aklapper, I can update numbers tomorrow if needed. Please, let me know!

Some method notes, just in case you liked to reproduce the analysis:

Numbers for today. Data were updated up to 2:00 am CEST.

Ok, this has been updated from "companies" to "organizations". Closing this task. Kudos to quan @ bitergia :).

Hi again, some improved numbers after some minor filtering process:

Some numbers to have some context.

Hi again,

Ok, I'll update the task description to add the 'waiting for review' requirement. It is now clear to me how to proceed. Thanks!

@Qgil, if we want to measure 'Median age of open changesets authored by volunteers in the last three months', it may make sense to measure all of the changesets that are not merged nor abandoned.

Sure @Aklapper, I'll start working on the queries. However, I'd like to be sure we're still using the same filters for the data.