Page MenuHomePhabricator

Wikiscan (Wikiscan)
Wikiscan

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Jul 8 2019, 11:32 AM (263 w, 4 d)
Availability
Available
LDAP User
Wikiscan
MediaWiki User
Unknown

Recent Activity

Jun 18 2020

Wikiscan updated the task description for T227462: Request increased quota for 'wikiscan' Toolforge user for database access.
Jun 18 2020, 7:56 AM · Data-Services (Quota-requests)

Jun 15 2020

Wikiscan updated the task description for T227462: Request increased quota for 'wikiscan' Toolforge user for database access.
Jun 15 2020, 2:00 PM · Data-Services (Quota-requests)

Jun 12 2020

Wikiscan reopened T227462: Request increased quota for 'wikiscan' Toolforge user for database access as "Open".
Jun 12 2020, 1:07 PM · Data-Services (Quota-requests)
Wikiscan added a comment to T227462: Request increased quota for 'wikiscan' Toolforge user for database access.

Hi, I have made several optimizations to remove long queries on replicas, updates are much more smoother now.

Jun 12 2020, 1:06 PM · Data-Services (Quota-requests)

Jul 30 2019

Wikiscan added a comment to T227462: Request increased quota for 'wikiscan' Toolforge user for database access.

Long queries happened only in the recent months, probably related to https://phabricator.wikimedia.org/T226050 and the revision table changes.
I have disabled comment join for several wikis which where slower : enwiki, commonswiki, wikidatawiki, viwiki, itwiki, cywiki, arwiki, ruwiki, eswiki, ukwiki, plwiktionary. This mean no more revert detection for users on those wikis.

Jul 30 2019, 9:15 AM · Data-Services (Quota-requests)

Jul 29 2019

Wikiscan added a comment to T227462: Request increased quota for 'wikiscan' Toolforge user for database access.

Wikiscan needs to refresh recent stats every 30 minutes (ideally) for each wiki. It also need to refresh old stats periodically, a process which can take several days per wikis, and also other data like user groups.
All of this for 380 wikis and probably 800 wikis in the coming month. Also any visitor looking at contributions/blocks for ip ranges needs a connection.

Jul 29 2019, 5:49 PM · Data-Services (Quota-requests)
Wikiscan added a comment to T227462: Request increased quota for 'wikiscan' Toolforge user for database access.

Wikiscan use several workers to update all wikis https://wikiscan.org/?menu=allsites&submenu=workers, actual needs are between 5-12 connections. I plan to extend wikis from 380 wikis to more than 800 (https://meta.wikimedia.org/wiki/Grants:Project/Rapid/Akeron/Wikiscan), so I think 15 connections could be required at peaks (some of them are only needed few seconds).
There is also a secondary usage to display contributions and block logs for ip ranges like https://fr.wikiscan.org/plage-ip/90.0.0.0/16?submenu=edits, it depends on visiting users and web crawlers.

Jul 29 2019, 7:46 AM · Data-Services (Quota-requests)

Jul 8 2019

Wikiscan updated the task description for T227462: Request increased quota for 'wikiscan' Toolforge user for database access.
Jul 8 2019, 12:53 PM · Data-Services (Quota-requests)
Wikiscan added a project to T227462: Request increased quota for 'wikiscan' Toolforge user for database access: Data-Services.
Jul 8 2019, 12:19 PM · Data-Services (Quota-requests)
Wikiscan added a comment to T227462: Request increased quota for 'wikiscan' Toolforge user for database access.

Hi, yes it is used to access Wikimedia SQL replicas.

Jul 8 2019, 12:12 PM · Data-Services (Quota-requests)
Wikiscan updated Wikiscan.
Jul 8 2019, 11:50 AM
Wikiscan created T227462: Request increased quota for 'wikiscan' Toolforge user for database access.
Jul 8 2019, 11:49 AM · Data-Services (Quota-requests)