Page MenuHomePhabricator
Create Task
Maniphest T210481

site_stats tables unavailable on Cloud replicas
Closed, ResolvedPublic
Actions

Description

The Pagecounts Tool is used to populate the article numbers on www.wikipedia.org. Recently, this tool started showing 0 as the page-count for all wikis :(

https://tools.wmflabs.org/pagecounts/pagecounts.json

The tool makes a simple DB query on the Toolforge database, something like:

SELECT ss_total_pages, ss_good_articles FROM site_stats LIMIT 1

When trying to manually make this call with the Pagecount credentials, or even accessing the site_stats table, the following error occurs:

MariaDB [enwiki_p]> describe site_stats;
ERROR 1356 (HY000): View 'enwiki_p.site_stats' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them

The Pagecounts code is hosted on GitHub here https://github.com/MaxSem/pagecounts/blob/master/pagecounts.php#L35

Other report: https://www.mediawiki.org/wiki/Topic:Up0qpe0wey94ca5n

Related Objects
Search...

Event Timeline

Jdrewniak created this task.Nov 27 2018, 9:06 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 27 2018, 9:06 AM
Jdrewniak added a parent task: T210401: www.wikipedia.org says 0+ articles for all languages.Nov 27 2018, 9:07 AM
MaxSem added a project: DBA.Nov 27 2018, 9:35 AM

Something's wrong with some labs replicas:

MariaDB [enwiki_p]> select * from site_stats \G
ERROR 1356 (HY000): View 'enwiki_p.site_stats' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them

MariaDB [adywiki_p]> select * from site_stats \G
*************************** 1. row ***************************
       ss_row_id: 1
  ss_total_edits: 7793
 [ . . . ]
Marostegui assigned this task to • Bstorm.EditedNov 27 2018, 9:37 AM
Marostegui triaged this task as High priority.
Marostegui moved this task from Triage to In progress on the DBA board.
Marostegui added a project: cloud-services-team.
Marostegui added subscribers: • Bstorm, Marostegui.
In T210481#4776984, @MaxSem wrote:

Something's wrong with some labs replicas:

MariaDB [enwiki_p]> select * from site_stats \G
ERROR 1356 (HY000): View 'enwiki_p.site_stats' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them

MariaDB [adywiki_p]> select * from site_stats \G
*************************** 1. row ***************************
       ss_row_id: 1
  ss_total_edits: 7793
 [ . . . ]

That is because: T86339
@Bstorm can you recreate all the views for site_stats table across all the wikis?

• Bstorm edited projects, added cloud-services-team (Kanban); removed cloud-services-team.Nov 27 2018, 3:33 PM
• Bstorm moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.
Framawiki renamed this task from Pagecounts.json Tool reports zero pages for all wikis to site_stats tables available on Cloud replicas.Nov 27 2018, 6:06 PM
Framawiki renamed this task from site_stats tables available on Cloud replicas to site_stats tables unavailable on Cloud replicas.
Framawiki edited projects, added Data-Services; removed Toolforge.
Framawiki updated the task description. (Show Details)
Framawiki subscribed.
• Bstorm added a comment.Nov 27 2018, 6:10 PM

Rebuilt the views on all replicas. Please check that this is working now.

Marostegui closed this task as Resolved.Nov 27 2018, 6:36 PM

Works for me and the two reported queries now work - thanks @Bstorm!:

root@cumin1001:~# for i in labsdb1009 labsdb1010 labsdb1011; do echo $i; mysql.py -h $i enwiki_p -e "SELECT ss_total_pages, ss_good_articles FROM site_stats LIMIT 1";done
labsdb1009
+----------------+------------------+
| ss_total_pages | ss_good_articles |
+----------------+------------------+
|       46446353 |          5758648 |
+----------------+------------------+
labsdb1010
+----------------+------------------+
| ss_total_pages | ss_good_articles |
+----------------+------------------+
|       46446362 |          5758650 |
+----------------+------------------+
labsdb1011
+----------------+------------------+
| ss_total_pages | ss_good_articles |
+----------------+------------------+
|       46446362 |          5758650 |
+----------------+------------------+

And:

root@cumin1001:~# for i in labsdb1009 labsdb1010 labsdb1011; do echo $i; mysql.py -h $i enwiki_p -e "describe site_stats;";done
labsdb1009
+------------------+---------------------+------+-----+---------+-------+
| Field            | Type                | Null | Key | Default | Extra |
+------------------+---------------------+------+-----+---------+-------+
| ss_row_id        | int(8) unsigned     | NO   |     | 0       |       |
| ss_total_edits   | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_good_articles | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_total_pages   | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_users         | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_images        | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_active_users  | bigint(20) unsigned | YES  |     | NULL    |       |
+------------------+---------------------+------+-----+---------+-------+
labsdb1010
+------------------+---------------------+------+-----+---------+-------+
| Field            | Type                | Null | Key | Default | Extra |
+------------------+---------------------+------+-----+---------+-------+
| ss_row_id        | int(8) unsigned     | NO   |     | 0       |       |
| ss_total_edits   | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_good_articles | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_total_pages   | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_users         | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_images        | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_active_users  | bigint(20) unsigned | YES  |     | NULL    |       |
+------------------+---------------------+------+-----+---------+-------+
labsdb1011
+------------------+---------------------+------+-----+---------+-------+
| Field            | Type                | Null | Key | Default | Extra |
+------------------+---------------------+------+-----+---------+-------+
| ss_row_id        | int(8) unsigned     | NO   |     | 0       |       |
| ss_total_edits   | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_good_articles | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_total_pages   | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_users         | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_images        | bigint(20) unsigned | YES  |     | NULL    |       |
| ss_active_users  | bigint(20) unsigned | YES  |     | NULL    |       |
+------------------+---------------------+------+-----+---------+-------+

I

• GTirloni awarded a token.Nov 27 2018, 6:39 PM
MaxSem added a comment.Nov 27 2018, 9:26 PM

Thanks, everybody! pagecounts.json now has the correct numbers.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits