Page MenuHomePhabricator
Create Task
Maniphest T119601

Certain tools users create multiple long running queries that take all memory and/or CPU from labsdb hosts, slowing it down and potentially crashing (tracking)
Closed, ResolvedPublic
Actions

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedLSobanskiT119601 Certain tools users create multiple long running queries that take all memory and/or CPU from labsdb hosts, slowing it down and potentially crashing (tracking)
 ResolvedjcrespoT119604 Faebot is crashing labsdb1002
 ResolvedjcrespoT119695 tools.joanjoc is executing the same >1h query every 5 minutes
 ResolvedjcrespoT120926 s52721__pagecount_stats_p import is making labsdb1005 100% utilized (and lagging its backup slave)
 OpenNoneT121094 Throttling linkwatcher tool user as it is consuming 100% CPU
 ResolvedMagnusT131933 BaGLAMa2 has very long running queries
 ResolvedNoneT131937 Throttling Cyberbot tool user as it is consuming most of the CPU
 ResolvedCyberpower678T133584 Reduce stress caused by IABot on the DB
 Resolved• chasempT131956 Disabling general.confirmeduser from dbreports for using up too much db resources
 ResolvedjcrespoT137707 Antigng-bot improper non-api http requests
 ResolvedjcrespoT138283 Some users use persistent connections that are idle, wasting memory and other resources that could be used for other users
 ResolvedjcrespoT142356 p50380g50921 has 20+ open persistent connections to labsdb1001 & labsdb1003
 ResolveddungodungT142358 s51704 had multiple long-running (~1 hour) concurrent queries before labsdb crashed
 ResolvedjcrespoT142475 s51059 is doing unnecessarily slow queries
 ResolvedjcrespoT142482 u3532 is executing several concurrent, highly-intensive, innefficient long-running queries on at least labsdb1003, potentially hurting the stability of the system
 ResolvedUrbanecmT144180 u13367 is running 2 inefficient 9-day-long queries, causing high cpu usage
 ResolvedMagnusT168375 Heavy 19-hour quries on labsdb1005 (tools-db) by s51203 at s51203__baglama2_p
 ResolvedjcrespoT114559 s51053 (tools.jackbot) is abusing resources on labsdbs, throttle his grants
 ResolvedjcrespoT182995 heavy queries from s51205, unlikely to finish?
 ResolvedjcrespoT183077 s51580 blocked from access to wikireplicas with suspicion of having tried a DOS
 ResolvedSamwalton9-WMFT188205 s52467__new_hashtags seems to be overloading the toolsdb host
 ResolvedWurglT187792 tools.wikihistory seems to be wasting lots of unnecessary cpu resources on toolsdb
 OpenNoneT178459 Long running queries from pltools unlikely to finish
 ResolvedjcrespoT194343 quentinv57-tools/tools/globalcontribs.php generates slow/complex SQL queries which impact server performance
 DeclinedNoneT198320 The SUL Info tool doesn't work
 ResolvedNoneT203769 s51434 user with long running writes on labsdb1005
 ResolvedSurlycyborgT216213 s52481__stats_global running CREATE DATABASE IF NOT EXISTS on too many queries causing locking issues
 ResolvedPathoschildT217853 tools.meta was creating high cpu load on wikireplicas, rate-limited

Event Timeline

jcrespo created this task.Nov 25 2015, 10:06 AM
jcrespo claimed this task.
jcrespo raised the priority of this task from to Needs Triage.
jcrespo updated the task description. (Show Details)
jcrespo added projects: DBA, Toolforge.
jcrespo added subscribers: jcrespo, yuvipanda.
Restricted Application added a project: Cloud-Services. · View Herald TranscriptNov 25 2015, 10:06 AM
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald Transcript
jcrespo added a parent task: T114559: s51053 (tools.jackbot) is abusing resources on labsdbs, throttle his grants.Nov 25 2015, 10:07 AM
jcrespo closed subtask T119604: Faebot is crashing labsdb1002 as Resolved.
jcrespo triaged this task as High priority.Nov 26 2015, 10:54 AM
jcrespo added a subtask: T119695: tools.joanjoc is executing the same >1h query every 5 minutes.
jcrespo set Security to None.
jcrespo moved this task from Triage to Backlog on the DBA board.Nov 29 2015, 10:55 PM
jcrespo removed jcrespo as the assignee of this task.Dec 1 2015, 5:23 PM
jcrespo added a subtask: T120926: s52721__pagecount_stats_p import is making labsdb1005 100% utilized (and lagging its backup slave).Dec 9 2015, 11:19 AM
jcrespo closed subtask T120926: s52721__pagecount_stats_p import is making labsdb1005 100% utilized (and lagging its backup slave) as Resolved.Dec 10 2015, 10:35 AM
Beetstra added a subscriber: Beetstra.Dec 13 2015, 3:28 AM
Glaisher added a subscriber: Glaisher.Dec 13 2015, 8:50 AM
Fae reopened subtask T119604: Faebot is crashing labsdb1002 as Open.Jan 5 2016, 9:53 AM
valhallasw closed subtask T119604: Faebot is crashing labsdb1002 as Resolved.Jan 8 2016, 10:29 AM
• bd808 added a project: Tracking-Neverending.Feb 21 2016, 8:59 PM
• bd808 moved this task from Triage to Tracking on the Toolforge board.
Volans added a subtask: T131933: BaGLAMa2 has very long running queries.Apr 6 2016, 2:47 PM
Volans added a subtask: T131937: Throttling Cyberbot tool user as it is consuming most of the CPU.Apr 6 2016, 3:12 PM
tom29739 added a subscriber: tom29739.Apr 6 2016, 3:26 PM
yuvipanda created subtask T131956: Disabling general.confirmeduser from dbreports for using up too much db resources.Apr 6 2016, 5:21 PM
• MZMcBride added a subscriber: • MZMcBride.Apr 6 2016, 11:15 PM
Magnus closed subtask T131933: BaGLAMa2 has very long running queries as Resolved.Apr 7 2016, 12:55 PM
Cyberpower678 closed subtask T131937: Throttling Cyberbot tool user as it is consuming most of the CPU as Resolved.May 24 2016, 8:54 PM
jcrespo created subtask T137707: Antigng-bot improper non-api http requests.Jun 13 2016, 1:20 PM
jcrespo created subtask T138283: Some users use persistent connections that are idle, wasting memory and other resources that could be used for other users.Jun 21 2016, 9:06 AM
jcrespo closed subtask T138283: Some users use persistent connections that are idle, wasting memory and other resources that could be used for other users as Resolved.Jun 28 2016, 3:29 PM
jcrespo closed subtask T137707: Antigng-bot improper non-api http requests as Resolved.Jul 14 2016, 1:14 PM
jcrespo added subtasks: T142356: p50380g50921 has 20+ open persistent connections to labsdb1001 & labsdb1003, T142358: s51704 had multiple long-running (~1 hour) concurrent queries before labsdb crashed, T142475: s51059 is doing unnecessarily slow queries.Aug 9 2016, 1:34 PM
jcrespo closed subtask T142475: s51059 is doing unnecessarily slow queries as Resolved.Aug 9 2016, 3:06 PM
jcrespo added a subtask: T142482: u3532 is executing several concurrent, highly-intensive, innefficient long-running queries on at least labsdb1003, potentially hurting the stability of the system.Aug 9 2016, 3:44 PM
jcrespo closed subtask T142482: u3532 is executing several concurrent, highly-intensive, innefficient long-running queries on at least labsdb1003, potentially hurting the stability of the system as Resolved.Aug 9 2016, 4:03 PM
jcrespo created subtask T144180: u13367 is running 2 inefficient 9-day-long queries, causing high cpu usage.Aug 29 2016, 1:30 PM
jcrespo closed subtask T144180: u13367 is running 2 inefficient 9-day-long queries, causing high cpu usage as Resolved.Aug 29 2016, 1:50 PM
Liuxinyu970226 added a subscriber: Liuxinyu970226.Feb 25 2017, 3:32 AM
jcrespo closed subtask T142356: p50380g50921 has 20+ open persistent connections to labsdb1001 & labsdb1003 as Resolved.May 4 2017, 2:49 PM
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:46 PM
jcrespo added a subtask: T168375: Heavy 19-hour quries on labsdb1005 (tools-db) by s51203 at s51203__baglama2_p.Jun 20 2017, 10:05 AM
jcrespo removed a parent task: T114559: s51053 (tools.jackbot) is abusing resources on labsdbs, throttle his grants.
jcrespo added a subtask: T114559: s51053 (tools.jackbot) is abusing resources on labsdbs, throttle his grants.
jcrespo closed subtask T168375: Heavy 19-hour quries on labsdb1005 (tools-db) by s51203 at s51203__baglama2_p as Resolved.Jun 22 2017, 6:51 AM
• chasemp closed subtask T131956: Disabling general.confirmeduser from dbreports for using up too much db resources as Resolved.Nov 17 2017, 1:55 PM
jcrespo added a subtask: T182995: heavy queries from s51205, unlikely to finish?.Jan 3 2018, 6:35 PM
jcrespo added a subtask: T183077: s51580 blocked from access to wikireplicas with suspicion of having tried a DOS.
• bd808 edited projects, added Data-Services; removed Cloud-Services.Jan 3 2018, 6:38 PM
• bd808 moved this task from Backlog to Wiki replicas on the Data-Services board.
• bd808 added a subscriber: • bd808.
jcrespo closed subtask T182995: heavy queries from s51205, unlikely to finish? as Resolved.Jan 3 2018, 7:12 PM
jcrespo added a subtask: T188205: s52467__new_hashtags seems to be overloading the toolsdb host.Feb 26 2018, 4:57 PM
jcrespo added a subtask: T187792: tools.wikihistory seems to be wasting lots of unnecessary cpu resources on toolsdb.
jcrespo closed subtask T188205: s52467__new_hashtags seems to be overloading the toolsdb host as Resolved.Feb 27 2018, 9:27 AM
jcrespo added a subtask: T178459: Long running queries from pltools unlikely to finish.May 11 2018, 3:16 PM
jcrespo added a subtask: T194343: quentinv57-tools/tools/globalcontribs.php generates slow/complex SQL queries which impact server performance.May 11 2018, 3:21 PM
jcrespo renamed this task from Certain tools users create multiple long running queries that take all memory from labsdb hosts, slowing it down and potentially crashing (tracking) to Certain tools users create multiple long running queries that take all memory and/or CPU from labsdb hosts, slowing it down and potentially crashing (tracking).May 11 2018, 3:40 PM
jcrespo reopened subtask T188205: s52467__new_hashtags seems to be overloading the toolsdb host as Open.Aug 8 2018, 1:34 PM
Marostegui added a subtask: T203769: s51434 user with long running writes on labsdb1005.Sep 7 2018, 10:13 AM
Marostegui closed subtask T203769: s51434 user with long running writes on labsdb1005 as Resolved.Sep 7 2018, 6:20 PM
jcrespo closed subtask T188205: s52467__new_hashtags seems to be overloading the toolsdb host as Resolved.Sep 11 2018, 2:23 PM
Marostegui moved this task from Backlog to Meta/Epic on the DBA board.Sep 11 2018, 2:24 PM
Marostegui closed subtask T194343: quentinv57-tools/tools/globalcontribs.php generates slow/complex SQL queries which impact server performance as Resolved.Dec 20 2018, 12:37 PM
Surlycyborg closed subtask T216213: s52481__stats_global running CREATE DATABASE IF NOT EXISTS on too many queries causing locking issues as Resolved.Feb 25 2019, 8:09 PM
jcrespo added a subtask: T217853: tools.meta was creating high cpu load on wikireplicas, rate-limited.Mar 7 2019, 5:52 PM
Wurgl closed subtask T187792: tools.wikihistory seems to be wasting lots of unnecessary cpu resources on toolsdb as Resolved.Mar 23 2019, 10:02 PM
LSobanski closed this task as Resolved.Apr 13 2021, 4:51 PM
LSobanski claimed this task.
LSobanski added subscribers: nskaggs, LSobanski.

Closing after consulting with @nskaggs. Doesn't seem like either of our teams is actively using this task.

taavi closed subtask T142358: s51704 had multiple long-running (~1 hour) concurrent queries before labsdb crashed as Resolved.May 16 2021, 4:41 PM
Pathoschild closed subtask T217853: tools.meta was creating high cpu load on wikireplicas, rate-limited as Resolved.May 26 2021, 1:56 PM
Content licensed under Creative Commons Attribution-ShareAlike 4.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL