Cannot delete job id #7523461 by tools.legobot on Tool Labs
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Legoktm
	Jun 18 2016, 12:23 AM

Description

I tried to delete job #7523461 after the bot got stuck or something. I ran qdel 7523461 last night, saw it entered the deleted state, and logged out. Except the job is still in the deleted state. I just tried qdel -f 7523461 and it didn't help...

tools.legobot@tools-bastion-03:~$ qdel -f 7523461
job 7523461 is already in deletion
............
tools.legobot@tools-bastion-03:~$ qstat
job-ID  prior   name       user         state submit/start at     queue                          slots ja-task-ID 
-----------------------------------------------------------------------------------------------------------------
6727771 0.34647 lighttpd-p tools.legobo r     05/25/2016 06:36:00 webgrid-lighttpd@tools-webgrid     1        
6956501 0.33412 oldidGA    tools.legobo r     05/31/2016 14:04:07 task@tools-exec-1208.eqiad.wmf     1        
7523461 0.30348 goodarticl tools.legobo dr    06/16/2016 05:40:10 task@tools-exec-1219.eqiad.wmf     1        
7590323 0.30003 rfc        tools.legobo r     06/18/2016 00:01:14 task@tools-exec-1220.tools.eqi     1

Related Objects

Mentioned In: T144789: Gridengine nodes tools-exec-1218 and 1219 seem unreachable

Event Timeline

Legoktm created this task.Jun 18 2016, 12:23 AM

Restricted Application added a project: Cloud-Services. · View Herald TranscriptJun 18 2016, 12:23 AM

Restricted Application added subscribers: Zppix, Aklapper. · View Herald Transcript

I force deleted it

Thanks! Is that a root-level thing or something I can do on my own? I thought qdel -f was supposed to do that...

It's a root level thing unfortunately - I think you can do qdel -f as a normal user but gridengine, uh, does not really seem to care while if a root does it it does care - since that's what I ran as well...

LOL.

Uh, @yuvipanda , could you use your root magic powers again? It seems to have gotten stuck again:

tools.legobot@tools-bastion-03:~$ qdel -f 300763
job 300763 is already in deletion
............
tools.legobot@tools-bastion-03:~$ qstat
job-ID  prior   name       user         state submit/start at     queue                          slots ja-task-ID 
-----------------------------------------------------------------------------------------------------------------
 300763 0.31091 rfc        tools.legobo dr    08/29/2016 23:46:26 task@tools-exec-1219.eqiad.wmf     1        
 359947 0.30812 lighttpd-p tools.legobo r     08/31/2016 20:25:01 webgrid-lighttpd@tools-webgrid     1        
 545217 0.30007 oldidGA    tools.legobo r     09/06/2016 06:04:06 task@tools-exec-1216.eqiad.wmf     1

Happened because of https://phabricator.wikimedia.org/T144789. fixed.

• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:42 PM

Cannot delete job id #7523461 by tools.legobot on Tool LabsClosed, ResolvedPublicActions

Description

Related Objects

Event Timeline

Cannot delete job id #7523461 by tools.legobot on Tool Labs
Closed, ResolvedPublic
Actions