Page MenuHomePhabricator
Paste P7632

long running (> 1 hour) docker processes in CI
ActivePublic

Authored by dduvall on Oct 4 2018, 8:21 PM.
Tags
None
Referenced Files
F26310325: long running (> 1 hour) docker processes in CI
Oct 4 2018, 8:21 PM
F26310314: long running (> 1 hour) docker processes in CI
Oct 4 2018, 8:21 PM
Subscribers
None
$ for h in $(curl -s 'https://integration.wikimedia.org/ci/computer/api/json' | ruby -r json -e 'JSON.load(STDIN)["computer"].each { |c| puts c["displayName"] if c["assignedLabels"].any? { |l| l["name"] == "DebianJessieDocker" } }'); do echo "# $h:"; ssh $h.integration.eqiad.wmflabs 'sudo docker ps --format '"'"'{{json .}}'"'"' | ruby -r json -r date -ne '"'"'JSON.load($_).tap { |c| puts c["ID"] if (DateTime.now - DateTime.parse(c["CreatedAt"])) > Rational(1,24) }'"'"' | while read id; do sudo docker top $id; done'; done
# integration-slave-docker-1017:
UID PID PPID C STIME TTY TIME CMD
nobody 20475 20459 0 Sep28 ? 00:00:00 bash /run.sh roundtrip
nobody 20717 20475 0 Sep28 ? 00:00:00 npm
nobody 20727 20717 0 Sep28 ? 00:00:00 sh -c node bin/roundtrip-test.js -c --domain en.wikipedia.org 'Barack Obama' && node bin/roundtrip-test.js -c --domain fr.wikipedia.org Chope && node bin/roundtrip-test.js -c --domain en.wikipedia.org --xml Parkour && node bin/roundtrip-test.js -c --domain www.mediawiki.org --oldid 2170316 'User:Legoktm/test_this_is_json'
nobody 20728 20727 0 Sep28 ? 00:00:57 node bin/roundtrip-test.js -c --domain en.wikipedia.org Barack Obama
# integration-slave-docker-1021:
UID PID PPID C STIME TTY TIME CMD
nobody 18531 18517 0 19:07 ? 00:00:00 bash /run.sh
nobody 19899 18531 0 19:08 ? 00:00:00 npm
nobody 19927 19899 0 19:08 ? 00:00:00 sh -c npm run nsp && npm run lint && npm run parserTests && npm run mocha
nobody 25354 19927 0 19:12 ? 00:00:00 npm
nobody 25364 25354 0 19:12 ? 00:00:00 sh -c mocha --opts tests/mocha/mocha.opts tests/mocha
nobody 25365 25364 0 19:12 ? 00:00:00 node /src/node_modules/.bin/mocha --opts tests/mocha/mocha.opts tests/mocha
nobody 25371 25365 1 19:12 ? 00:00:42 /usr/bin/nodejs /src/node_modules/mocha/bin/_mocha --check-leaks --reporter spec --timeout 10s --recursive --opts tests/mocha/mocha.opts tests/mocha
nobody 25387 18531 0 19:12 ? 00:00:33 /usr/bin/nodejs /src/node_modules/worker-farm/lib/child/index.js /usr/bin/nodejs /src/node_modules/service-runner/service-runner.js --check-leaks --reporter spec --timeout 10s --recursive --opts tests/mocha/mocha.opts tests/mocha
nobody 28977 25371 0 19:44 ? 00:00:02 /usr/bin/nodejs /src/node_modules/service-runner/service-runner.js --check-leaks --reporter spec --timeout 10s --recursive --opts tests/mocha/mocha.opts tests/mocha
# integration-slave-docker-1033:
UID PID PPID C STIME TTY TIME CMD
nobody 25478 25462 0 16:27 ? 00:00:00 /usr/bin/python3 /usr/local/bin/quibble --packages-source vendor --db mysql --db-dir /workspace/db --skip composer-test
nobody 25758 25478 0 16:28 ? 00:00:10 /usr/sbin/mysqld --skip-networking --datadir=/workspace/db/quibble-mysql-dox4gan0 --log-error=/workspace/db/quibble-mysql-dox4gan0/error.log --pid-file=/workspace/db/quibble-mysql-dox4gan0/mysqld.pid --socket=/workspace/db/quibble-mysql-dox4gan0/socket
nobody 25925 25478 87 16:28 ? 03:22:56 npm
UID PID PPID C STIME TTY TIME CMD
nobody 22715 22700 0 Oct03 ? 00:00:00 bash /run.sh
nobody 22769 22715 99 Oct03 ? 1-01:07:59 npm
# integration-slave-docker-1034:
# integration-slave-docker-1037:
UID PID PPID C STIME TTY TIME CMD
nobody 11738 11723 0 Sep28 ? 00:00:00 bash /run.sh roundtrip
nobody 12001 11738 0 Sep28 ? 00:00:00 npm
nobody 12011 12001 0 Sep28 ? 00:00:00 sh -c node bin/roundtrip-test.js -c --domain en.wikipedia.org 'Barack Obama' && node bin/roundtrip-test.js -c --domain fr.wikipedia.org Chope && node bin/roundtrip-test.js -c --domain en.wikipedia.org --xml Parkour && node bin/roundtrip-test.js -c --domain www.mediawiki.org --oldid 2170316 'User:Legoktm/test_this_is_json'
nobody 12012 12011 0 Sep28 ? 00:01:09 node bin/roundtrip-test.js -c --domain en.wikipedia.org Barack Obama
# integration-slave-docker-1038:
UID PID PPID C STIME TTY TIME CMD
nobody 18391 18376 0 16:27 ? 00:00:00 /usr/bin/python3 /usr/local/bin/quibble --packages-source vendor --db mysql --db-dir /workspace/db --run composer-test
nobody 18666 18391 0 16:28 ? 00:00:08 /usr/sbin/mysqld --skip-networking --datadir=/workspace/db/quibble-mysql-k1oi0awv --log-error=/workspace/db/quibble-mysql-k1oi0awv/error.log --pid-file=/workspace/db/quibble-mysql-k1oi0awv/mysqld.pid --socket=/workspace/db/quibble-mysql-k1oi0awv/socket
nobody 18836 18391 90 16:28 ? 03:29:20 npm
UID PID PPID C STIME TTY TIME CMD
nobody 19343 19328 0 Oct03 ? 00:00:00 bash /run.sh roundtrip
nobody 19400 19343 99 Oct03 ? 1-06:21:28 npm
# integration-slave-docker-1040:
UID PID PPID C STIME TTY TIME CMD
nobody 8599 30028 78 07:03 ? 10:23:09 npm
nobody 30028 29914 0 06:59 ? 00:00:03 /usr/bin/python3 /usr/local/bin/quibble --packages-source vendor --db mysql --db-dir /workspace/db
UID PID PPID C STIME TTY TIME CMD
nobody 17113 31724 81 Oct03 ? 18:47:12 npm
nobody 31724 31610 0 Oct03 ? 00:00:04 /usr/bin/python3 /usr/local/bin/quibble --packages-source vendor --db mysql --db-dir /workspace/db --phpunit-testsuite=extensions
# integration-slave-docker-1041:
UID PID PPID C STIME TTY TIME CMD
nobody 27415 27383 0 16:27 ? 00:00:00 /usr/bin/python3 /usr/local/bin/quibble --packages-source vendor --db sqlite --db-dir /workspace/db --skip composer-test
nobody 28826 27415 99 16:28 ? 04:25:02 npm
UID PID PPID C STIME TTY TIME CMD
nobody 24686 24670 0 13:32 ? 00:00:00 /usr/bin/python3 /usr/local/bin/quibble --packages-source vendor --db mysql --db-dir /workspace/db
nobody 25232 24686 75 13:35 ? 05:05:46 npm
nobody 27508 24686 0 13:34 ? 00:01:03 /usr/sbin/mysqld --skip-networking --datadir=/workspace/db/quibble-mysql-2_marox8 --log-error=/workspace/db/quibble-mysql-2_marox8/error.log --pid-file=/workspace/db/quibble-mysql-2_marox8/mysqld.pid --socket=/workspace/db/quibble-mysql-2_marox8/socket
UID PID PPID C STIME TTY TIME CMD
nobody 2250 2234 0 04:17 ? 00:00:02 /usr/bin/python3 /usr/local/bin/quibble --packages-source vendor --db mysql --db-dir /workspace/db
nobody 9780 2250 84 04:23 ? 13:29:23 npm
UID PID PPID C STIME TTY TIME CMD
nobody 11746 11731 0 Oct03 ? 00:00:00 bash /run.sh toolcheck
nobody 11796 11746 99 Oct03 ? 1-06:10:12 npm
UID PID PPID C STIME TTY TIME CMD
nobody 449 31225 0 Oct02 ? 00:00:00 npm
nobody 470 449 0 Oct02 ? 00:00:00 sh -c node bin/roundtrip-test.js -c --domain en.wikipedia.org 'Barack Obama' && node bin/roundtrip-test.js -c --domain fr.wikipedia.org Chope && node bin/roundtrip-test.js -c --domain en.wikipedia.org --xml Parkour && node bin/roundtrip-test.js -c --domain www.mediawiki.org --oldid 2170316 'User:Legoktm/test_this_is_json'
nobody 471 470 0 Oct02 ? 00:00:26 node bin/roundtrip-test.js -c --domain en.wikipedia.org Barack Obama
nobody 31225 31209 0 Oct02 ? 00:00:00 bash /run.sh roundtrip
# integration-slave-docker-1043:
UID PID PPID C STIME TTY TIME CMD
nobody 351 336 0 Oct03 ? 00:00:00 bash /run.sh
nobody 407 351 99 Oct03 ? 1-03:54:25 npm

Event Timeline

dduvall changed the title of this paste from untitled to long running (> 1 hour) docker processes in CI.