Page MenuHomePhabricator
Create Task
Maniphest T141917

AQS Build hangs
Closed, ResolvedPublic
Actions

Description

I followed the instructions we have at https://wikitech.wikimedia.org/wiki/Analytics/AQS#Deploying to try and deploy AQS. This worked in the past, but now it hangs. I pasted the full console output below, after npm install. My environment is as follows:

local node: 4.4.6
local npm: 2.15.5
docker: 1.11.1
OS: Ubuntu 14.04
service-runner: 1.3.1

dan ~/projects/aqs  (master)$ npm install
dan ~/projects/aqs  (master)$ ./server.js build --deploy-repo --force --review -c config.test.yaml
Sending build context to Docker daemon 134.7 kB
Step 1 : FROM debian:jessie
 ---> 28dd215ed12e
Step 2 : RUN apt-get update && apt-get install -y nodejs nodejs-legacy npm git wget && rm -rf /var/lib/apt/lists/*
 ---> Using cache
 ---> 75c734f4e599
Step 3 : ENV NVM_DIR /usr/local/nvm
 ---> Using cache
 ---> 448ef91d8d06
Step 4 : RUN wget -qO- https://raw.githubusercontent.com/creationix/nvm/v0.31.1/install.sh | bash && . $NVM_DIR/nvm.sh && nvm install 4.4.6
 ---> Using cache
 ---> b5b32d9469ad
Step 5 : RUN groupadd -g 1001 -r rungroup && useradd -m -r -g rungroup -u 1001 runuser
 ---> Using cache
 ---> ddd4f9ca93bc
Step 6 : USER runuser
 ---> Using cache
 ---> f0b6c9829274
Step 7 : ENV HOME /home/runuser LINK g++
 ---> Using cache
 ---> 9e4be791b2d1
Step 8 : ENV IN_DOCKER 1
 ---> Using cache
 ---> 18b7850f9402
Step 9 : CMD . $NVM_DIR/nvm.sh && nvm use 4.4.6 && npm install --production && npm install heapdump && npm dedupe
 ---> Using cache
 ---> b9a545d022eb
Successfully built b9a545d022eb
Now using node v4.4.6 (npm v2.15.5)

> dtrace-provider@0.6.0 install /opt/service/node_modules/service-runner/node_modules/bunyan/node_modules/dtrace-provider
> node scripts/install.js

bluebird@3.4.1 node_modules/bluebird

service-runner@1.3.1 node_modules/service-runner
├── semver@5.3.0
├── hot-shots@2.4.0
├── extend@3.0.0
├── bunyan-syslog-udp@0.1.0
├── gelf-stream@1.1.1 (gelfling@0.3.0)
├── js-yaml@3.6.1 (esprima@2.7.2, argparse@1.0.7)
├── yargs@4.8.1 (decamelize@1.2.0, y18n@3.2.1, lodash.assign@4.1.0, which-module@1.0.0, set-blocking@2.0.0, window-size@0.2.0, require-main-filename@1.0.1, require-directory@2.1.1, get-caller-file@1.0.1, yargs-parser@2.4.1, cliui@3.2.0, string-width@1.0.1, os-locale@1.4.0, read-pkg-up@1.0.1)
├── bunyan@1.8.1 (safe-json-stringify@1.0.3, mv@2.1.1, dtrace-provider@0.6.0, moment@2.14.1)
├── limitation@0.1.9 (readable-stream@2.1.4, kad@1.3.6)
└── core-js@2.4.1

restbase-mod-table-cassandra@0.8.18 node_modules/restbase-mod-table-cassandra
├── semver@5.3.0
├── extend@3.0.0
├── json-stable-stringify@1.0.0 (jsonify@0.0.0)
├── cassandra-driver@2.2.2 (async@0.9.2, long@2.4.0)
├── js-yaml@3.6.1 (esprima@2.7.2, argparse@1.0.7)
├── restbase-mod-table-spec@0.1.10 (cassandra-uuid@0.0.2, routeswitch@0.6.3)
└── core-js@2.4.1

hyperswitch@0.1.5 node_modules/hyperswitch
├── json-stable-stringify@1.0.0 (jsonify@0.0.0)
├── cassandra-uuid@0.0.2 (long@2.4.0)
├── swagger-router@0.4.6 (template-expression-compiler@0.1.9, tassembly@0.2.3)
├── js-yaml@3.6.1 (esprima@2.7.2, argparse@1.0.7)
├── ajv@3.8.10 (co@4.6.0, json-stable-stringify@1.0.1)
├── busboy@0.2.13 (readable-stream@1.1.14, dicer@0.2.5)
├── swagger-ui@2.1.4
├── jsonwebtoken@5.7.0 (ms@0.7.1, xtend@4.0.1, jws@3.1.3)
├── preq@0.4.10 (request@2.74.0)
└── core-js@2.4.1

> heapdump@0.3.7 install /opt/service/node_modules/heapdump
> node-gyp rebuild

gyp WARN download NVM_NODEJS_ORG_MIRROR is deprecated and will be removed in node-gyp v4, please use NODEJS_ORG_MIRROR
gyp WARN download NVM_NODEJS_ORG_MIRROR is deprecated and will be removed in node-gyp v4, please use NODEJS_ORG_MIRROR
gyp WARN download NVM_NODEJS_ORG_MIRROR is deprecated and will be removed in node-gyp v4, please use NODEJS_ORG_MIRROR
make: Entering directory '/opt/service/node_modules/heapdump/build'
  CXX(target) Release/obj.target/addon/src/heapdump.o
  SOLINK_MODULE(target) Release/obj.target/addon.node
  COPY Release/addon.node
make: Leaving directory '/opt/service/node_modules/heapdump/build'
heapdump@0.3.7 node_modules/heapdump
npm WARN unavoidable conflict json-stable-stringify { '/opt/service/node_modules/hyperswitch/node_modules/json-stable-stringify': '1.0.0',
npm WARN unavoidable conflict   '/opt/service/node_modules/hyperswitch/node_modules/ajv/node_modules/json-stable-stringify': '1.0.1',
npm WARN unavoidable conflict   '/opt/service/node_modules/restbase-mod-table-cassandra/node_modules/json-stable-stringify': '1.0.0' }
npm WARN unavoidable conflict Not de-duplicating
npm WARN unavoidable conflict readable-stream { '/opt/service/node_modules/hyperswitch/node_modules/busboy/node_modules/readable-stream': '1.1.14',
npm WARN unavoidable conflict   '/opt/service/node_modules/hyperswitch/node_modules/jsonwebtoken/node_modules/jws/node_modules/base64url/node_modules/concat-stream/node_modules/readable-stream': '1.1.14',
npm WARN unavoidable conflict   '/opt/service/node_modules/service-runner/node_modules/limitation/node_modules/readable-stream': '2.1.4' }
npm WARN unavoidable conflict Not de-duplicating
npm WARN unavoidable conflict camelcase { '/opt/service/node_modules/hyperswitch/node_modules/jsonwebtoken/node_modules/jws/node_modules/base64url/node_modules/meow/node_modules/camelcase-keys/node_modules/camelcase': '1.2.1',
npm WARN unavoidable conflict   '/opt/service/node_modules/service-runner/node_modules/yargs/node_modules/yargs-parser/node_modules/camelcase': '3.0.0' }
npm WARN unavoidable conflict Not de-duplicating
npm WARN unavoidable conflict assert-plus { '/opt/service/node_modules/hyperswitch/node_modules/preq/node_modules/request/node_modules/http-signature/node_modules/assert-plus': '0.2.0',
npm WARN unavoidable conflict   '/opt/service/node_modules/hyperswitch/node_modules/preq/node_modules/request/node_modules/http-signature/node_modules/sshpk/node_modules/assert-plus': '1.0.0' }
npm WARN unavoidable conflict Not de-duplicating
npm WARN unavoidable conflict async { '/opt/service/node_modules/hyperswitch/node_modules/preq/node_modules/request/node_modules/form-data/node_modules/async': '1.5.2',
npm WARN unavoidable conflict   '/opt/service/node_modules/restbase-mod-table-cassandra/node_modules/cassandra-driver/node_modules/async': '0.9.2',
npm WARN unavoidable conflict   '/opt/service/node_modules/restbase-mod-table-cassandra/node_modules/restbase-mod-table-spec/node_modules/routeswitch/node_modules/async': '0.9.2',
npm WARN unavoidable conflict   '/opt/service/node_modules/service-runner/node_modules/limitation/node_modules/kad/node_modules/async': '0.9.2' }
npm WARN unavoidable conflict Not de-duplicating
npm WARN unavoidable conflict minimist { '/opt/service/node_modules/hyperswitch/node_modules/jsonwebtoken/node_modules/jws/node_modules/base64url/node_modules/meow/node_modules/minimist': '1.2.0',
npm WARN unavoidable conflict   '/opt/service/node_modules/service-runner/node_modules/bunyan/node_modules/mv/node_modules/mkdirp/node_modules/minimist': '0.0.8' }
npm WARN unavoidable conflict Not de-duplicating
npm WARN unavoidable conflict bluebird { '/opt/service/node_modules/bluebird': '3.4.1',
npm WARN unavoidable conflict   '/opt/service/node_modules/restbase-mod-table-cassandra/node_modules/restbase-mod-table-spec/node_modules/routeswitch/node_modules/bluebird': '2.3.11' }
npm WARN unavoidable conflict Not de-duplicating
spdx-license-ids@1.2.2 node_modules/service-runner/node_modules/yargs/node_modules/read-pkg-up/node_modules/read-pkg/node_modules/normalize-package-data/node_modules/validate-npm-package-license/node_modules/spdx-license-ids
wrappy@1.0.2 node_modules/service-runner/node_modules/bunyan/node_modules/mv/node_modules/rimraf/node_modules/glob/node_modules/wrappy
pify@2.3.0 node_modules/service-runner/node_modules/yargs/node_modules/read-pkg-up/node_modules/read-pkg/node_modules/pify
graceful-fs@4.1.5 node_modules/service-runner/node_modules/yargs/node_modules/read-pkg-up/node_modules/read-pkg/node_modules/graceful-fs
number-is-nan@1.0.0 node_modules/number-is-nan
inherits@2.0.1 node_modules/inherits
ms@0.7.1 node_modules/ms
xtend@4.0.1 node_modules/hyperswitch/node_modules/xtend
semver@5.3.0 node_modules/semver
extend@3.0.0 node_modules/extend
strip-ansi@3.0.1 node_modules/strip-ansi
└── ansi-regex@2.0.0
pinkie-promise@2.0.1 node_modules/pinkie-promise
└── pinkie@2.0.4
cassandra-uuid@0.0.2 node_modules/cassandra-uuid
└── long@2.4.0
bl@1.1.2 node_modules/bl
└── readable-stream@2.0.6 (string_decoder@0.10.31, inherits@2.0.1, util-deprecate@1.0.2, process-nextick-args@1.0.7, core-util-is@1.0.2, isarray@1.0.0)
js-yaml@3.6.1 node_modules/js-yaml
├── esprima@2.7.2
└── argparse@1.0.7 (sprintf-js@1.0.3)
core-js@2.4.1 node_modules/core-js
ansi-regex@2.0.0 node_modules/ansi-regex
long@2.4.0 node_modules/long
^C

Changes sent to Gerrit for review!
dan ~/projects/aqs  (master)$

Event Timeline

Milimetric created this task.Aug 2 2016, 7:50 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 2 2016, 7:50 PM
• Pchelolo added a project: service-runner.Aug 2 2016, 7:56 PM
• Pchelolo claimed this task.Aug 2 2016, 8:02 PM
• Pchelolo subscribed.

Ye, I've seen it hanging on the 'review' part from time to time, but never got a chance to investigate the reasons. Now it's the time, assigning to myself.

• Pchelolo closed this task as Resolved.Aug 4 2016, 9:22 PM

New version of service-runner has been released that should help with this issue.

Milimetric added a comment.Aug 6 2016, 3:11 AM

sweet! thanks :)

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL