Page MenuHomePhabricator

maps hosts have bad permissions under /srv/deployment
Closed, ResolvedPublic

Description

kartotherian / tilerator cannot read their config files

permissions reset by hand and puppet being disabled on maps eqiad

Event Timeline

Mentioned in SAL (#wikimedia-operations) [2019-04-15T14:21:49Z] <cdanis> cdanis@cumin1001.eqiad.wmnet ~ % sudo cumin 'maps1*' "disable-puppet 'bad permissions - T220982 - cdanis'"

Mentioned in SAL (#wikimedia-operations) [2019-04-15T14:22:14Z] <cdanis> T220982 cdanis@cumin1001.eqiad.wmnet ~ % sudo cumin 'maps1*' 'sudo chmod -R a+r /srv/deployment/tilerator /srv/deployment/kartotherian'

permissions reset via:

cumin 'A:maps' 'chmod -R a+r /srv/deployment/kartotherian'
cumin 'A:maps' 'chmod -R a+r /srv/deployment/tilerator'

Mentioned in SAL (#wikimedia-operations) [2019-04-15T14:55:48Z] <gehel> deploying tilerator to maps1001 to validate deployment is working - T220982

Deployment seems to be a noop:

gehel@deploy1001:/srv/deployment/tilerator/deploy$ scap deploy --environment stretch --limit-hosts maps1001.eqiad.wmnet "check deployment is working - T220982" 
 
14:54:10 Started deploy [tilerator/deploy@fac7e5e] (stretch)
14:54:10 Deploying Rev: HEAD = fac7e5eb13df89801f9866070627c89d60e9b36b
14:54:10 Started deploy [tilerator/deploy@fac7e5e] (stretch): check deployment is working - T220982
14:54:10 
== DEFAULT ==
:* maps1001.eqiad.wmnet
tilerator/deploy: fetch stage(s): 100% (ok: 1; fail: 0; left: 0)
tilerator/deploy: config_deploy stage(s): 100% (ok: 1; fail: 0; left: 0)
tilerator/deploy: promote and restart_service stage(s):   0% (ok: 0; fail: 0; letilerator/deploy: promote and restart_service stage(s): 100% (ok: 1; fail: 0; letilerator/deploy: promote and restart_service stage(s): 100% (ok: 1; fail: 0; left: 0)
14:54:13 
== DEFAULT ==
:* maps1001.eqiad.wmnet
tilerator/deploy: finalize stage(s): 100% (ok: 1; fail: 0; left: 0)
14:54:14 Finished deploy [tilerator/deploy@fac7e5e] (stretch): check deployment is working - T220982 (duration: 00m 04s)
14:54:14 Finished deploy [tilerator/deploy@fac7e5e] (stretch) (duration: 00m 04s)
gehel@maps1001:~$ ls -lh /srv/deployment/tilerator/deploy/.git/config-files/etc/tilerator/config.yaml 
-rw-r--r-- 1 deploy-service deploy-service 6.3K Apr 15 14:43 /srv/deployment/tilerator/deploy/.git/config-files/etc/tilerator/config.yaml

Mentioned in SAL (#wikimedia-operations) [2019-04-15T17:41:31Z] <akosiaris> force puppet agent run on maps* after moving config-vars.yaml file for kartotherian, tilerator, tileratorui T220982

Is there anything left to do before closing this?

Gehel claimed this task.

no further issues seen, let's get this closed.