Page MenuHomePhabricator

Don't rely on wikitech API for production services
Closed, ResolvedPublic

Description

nfs-project-exports-daemon (presumably among others) hits the wikitech API to learn about instances and their IPs. This is extremely fragile and relies on tech that we've already planned to phase out.

Related Objects

Event Timeline

Andrew raised the priority of this task from to Needs Triage.
Andrew updated the task description. (Show Details)
Andrew added projects: Cloud-Services, Cloud-VPS.
Andrew added a subscriber: Andrew.

+1 - we need a readonly nova api account, I think.

chasemp added a subscriber: chasemp.

modules/labstore/files/nfs-exports-daemon: url = ("https://wikitech.wikimedia.org/w/api.php" +

Labs hiera stuff:
modules/wmflib/lib/hiera/mwcache.rb: @httphost = config[:host] || 'https://wikitech.wikimedia.org'
modules/puppetmaster/files/labs.hiera.yaml: :host: https://wikitech.wikimedia.org
modules/puppetmaster/files/labtest.hiera.yaml: :host: https://wikitech.wikimedia.org

Hiera variable status_wiki_host_master - this is more about labs updating wikitech, it's not vital
Hiera variable labs_osm_host - this is to allow silver to connect to ports 5000 and 35357 (keystone) + 9292 (glance) on control, and port 9001 (designate) on services

modules/ldap/manifests/role/config.pp: 'wikicontrollerapiurl' => 'https://wikitech.wikimedia.org/w/api.php', - unused?

modules/graphite/files/archive-instances: 'https://wikitech.wikimedia.org/w/api.php' +
modules/graphite/files/archive-instances: 'https://wikitech.wikimedia.org/w/api.php?action=query&list=novaprojects&format=json'
modules/prometheus/files/usr/local/bin/prometheus-labs-targets: 'https://wikitech.wikimedia.org/w/api.php?' +

Change 328608 had a related patch set uploaded (by Alex Monk):
graphite: Don't use wikitech API to find labs projects/instances

https://gerrit.wikimedia.org/r/328608

Change 328609 had a related patch set uploaded (by Alex Monk):
labstore: Don't use wikitech API to find labs instances in nfs-exportd

https://gerrit.wikimedia.org/r/328609

Change 329021 had a related patch set uploaded (by Alex Monk):
toollabs: Don't use wikitech API to find labs instances in tools-clush-generator

https://gerrit.wikimedia.org/r/329021

Change 329021 merged by Andrew Bogott:
toollabs: Don't use wikitech API to find labs instances in tools-clush-generator

https://gerrit.wikimedia.org/r/329021

Change 328608 merged by Andrew Bogott:
graphite: Don't use wikitech API to find labs projects/instances

https://gerrit.wikimedia.org/r/328608

Change 333267 had a related patch set uploaded (by Andrew Bogott):
graphite: Don't use wikitech API to find labs projects/instances

https://gerrit.wikimedia.org/r/333267

Change 333267 merged by Andrew Bogott:
graphite: Don't use wikitech API to find labs projects/instances

https://gerrit.wikimedia.org/r/333267

Change 333289 had a related patch set uploaded (by Alex Monk):
Follow-up I94eb86ba: Ignore projects where we can't list instances

https://gerrit.wikimedia.org/r/333289

Change 333289 merged by Andrew Bogott:
Follow-up I94eb86ba: Ignore projects where we can't list instances

https://gerrit.wikimedia.org/r/333289

Change 328609 merged by Andrew Bogott:
labstore: Don't use wikitech API to find labs instances in nfs-exportd

https://gerrit.wikimedia.org/r/328609

Change 335917 had a related patch set uploaded (by Andrew Bogott):
Labstore: set openstack::version: mitaka on 1004 and 1005

https://gerrit.wikimedia.org/r/335917

Change 335917 merged by Andrew Bogott:
Labstore: set openstack::version: mitaka on 1004 and 1005

https://gerrit.wikimedia.org/r/335917

Andrew claimed this task.

I think that's all of them!