Page MenuHomePhabricator

Re-organize hiera lookups for cloud-vps instances
Closed, DuplicatePublic

Description

Historically our puppet and hiera trees for different cloud-vps deployments (e.g. eqiad1, codfw1dev) have been inconsistently tangled up together. Let's have distinct per-deployment and per-project-per-deployment lookup trees!

Event Timeline

Andrew added a subscriber: jbond.

The patch to re-organize is:

https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/571562/

It looks right to me, but after merging I get failures like:

"Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Function Call, DNS lookup failed for Resolv::DNS::Resource::IN::A at /etc/puppet/manifests/realm.pp:64:9 on node util-abogott-buster.testlabs.eqiad.wmflabs"

That looks to be because this dnsconfig isn't getting set properly:

$dnsconfig = lookup('labsdnsconfig',Hash, 'hash', {})

Which in turn is probably because the hiera lookup isn't working properly. @jbond offered to help debug this but immediately ran into this upstream issue: https://tickets.puppetlabs.com/browse/PUP-9207

I'm assigning this to @jbond for now; John, if you get stumped or don't have time to work on this please just assign it back to me and I'll just stick debugging lines all over the place. Thanks!