Page MenuHomePhabricator
Create Task
Maniphest T208880

Puppet errors on swift-stretch-ms-fe01.swift.eqiad.wmflabs
Closed, ResolvedPublic
Actions

Description

Puppet errors on $hostname

Puppet has been failing on swift-stretch-ms-fe01.swift.eqiad.wmflabs

Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, Could not find data item profile::prometheus::statsd_exporter::mappings in any Hiera data file and no default supplied at /etc/puppet/modules/profile/manifests/prometheus/statsd_exporter.pp:3:29 on node swift-stretch-ms-fe01.swift.eqiad.wmflabs

If that's a one-off test server, please let us know so we can delete it.

Otherwise, could you take a few minutes to fix that? Thank you!

Related Objects
Search...

Event Timeline

• GTirloni triaged this task as High priority.Nov 6 2018, 7:42 PM
• GTirloni created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 6 2018, 7:42 PM
bd808 subscribed.Nov 6 2018, 11:09 PM

Same problem on 3 of the hosts listed in T208879: Puppet errors on various deployment-prep hosts. Looks to be related to a change that @fgiunchedi made recently (https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/470832/). The common role hiera settings are not seen in Cloud VPS instances because we don't use/support the custom role() function, so these hiera settings need to be propagated to projects that are using the role/profile without the help of our prod lookup magic.

fgiunchedi added a comment.Nov 8 2018, 8:37 AM

Thanks for the help in diagnosis @bd808 ! to set expectations I don't think I'll be able to get to this until next week :|

fgiunchedi closed this task as Resolved.Nov 16 2018, 11:10 AM
fgiunchedi claimed this task.

Catalog compiles now, still some errors when applying resources but that's expected. Resolving though feel free to reopen as needed.

filippo@swift-stretch-ms-fe01:~$ sudo puppet agent --test
Info: Using configured environment 'production'
Info: Retrieving pluginfacts
Info: Retrieving plugin
Info: Loading facts
Info: Caching catalog for swift-stretch-ms-fe01.swift.eqiad.wmflabs
Notice: /Stage[main]/Base::Environment/Tidy[/var/tmp/core]: Tidying 0 files
Info: Applying configuration version '1542366456'
Error: /Stage[main]/Swift::Ring/File[/etc/swift/account.builder]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///volatile/swift/labs/account.builder
Error: /Stage[main]/Swift::Ring/File[/etc/swift/account.ring.gz]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///volatile/swift/labs/account.ring.gz
Error: /Stage[main]/Swift::Ring/File[/etc/swift/container.builder]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///volatile/swift/labs/container.builder
Error: /Stage[main]/Swift::Ring/File[/etc/swift/container.ring.gz]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///volatile/swift/labs/container.ring.gz
Error: /Stage[main]/Swift::Ring/File[/etc/swift/object.builder]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///volatile/swift/labs/object.builder
Error: /Stage[main]/Swift::Ring/File[/etc/swift/object.ring.gz]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///volatile/swift/labs/object.ring.gz
Notice: Applied catalog in 7.06 seconds
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL