We need to move Maps (Kartotherian) and Maps (Tilerator) to the new logging pipeline. The config should be updated similar to https://gerrit.wikimedia.org/r/#/c/mediawiki/services/change-propagation/deploy/+/500813 and newest node dependencies should be used (newest version of service-runner).
|Open||None||T227080 Deprecate all non-Kafka logstash inputs|
|Invalid||None||T225122 Migrate services using deprecated Gelf logstash input to Kafka enabled logging pipeline|
|Open||None||T225125 Migrate Elasticsearch from deprecated Gelf logstash input to rsyslog Kafka logging pipeline|
|Resolved||Pchelolo||T211125 Move service-runner to new logging infrastructure|
|Invalid||None||T224602 Fix logging umbrella task|
|Resolved||MSantos||T222377 Move kartotherian/tilerator logging to new logging pipeline|
- Mentioned In
- T255932: Automatic zoom and positioning doesn't work for geomasks in thumbnails
T223041: Install a robots.txt file for maps.wikimedia.org
T227080: Deprecate all non-Kafka logstash inputs
- Mentioned Here
- T223041: Install a robots.txt file for maps.wikimedia.org
T255932: Automatic zoom and positioning doesn't work for geomasks in thumbnails
T260947: [OSM] Setup a beta cluster instance to test imposm3 DB replication
T211125: Move service-runner to new logging infrastructure
Reminder/ping as we (SRE Observability) would like to deprecate all non-kafka inputs by end of Q4 FY19/20. If the service is moving (or has moved) to k8s then what's left to do is disable gelf log output and keep on stdout/stderr. If the service isn't moving to k8s then we'll also need to perform puppet-level changes. Thanks!
You're right. However the changes are now being prepared for testing in the beta cluster and should land production afterwards, https://gerrit.wikimedia.org/r/c/maps/kartotherian/deploy/+/627503
I'm reopening since I'm still seeing gelf traffic from tilerator and kartotherian from maps codfw: https://logstash-next.wikimedia.org/goto/df736dad5b406f27bb983ee7fd3bf0fc I'm guessing these hosts didn't get the updated deployment?