Operations Engineer with the Wikimedia Cloud Services Team
Fri, Nov 8
That makes sense..thanks for pointing it out Krenair.
I tested these images and confirmed working.
Updating tools-webservice to include new buster images options to webservice: golang111, jdk11, php73, python37 and ruby25
Wed, Nov 6
Updated documentation based on feedbacks from Arturo.
Tue, Nov 5
All of the lighttpd based k8s pods have been restarted
I am looking for a sane way to restart all of the lighttpd powered webservices to force the change to take effect...
Mon, Nov 4
I think our best bet is to set the max-size and max-file options for the json-file logging driver
Sat, Nov 2
Fri, Nov 1
Thanks for letting us know.
Wed, Oct 30
Hey @Magnus ... we are just doing some ticket cleanup and noticed that the last update was back in March... and it looks like the ticket had been resolved. Is it ok if we close this ticket?
Tue, Oct 29
Hey @Chicocvenancio ... I have manually force killed the jupyter--43riscod container on tools-paws-worker-1007. Let me know if you need anything else.
@Fae .... Try running it in one of the kubernetes python shell
The first draft of the documentation has been posted. Will ask the cteam for the initial review.
Mon, Oct 28
This ticket is closed as part of scheduled clean-up. Please let us if this issue needs to be re-opened.
Marking as done as the documentation has met the requirement scopes of the request.
Fri, Oct 25
Thu, Oct 24
It's fixed.. I have admin to incinga now.
It looks like I still don't have admin access to icinga.. will attempt to update the cfg.cfg file
Wed, Oct 23
The new version of toollabs-webservice package 0.47 has been pushed out to:
I am closing this issue as I have confirmed that kmlexport uses grid not kubernetes (since CGI.pm isn't available). As the service is a simple lighttp based serving a single kmlexport.pl file, this issue was most likely one-off.
Jephpaul responded to the email letting us know that they have actioned the ticket. Confirmed that /home/cosmiclattes now only occupies 16GB of disk space.
Tue, Oct 22
Mon, Oct 21
Hi @bd808 .. I think I got a grip on creating new debian package, uploading it to the repo and updating/push new docker images.. can we proceed with this step Merge and deploy the updated webservice code including Docker image rebuilds ?
All jessie and stretch docker images have been rebuilt with toollabs-webservice package installed. Update images have been pushed to the docker registry.
Hi @Bstorm... do you think it's safe to say that this workaround works and we can close this issue?
I was able to successfully follow bd808's instructions. Does it meet your original requirements?
Notified the user by email.
We have tracked you down as the owner of the cosmiclattes account.
I will update the docker images to include this fix.
Fri, Oct 18
Please disregard my last comment. Moritz has just let us know that Grafana6 is now available on Buster... https://debmonitor.wikimedia.org/packages/grafana
Hi @CDanis, could you please let me know the timeline for getting Grafana package on Buster repo?
Thu, Oct 17
The new version of toollabs-webservice package 0.46 with this fix has been pushed out to:
Hi @SalixAlba . We are just doing some clean up... do you still need help with this issue? If not, please let us know if we can close this ticket.
This task is done. The package toollabs-webservice 0.46 has been ported to buster-tools repo.
Wed, Oct 16
It looks like toollabs-webservice is not in buster-tools... will ask for help from arturo again to port this package
Tue, Oct 15
Wikitech documentation https://w.wiki/9go has been updated
Woot woot... confirmed.. thanks arturo for blocking me
I might as well extend the scope of this ticket to update all docker images based on buster.
Oct 12 2019
Oct 11 2019
I found a couple of previous tickets related to this:
python37/web (specifically toollabs-webservice) needs python-pykube which doesn't look like it's available in buster
stretch doesn't have python3.6 so as per suggestion from bstorm, I'm going to skip to python3.7 since it's available on buster
Oct 9 2019
Oct 8 2019
Oct 7 2019
Ongoing documentation can be found here https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Systems_and_Service_Continuity
The /tmp mount has been cleaned.
Confirmed that /tmp is at 99% disk usage. Will attempt to cleanup unused resources.
Oct 4 2019
It looks like both grafana and python-whisper are not available on buster
Oct 3 2019
I commented the lines related to puppetdb (34 to 44 https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/refs/heads/production/modules/prometheus/manifests/class_config.pp) and was able to run it locally on a test labmon VM with buster installed
It looks like it's been resolved since I no longer see the No such tool? Trying to guess, are you? error.