Page MenuHomePhabricator
Create Task
Maniphest T324147

Investigate and document cloudvirt-wdqs servers
Closed, ResolvedPublic
Actions

Description

I have IRC notifications for the string "wdqs" , and I noticed that 3 cloudvirt-wdqs alerted today. Per conversation with @Gehel , "the wikimedia-cloud team should manage the cloudvirt* servers" , "cloudvirt-wdqs are the physical servers hosting our WDQS VMs in WMCS" and "We don't have any active testing on WMCS for wikidata at the moment".

Creating this ticket to investigate and document current and past use for cloudvirt-wdqs hosts, so we avoid any future confusion about who owns them, if we still need them, etc...

Related Objects

Event Timeline

bking created this task.Nov 30 2022, 8:27 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 30 2022, 8:27 PM
Andrew subscribed.EditedDec 2 2022, 9:10 PM

Hello bking! Those hosts were bought as a result of T221631

They were purchased specifically to host great big wdqs-specific VMS in cloud-vps. They've been used for that purpose off and on. The hardware is definitely maintained by the WMCS team, as part of the cloudvirt fleet.

That said -- they've been idle for quite some time, waiting for the wdqs people to request a new workload there. If you don't anticipate needing them any longer then we might repurpose the hardware for other uses. The hardware itself is scheduled for refresh in 2024.

Andrew added a comment.Dec 2 2022, 9:15 PM

Oh, I should add: they alerted the other day because I failed to catch them with a wildcard when doing some routine maintenance. I did my best to silence the alerts but they managed to get forwarded anyway, which is a mystery relegated to T324208

bking added a comment.Dec 5 2022, 4:46 PM

Hey Andrew, thanks for the follow-up!

I'm open to letting WMCS repurpose the hardware, but let me confirm with my team first. Will update here or ping in IRC when I have more info.

Andrew mentioned this in T324209: Quota increase request for wikidata-query project.Dec 5 2022, 9:31 PM
bking added a comment.Dec 8 2022, 3:13 PM

Hello Andrew,

After discussing it with my team, we still want to hold on to these servers for now. We still need to completely replace the most important application in the WDQS stack (Blazegraph) , and we believe we'll need the capacity to test at scale.

Sorry for the confusion and let us know if you have any other questions.

Andrew added a comment.Dec 8 2022, 4:19 PM

That's just fine -- as long as those servers are good for something we'll keep them around! lmk when you're ready to stand up VMs there.

Gehel closed this task as Resolved.Dec 19 2022, 4:35 PM
Gehel claimed this task.
Andrew mentioned this in T346948: Move cloudvirt-wdqs hosts.Sep 20 2023, 5:09 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL