Page MenuHomePhabricator
Create Task
Maniphest T108767

Make available an XL labs instance with ~350GB available disk space.
Closed, InvalidPublic
Actions

Description

Within search we would like to setup a small cluster of elasticsearch instances in labs for importing production data to and running tests against. I am estimating that three of the existing XL labs instances would be sufficient in terms of memory and cpu, but the disk is lacking. if we can have a combined ~1TB of available disk space between the machines I think that would cover our bases.

Is it possible to create a new, or one-off, labs instance type with 350GB disk space per server? This would give us enough space to pull in some of the larger indexes and be able to reindex/reanalyze them in different ways.

Related Objects
Search...

Event Timeline

EBernhardson created this task.Aug 11 2015, 11:34 PM
EBernhardson raised the priority of this task from to Needs Triage.
EBernhardson updated the task description. (Show Details)
EBernhardson added projects: CirrusSearch, Cloud-VPS.
EBernhardson subscribed.
Restricted Application added projects: Cloud-Services, Discovery-ARCHIVED. · View Herald TranscriptAug 11 2015, 11:34 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
EBernhardson added a parent task: T108766: [epic] Setup elasticsearch cluster in labs and build out necessary tooling to use it for hypothesis testing against production data.Aug 11 2015, 11:36 PM
TJones subscribed.Aug 12 2015, 3:32 PM
EBernhardson set Security to None.Aug 12 2015, 7:39 PM
EBernhardson added a subscriber: yuvipanda.
• chasemp subscribed.Aug 12 2015, 9:27 PM
Hydriz added a project: Datasets-Archiving.Aug 15 2015, 1:54 PM
Hydriz subscribed.

Will be great to have this for the Dumps project as well

• Deskana closed this task as Resolved.Aug 31 2015, 3:26 AM
• Deskana claimed this task.
• Deskana subscribed.

As per T108766, https://suggesty.wmflabs.org has the enwiki production index in it without any of the content, and we've used it to test hypotheses (see T109729), so I'm calling this task complete.

• Deskana triaged this task as Medium priority.Aug 31 2015, 3:26 AM
Nemo_bis changed the task status from Resolved to Invalid.Aug 31 2015, 7:26 AM
Nemo_bis subscribed.

Apparently there are multiple related projects, so the instances in use are quite hard to find, but none appears to have 350 GB disk space. Marking the task as withdrawn instead.

Hydriz moved this task from Incoming to Done on the Datasets-Archiving board.Aug 31 2015, 1:00 PM
• Deskana moved this task from Inbox to Resolved/Invalid/Declined/Legacy on the CirrusSearch board.Dec 31 2015, 5:08 AM
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:48 PM
Restricted Application added a project: Discovery-Search. · View Herald TranscriptJun 7 2017, 6:48 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits