Maniphest T117081

Investigate moving mwoffliner onto a labs-on-real-hardware machine
Closed, DeclinedPublic
Actions

Assigned To

Authored By

	yuvipanda
	Oct 29 2015, 7:22 PM

Tags

Referenced Files

None

Subscribers

Description

Currently the mwoffliner project(https://wikitech.wikimedia.org/wiki/Nova_Resource:Mwoffliner) uses /data/scratch (on NFS) to store temp thumbnails and other files to generate wikipedia (and other projects) ZIM dumps. It uses /data/scratch because for big projects (like enwiki!) the amount of space needed in one time is too high to fit onto an instance's storage.

Would be nice to have a simpler labs-real-hardware machine with maybe 300-400G of hard disk space and 'sufficient' CPU/RAM (8 cores maybe, and 16-32G of RAM). This will also need a public IP (or some other solution that lets kiwix project rsync the generated files off this host)

That'll allow us to move mwoffliner off NFS and also speed up the ZIM generation.

@Kelson would have root on the machine and set it up as he wants (although we'll help streamline it a bit if necessary - see https://wikitech.wikimedia.org/wiki/Nova_Resource_Talk:Mwoffliner for current procedure). It won't be puppetized to begin with, and just be treated as a labs vm in terms of support.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Declined		• chasemp	T117081 Investigate moving mwoffliner onto a labs-on-real-hardware machine
		Resolved		• chasemp	T117095 eqiad: 1 hardware access request for labs on real hardware (mwoffliner)
		Declined		None	T116607 How to handle mgmt lan for labs bare metal?

Event Timeline

yuvipanda created this task.Oct 29 2015, 7:22 PM

yuvipanda raised the priority of this task from to Needs Triage.

yuvipanda updated the task description. (Show Details)

yuvipanda added a project: Cloud-Services.

yuvipanda subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 29 2015, 7:22 PM

• chasemp triaged this task as Medium priority.Oct 29 2015, 7:23 PM

• chasemp set Security to None.

• chasemp subscribed.

• chasemp added a parent task: T95185: PoC bare-metal server allocation in labs -- bootstrap mode.Oct 29 2015, 7:34 PM

yuvipanda updated the task description. (Show Details)Oct 29 2015, 7:34 PM

yuvipanda added a subscriber: Kelson.

yuvipanda mentioned this in T106731: eqiad: 1 hardware access request for labs on real hardware.Oct 29 2015, 7:53 PM

yuvipanda added a subtask: T106731: eqiad: 1 hardware access request for labs on real hardware.

yuvipanda closed subtask T106731: eqiad: 1 hardware access request for labs on real hardware as Declined.Oct 29 2015, 8:18 PM

yuvipanda edited subtasks, added: T117095: eqiad: 1 hardware access request for labs on real hardware (mwoffliner); removed: T106731: eqiad: 1 hardware access request for labs on real hardware.Oct 29 2015, 8:22 PM

This is on hold, pending allocation questions.

We want to work out a few specifics before trying to port an existing project we decided.

• chasemp changed the status of subtask T117095: eqiad: 1 hardware access request for labs on real hardware (mwoffliner) from Open to Stalled.Nov 24 2015, 10:09 PM

for now I'm declining not as a bad idea but because we have other issues to track this as eventual and we are still working out the use case

Andrew closed subtask T117095: eqiad: 1 hardware access request for labs on real hardware (mwoffliner) as Resolved.Nov 18 2016, 9:20 PM

• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:46 PM