Page MenuHomePhabricator

Can scandium.eqiad.wmnet receives a couple 500G hard drive in a RAID 1 array?
Closed, DeclinedPublic

Description

Merely a question for @RobH / DC-Ops I believe.

We are envisioning migrating Jenkins to scandium.eqiad.wmnet. The server has a couple 150GB SSD with two raid 1:

Mount pointSizeUsedAvail
/9.1G2.5G 6.2G
/srv/ssd140G12G128G

T136711 is asking to split /srv/ssd and form a second /srv/ssd2 raid. Each would eventually have at least 20 GBytes or 40GBytes total.

With Zuul and Jenkins / will probably need to be resized, most probably to 20 Gbytes.

That will leave 90 GBytes for Jenkins build history and artifacts. With a 15/30 days retention, that is currently 160Gbytes on gallium /var/lib/jenkins/builds which would not fit.

A potential solution would be to add a RAID 1 array of 500 Gbytes on hard drives to host the Jenkins history and potentially over growing data (such as log).

Question

Does scandium has a raid array / empty slot in which to add 500Gbytes disks? Do we have some spare disks floating around.

Alternative
Another solution would be to further limit the amount of disk used by Jenkins. Have a new 80 GBytes partition dedicated to Jenkins build (and mounted as /var/lib/jenkins/builds) then change the jobs data retention so they consume less disk.

Jenkins jobs top sizes on gallium /var/lib/jenkins/builds

Size (MB)Job
18484apps-android-wikipedia-test
16621mediawiki-extensions-hhvm
12060mediawiki-phpunit-hhvm-trusty
10129apps-android-wikipedia-periodic-test
9208apps-android-wikipedia-publish
4971mwext-testextension-hhvm
4968mwext-testextension-php55
4890mediawiki-phpunit-hhvm-composer
4726mediawiki-extensions-php55
3844mediawiki-parsertests-hhvm-trusty
3634mwext-testextension-hhvm-composer
3597mediawiki-phpunit-php55-trusty
3597mediawiki-extensions-qunit
3540mwext-testextension-php55-composer
2608mediawiki-extensions-qunit-jessie
1950analytics-refinery-maven
1920beta-update-databases-eqiad
1778mwext-Wikibase-repo-tests-sqlite-hhvm
1562mwext-qunit
1495operations-debs-archiva-debian-glue
1157mediawiki-parsertests-php55-trusty
1015mwext-qunit-composer
1013integration-zuul-layoutvalidation-gate
1006mediawiki-core-code-coverage

Event Timeline

hashar created this task.Jun 29 2016, 3:01 PM
Restricted Application added subscribers: Zppix, Southparkfan. · View Herald TranscriptJun 29 2016, 3:01 PM
hashar updated the task description. (Show Details)Jun 29 2016, 4:03 PM
hashar changed the task status from Open to Stalled.Jul 11 2016, 2:15 PM

I have filled hardware-requests T139938: eqiad: 2 300GB SSD disks for scandium.eqiad.wmnet to get us a couple 300 SSD disk on scandium.

hashar closed this task as Declined.Jul 13 2016, 3:31 PM

Change of .plan. We are heading toward using contint1001 to replace both gallium and scandium.