The Analytics team discussed the Labs Data lake project requirements in T198424. We'll basically need three Hadoop worker nodes in labs to build a new little Hadoop cluster, able to offer public data to researchers.
The three new nodes should have the same hardware specs as the Hadoop nodes ordered in T182628 and being ordered in T199673.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T204950 Public Edit Data Lake: Mediawiki history snapshots available in SQL data store to cloud (labs) users | |||
| Declined | Ottomata | T204951 Presto cluster online and usable with test data pushed from analytics prod infrastructure accessible by Cloud (labs) users | |||
| Resolved | elukey | T198694 Q1 2018/19 Analytics procurement | |||
| Resolved | None | T199674 eqiad | (3) Labs Data Lake hardware | |||
| Unknown Object (Task) | |||||
| Resolved | • Cmjohnson | T207192 rack/setup/install an-worker10[78-95].eqiad.wmnet | |||
| Resolved | Ottomata | T207194 rack/setup/install cloudvirtan100[1-5].eqiad.wmnet |