Page MenuHomePhabricator
Create Task
Maniphest T179501

Use external dsh group to list pooled ORES nodes
Closed, DeclinedPublic
Actions

Description

Move the node list from scap/ores-cluster to an /etc/dsh/group/... file.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedakosiarisT162039 Prepare to service applications from kubernetes
 ResolvedakosiarisT162041 Expand the infrastructure to codfw
 ResolvedRobHT161700 CODFW: (4) hardware access request for kubernetes
 ResolvedRobHT142578 codfw/eqiad:(9+9) hardware access request for ORES
Unknown Object (Task)
 ResolvedakosiarisT165170 rack/setup/install ores2001-2009
 DeclinedNoneT179501 Use external dsh group to list pooled ORES nodes
 ResolvedakosiarisT168073 Switch ORES to dedicated cluster
 ResolvedakosiarisT165171 rack/setup/install ores1001-1009
 Resolved• mmodellT181552 Git refusing to clone some ORES submodules
 ResolvedawightT181661 Connection timeout from tin to new ores servers
 ResolvedakosiarisT182347 SCAP: Upload debian package version 3.7.4-3
 ResolvedakosiarisT183046 scap 3.7.4-2 is broken
 InvalidNoneT182801 New, mysterious scap failure
 ResolvedHalfakT185901 Preliminary deployment of ORES to new cluster
 ResolvedakosiarisT171851 Reimage ores* hosts with Debian Stretch
 ResolvedawightT169246 Stress/capacity test new ores* cluster
 ResolvedHalfakT174402 Review and fix file handle management in worker and celery processes
 ResolvedawightT177036 Clean up file handle and Redis connection management in ORES worker and celery processes
 ResolvedNoneT175736 Give ores admins read access to /srv/log/ores/main.log*
 ResolvedawightT179095 Wheels built on ores-misc-01 are incompatible with ores* and scb*
 ResolvedawightT181806 Problem with Redis server configuration on new ORES cluster
 ResolvedHalfakT182799 Make sure ORES is compatible with stretch
 ResolvedHalfakT184072 Rebuild ORES models on Stretch
 ResolvedHalfakT184073 Provision a Stretch box we can use to build ORES models
 ResolvedakosiarisT184074 Verify that all enchant/spelling dictionaries are available on Stretch. Port if needed.
 ResolvedHalfakT184135 Rebuild ORES wheels on Stretch
 ResolvedHalfakT184296 Convert CloudVPS instances to stretch.
ResolvedHalfakT184766 Convert ores-misc-01 to stretch
 ResolvedSumitT184765 Back up ores-misc-01 to ores-staging-01

Event Timeline

awight created this task.Nov 1 2017, 3:48 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 1 2017, 3:48 PM
awight added a subtask: T168073: Switch ORES to dedicated cluster.Nov 1 2017, 3:49 PM
Halfak triaged this task as Low priority.Nov 1 2017, 4:54 PM
Halfak added a project: Scap.
Halfak moved this task from Unsorted to Maintenance/cleanup on the Machine-Learning-Team board.
awight changed the status of subtask T168073: Switch ORES to dedicated cluster from Stalled to Open.Dec 14 2017, 9:24 PM
akosiaris subscribed.Feb 7 2018, 3:24 PM

ORES dsh groups populated via conftool alongside 2 canaries is in https://gerrit.wikimedia.org/r/#/c/408799/. Some changes are required in scap.cfg, I 'll post them in this task and then resolve it

akosiaris added a comment.Feb 14 2018, 8:34 AM

And scap configuration updated in https://gerrit.wikimedia.org/r/#/c/409932/. When that one is merged this can be called done as well

akosiaris closed subtask T168073: Switch ORES to dedicated cluster as Resolved.Feb 22 2018, 12:00 PM
• Phabricator_maintenance moved this task from Backlog to Acknowledged on the SRE board.Jan 26 2019, 9:33 PM
awight unsubscribed.Mar 21 2019, 4:01 PM
• ACraze moved this task from Maintenance/cleanup to Backlog/ORES on the Machine-Learning-Team board.Jan 19 2021, 10:29 PM
elukey closed this task as Declined.May 29 2023, 9:25 AM
elukey subscribed.

We are moving to Lift Wing: https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing

I am closing old tasks related to ORES since it is being deprecated, please re-open if you feel that any work could be done on Lift Wing.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL