Page MenuHomePhabricator
Create Task
Maniphest T240437

Analytics Ops Technical Debt
Closed, ResolvedPublic
Actions

Description

This task should track the ops-related technical debt of the Analytics team. The idea is to have a quick way to identify small/medium tasks to work on every quarter to reduce the overall technical debt (new and accumulated over the years) in a sustainable way.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedodimitrijevicT240437 Analytics Ops Technical Debt
 Resolved• razziT240439 Move https termination from nginx to envoy (if possible)
 DeclinedelukeyT240422 Create user quotas for notebook100[3,4] to limit home directory size
 ResolvedelukeyT240440 Add CPU quota to stat and notebook hosts
 ResolvedelukeyT240255 an-coord1001 hive metastore not listening on ipv6
 ResolvedelukeyT234826 Repurpose db1108 as generic Analytics db replica
 ResolvedMarosteguiT238113 Repurpose db1107 as a generic database
 DeclinedNoneT241040 Deprecate /mnt/hdfs from the Analytics infra
 ResolvedelukeyT243934 Unify puppet roles for stat and notebook hosts
 ResolvedelukeyT244717 Create a ganeti VM in eqiad: an-launcher1001
 ResolvedelukeyT245179 Add SWAP profile to stat1005
ResolvedelukeyT246578 Refactor Analytics POSIX groups in puppet to improve maintainability
 ResolvedelukeyT249752 Decomission notebook hosts
ResolvedelukeyT249754 Unify stat1007 puppet role with the rest of the stats cluster
 DuplicateelukeyT247084 Kerberos credential cache expiry time on notebook is different than the OS one
 ResolvedelukeyT245238 Remove references to m4-master
 ResolvedelukeyT253957 Fix TLS certificate location and expire for Hadoop/Presto/etc.. and add alarms on TLS cert expiry
 DeclinedNoneT255262 Kerberos credential cache location
 DeclinedNoneT255265 Create a small VM to host jobs/system timers currently running on stat1007
 DeclinedNoneT255266 Separate Report Updater Jobs to dedicated VM
 ResolvedelukeyT257412 Review an-coord1001's usage and failover plans
 ResolvedelukeyT268028 Move oozie's hive2 actions to analytics-hive.eqiad.wmnet
 DeclinedelukeyT258799 Deprecate Hue (if possible)
 DeclinedNoneT262183 Apply proper permissions to stat100x home directories
 ResolvedelukeyT268220 Refactor puppet profiles to reduce hiera pollution
 ResolvedelukeyT268801 Deprecate the 'researchers' posix group
 ResolvedelukeyT269150 Deprecate the anaytics-users POSIX group
 ResolvedBTullisT269925 Update Spicerack cookbooks to follow the new class API conventions

Event Timeline

elukey created this task.Dec 11 2019, 10:58 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 11 2019, 10:58 AM
elukey added a subtask: T238243: Archive /home/ezachte data on stat1007.Dec 11 2019, 10:59 AM
elukey added a subtask: T240422: Create user quotas for notebook100[3,4] to limit home directory size.Dec 11 2019, 11:03 AM
elukey added subtasks: T240255: an-coord1001 hive metastore not listening on ipv6, T234826: Repurpose db1108 as generic Analytics db replica.Dec 11 2019, 11:08 AM
• fdans added a project: Analytics-Kanban.Dec 23 2019, 5:07 PM
• fdans moved this task from Next Up to Parent Tasks on the Analytics-Kanban board.
• fdans moved this task from Incoming to Operational Excellence on the Analytics board.
elukey closed subtask T240255: an-coord1001 hive metastore not listening on ipv6 as Resolved.Jan 30 2020, 12:47 AM
elukey closed subtask T240440: Add CPU quota to stat and notebook hosts as Resolved.
elukey closed subtask T240422: Create user quotas for notebook100[3,4] to limit home directory size as Declined.Jan 30 2020, 12:59 AM
elukey changed the status of subtask T243934: Unify puppet roles for stat and notebook hosts from Open to Stalled.Mar 1 2020, 4:07 PM
elukey changed the status of subtask T243934: Unify puppet roles for stat and notebook hosts from Stalled to Open.Mar 10 2020, 3:47 PM
elukey added a subtask: T247084: Kerberos credential cache expiry time on notebook is different than the OS one.Mar 10 2020, 6:22 PM
Milimetric triaged this task as High priority.Apr 13 2020, 3:57 PM
elukey closed subtask T241040: Deprecate /mnt/hdfs from the Analytics infra as Declined.Apr 14 2020, 12:26 PM
elukey changed the status of subtask T234826: Repurpose db1108 as generic Analytics db replica from Open to Stalled.Apr 21 2020, 1:30 PM
elukey added a subtask: T245238: Remove references to m4-master.May 11 2020, 10:46 AM
elukey closed subtask T245238: Remove references to m4-master as Resolved.May 11 2020, 1:53 PM
• Nuria closed subtask T243934: Unify puppet roles for stat and notebook hosts as Resolved.Jun 3 2020, 2:57 PM
elukey changed the status of subtask T234826: Repurpose db1108 as generic Analytics db replica from Stalled to Open.Jun 16 2020, 7:15 AM
elukey closed subtask T255266: Separate Report Updater Jobs to dedicated VM as Declined.Jun 25 2020, 11:27 AM
elukey added a subtask: T258799: Deprecate Hue (if possible).Jul 24 2020, 2:27 PM
elukey closed subtask T258799: Deprecate Hue (if possible) as Declined.Sep 7 2020, 6:17 AM
• Nuria closed subtask T252617: Use types in Analytics Puppet classes/profiles/etc.. as Resolved.Sep 17 2020, 12:01 AM
elukey reopened subtask T252617: Use types in Analytics Puppet classes/profiles/etc.. as Open.Sep 17 2020, 7:13 AM
elukey closed subtask T255265: Create a small VM to host jobs/system timers currently running on stat1007 as Declined.Oct 7 2020, 2:45 PM
• Nuria closed subtask T234826: Repurpose db1108 as generic Analytics db replica as Resolved.Oct 12 2020, 5:30 PM
• fdans closed subtask T253957: Fix TLS certificate location and expire for Hadoop/Presto/etc.. and add alarms on TLS cert expiry as Resolved.Oct 29 2020, 9:22 PM
• fdans closed subtask T240439: Move https termination from nginx to envoy (if possible) as Resolved.Nov 16 2020, 3:51 PM
elukey closed subtask T262183: Apply proper permissions to stat100x home directories as Declined.Dec 2 2020, 8:17 AM
elukey added a subtask: T269150: Deprecate the anaytics-users POSIX group.
Ottomata added a subtask: T263972: Remove support for the (deprecated) Druid datasources (in favor of Druid Tables) on Superset.Jan 11 2021, 4:52 PM
• fdans closed subtask T269150: Deprecate the anaytics-users POSIX group as Resolved.Jan 25 2021, 7:00 PM
• fdans closed subtask T268220: Refactor puppet profiles to reduce hiera pollution as Resolved.
• fdans closed subtask T268801: Deprecate the 'researchers' posix group as Resolved.
• fdans closed subtask T257412: Review an-coord1001's usage and failover plans as Resolved.Apr 8 2021, 4:24 PM
elukey closed subtask T255262: Kerberos credential cache location as Declined.Jun 1 2021, 8:13 AM
BTullis closed subtask T269925: Update Spicerack cookbooks to follow the new class API conventions as Resolved.Aug 2 2021, 5:02 PM
odimitrijevic removed a subtask: T268985: Improve user experience for Kerberos by creating automatic token renewal service.Oct 27 2021, 11:15 PM
odimitrijevic closed this task as Resolved.Oct 27 2021, 11:22 PM
odimitrijevic claimed this task.
odimitrijevic removed a subtask: T263972: Remove support for the (deprecated) Druid datasources (in favor of Druid Tables) on Superset.
odimitrijevic removed a subtask: T252617: Use types in Analytics Puppet classes/profiles/etc...
odimitrijevic removed a subtask: T238243: Archive /home/ezachte data on stat1007.
odimitrijevic subscribed.

Closing long standing catch all task

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits