Page MenuHomePhabricator
Create Task
Maniphest T336385

Edit Analytics: Deploy to staging and production
Closed, ResolvedPublic3 Estimated Story Points
Actions

Description

Subtask of epic T327817

Required:

  • Add blubber and pipeline configuration to service repo
  • Integrate service image building in CI pipeline
  • Add service druid user
  • Add k8s secrets
  • Create deployment-charts helmfile.d configuration entries
  • Add service catalogue entry for service
  • Run smoke tests against staging and certify service is working properly
  • Deploy service to LVS in state service_setup
  • Move service lvs_setup in LVS
  • Move service production in LVS
  • Add service to the API Gateway
  • Route public requests via ATS

Related Tasks:

T288661: Create k8s deployment of AQS 2.0

Details

Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 StalledNoneT324931 Clean up open RESTBase related tickets
 In ProgressNoneT262315 <CORE TECHNOLOGY> API Migration & RESTbase Sunset
 In ProgressNoneT263489 AQS 2.0
 ResolvedNoneT327817 Edit Analytics Service
 ResolvedhnowlanT336385 Edit Analytics: Deploy to staging and production

Event Timeline

BPirkle created this task.May 10 2023, 1:45 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 10 2023, 1:45 PM
BPirkle updated the task description. (Show Details)May 10 2023, 1:46 PM
BPirkle added a parent task: T327817: Edit Analytics Service.
JArguello-WMF assigned this task to hnowlan.Jun 8 2023, 11:57 AM
JArguello-WMF edited projects, added AQS2.0 (Sprint 10); removed API Platform (AQS 2.0 Roadmap).
JArguello-WMF updated the task description. (Show Details)
JArguello-WMF added subscribers: VirginiaPoundstone, FJoseph-WMF, SGupta-WMF and 3 others.
JArguello-WMF mentioned this in T327817: Edit Analytics Service.Jun 8 2023, 12:07 PM
hnowlan updated the task description. (Show Details)Sep 28 2023, 11:30 AM

Please let me know which Cassandra tables the service will require access to

gerritbot added a comment.Sep 28 2023, 11:41 AM

Change 961774 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] k8s, cassandra: add entries for {edit,editor,page}-analytics

https://gerrit.wikimedia.org/r/961774

gerritbot added a project: Patch-For-Review.Sep 28 2023, 11:41 AM
Sfaci added a comment.EditedSep 28 2023, 11:43 AM
  • edit and editors are Druid-based services. For that services I think you only need the Druid datasource/table name and it's already included in the config service file. Is that enough for you?
Sfaci edited projects, added Data Products (Sprint 01); removed AQS2.0 (Sprint 10).Sep 28 2023, 11:51 AM
Sfaci moved this task from Sprint Backlog to In Process on the Data Products (Sprint 01) board.
gerritbot added a comment.Sep 28 2023, 11:54 AM

Change 961777 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[integration/config@master] jjb: add editor-analytics, edit-analytics and page-analytics

https://gerrit.wikimedia.org/r/961777

gerritbot added a comment.Sep 28 2023, 11:55 AM

Change 961778 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[integration/config@master] zuul: add edit-analytics and page-analytics

https://gerrit.wikimedia.org/r/961778

gerritbot added a comment.Sep 28 2023, 12:06 PM

Change 961782 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/deployment-charts@master] admin: add namespaces for remaining aqs2 services, add config for page-analytics

https://gerrit.wikimedia.org/r/961782

gerritbot added a comment.Sep 28 2023, 12:25 PM

Change 961786 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/deployment-charts@master] Add druid-http-gateway chart

https://gerrit.wikimedia.org/r/961786

gerritbot added a comment.Sep 29 2023, 11:48 AM

Change 961777 merged by jenkins-bot:

[integration/config@master] jjb: add editor-analytics, edit-analytics and page-analytics

https://gerrit.wikimedia.org/r/961777

gerritbot added a comment.Sep 29 2023, 11:57 AM

Change 961778 merged by jenkins-bot:

[integration/config@master] zuul: add edit-analytics and page-analytics

https://gerrit.wikimedia.org/r/961778

Stashbot mentioned this in T336415: Editor analytics service: Configure routing in staging and production.Sep 29 2023, 11:58 AM
Stashbot mentioned this in T336391: AQS 2.0: Page Analytics Service: Deploy to staging and production.

Mentioned in SAL (#wikimedia-releng) [2023-09-29T11:58:47Z] <hashar> Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/961778 "add edit-analytics and page-analytics" T336391 T336385 T336415

gerritbot added a comment.Oct 2 2023, 10:50 AM

Change 961774 merged by Hnowlan:

[operations/puppet@production] k8s, cassandra: add entries for {edit,editor,page}-analytics

https://gerrit.wikimedia.org/r/961774

gerritbot added a comment.Oct 2 2023, 10:50 AM

Change 962570 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] service: add {edit,editor,page}-analytics services

https://gerrit.wikimedia.org/r/962570

gerritbot added a comment.Oct 2 2023, 11:34 AM

Change 961782 merged by jenkins-bot:

[operations/deployment-charts@master] admin: add namespaces for remaining aqs2 services, add config for page-analytics

https://gerrit.wikimedia.org/r/961782

gerritbot added a comment.Oct 2 2023, 1:40 PM

Change 961786 merged by jenkins-bot:

[operations/deployment-charts@master] Add druid-http-gateway chart

https://gerrit.wikimedia.org/r/961786

Sfaci edited projects, added Data Products (Sprint 02); removed Data Products (Sprint 01).Oct 3 2023, 1:39 PM
Sfaci moved this task from Sprint Backlog to In Process on the Data Products (Sprint 02) board.
FJoseph-WMF unsubscribed.Oct 3 2023, 2:27 PM
gerritbot added a comment.Oct 3 2023, 3:15 PM

Change 963086 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/deployment-charts@master] helmfile: add edit-analytics and editor-analytics

https://gerrit.wikimedia.org/r/963086

gerritbot added a comment.Oct 3 2023, 3:46 PM

Change 963086 merged by jenkins-bot:

[operations/deployment-charts@master] helmfile: add edit-analytics and editor-analytics

https://gerrit.wikimedia.org/r/963086

Sfaci merged a task: T336404: Edit Analytics: Configure routing in staging and production.Oct 3 2023, 4:38 PM
Sfaci added a subscriber: FJoseph-WMF.
gerritbot added a comment.Oct 3 2023, 4:44 PM

Change 963104 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/deployment-charts@master] edit-analytics, editor-analytics: correct networkpolicy

https://gerrit.wikimedia.org/r/963104

gerritbot added a comment.Oct 3 2023, 4:54 PM

Change 963106 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/dns@master] wmnet: add records for edit-, editor- and page-analytics

https://gerrit.wikimedia.org/r/963106

gerritbot added a comment.Oct 3 2023, 5:00 PM

Change 963104 merged by jenkins-bot:

[operations/deployment-charts@master] edit-analytics, editor-analytics: correct networkpolicy

https://gerrit.wikimedia.org/r/963104

FJoseph-WMF unsubscribed.Oct 3 2023, 5:11 PM
gerritbot added a comment.Oct 4 2023, 11:12 AM

Change 963106 merged by Hnowlan:

[operations/dns@master] wmnet: add records for edit-, editor- and page-analytics

https://gerrit.wikimedia.org/r/963106

gerritbot added a comment.Oct 4 2023, 11:34 AM

Change 962570 merged by Hnowlan:

[operations/puppet@production] service: add {edit,editor,page}-analytics services

https://gerrit.wikimedia.org/r/962570

Maintenance_bot removed a project: Patch-For-Review.Oct 4 2023, 12:10 PM
gerritbot added a comment.Oct 6 2023, 4:58 PM

Change 964044 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/deployment-charts@master] rest-gateway: route edit-,editor- and page-analytics

https://gerrit.wikimedia.org/r/964044

gerritbot added a project: Patch-For-Review.Oct 6 2023, 4:58 PM
gerritbot added a comment.Oct 10 2023, 12:26 PM

Change 964044 merged by jenkins-bot:

[operations/deployment-charts@master] rest-gateway: route edit-,editor- and page-analytics

https://gerrit.wikimedia.org/r/964044

Maintenance_bot removed a project: Patch-For-Review.Oct 10 2023, 12:30 PM
gerritbot added a comment.Oct 10 2023, 2:37 PM

Change 964923 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] service: change state to production for {edit,editor,page}-analytics

https://gerrit.wikimedia.org/r/964923

gerritbot added a project: Patch-For-Review.Oct 10 2023, 2:37 PM
gerritbot added a comment.Oct 10 2023, 3:08 PM

Change 964923 merged by Hnowlan:

[operations/puppet@production] service: change state to production for {edit,editor,page}-analytics

https://gerrit.wikimedia.org/r/964923

Maintenance_bot removed a project: Patch-For-Review.Oct 10 2023, 3:10 PM
WDoranWMF set the point value for this task to 3.Oct 17 2023, 11:07 AM
WDoranWMF moved this task from In Process to BLOCKED on the Data Products (Sprint 02) board.Oct 17 2023, 12:19 PM
gerritbot added a comment.Oct 18 2023, 3:18 PM

Change 966885 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] trafficserver: route all requests for /api/rest_v1/metrics to rest-gateway

https://gerrit.wikimedia.org/r/966885

gerritbot added a project: Patch-For-Review.Oct 18 2023, 3:18 PM
hnowlan updated the task description. (Show Details)Oct 18 2023, 3:20 PM
WDoranWMF moved this task from BLOCKED to Teleport to Sprint 03 on the Data Products (Sprint 02) board.Oct 24 2023, 12:23 PM
WDoranWMF edited projects, added Data Products (Data Products (Sprint 03)); removed Data Products (Sprint 02).
VirginiaPoundstone triaged this task as Low priority.Oct 30 2023, 7:42 PM
VirginiaPoundstone raised the priority of this task from Low to High.
gerritbot added a comment.Oct 31 2023, 12:50 PM

Change 970367 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] trafficserver: route edit-analytics service via rest-gateway

https://gerrit.wikimedia.org/r/970367

gerritbot added a comment.Nov 2 2023, 3:06 PM

Change 970367 merged by Hnowlan:

[operations/puppet@production] trafficserver: route edit-analytics service via rest-gateway

https://gerrit.wikimedia.org/r/970367

gerritbot added a comment.Nov 2 2023, 4:16 PM

Change 971226 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] trafficserver: correct pathing for some AQS routes

https://gerrit.wikimedia.org/r/971226

gerritbot added a comment.Nov 2 2023, 4:27 PM

Change 971226 merged by Hnowlan:

[operations/puppet@production] trafficserver: correct pathing for some AQS routes

https://gerrit.wikimedia.org/r/971226

VirginiaPoundstone moved this task from Sprint Backlog to Done on the Data Products (Data Products (Sprint 03)) board.Nov 8 2023, 5:24 PM
hnowlan closed this task as Resolved.Nov 9 2023, 5:46 PM
hnowlan updated the task description. (Show Details)
gerritbot added a comment.Dec 14 2023, 10:47 AM

Change 966885 merged by Hnowlan:

[operations/puppet@production] trafficserver: route all requests for /api/rest_v1/metrics to rest-gateway

https://gerrit.wikimedia.org/r/966885

Maintenance_bot removed a project: Patch-For-Review.Dec 14 2023, 11:10 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL