Page MenuHomePhabricator
Create Task
Maniphest T333656

Decommission query-preview.wikidata.org
Closed, ResolvedPublic
Actions

Description

query-preview was exposed publicly to help our users test the impact of the Streaming Updater back in October 2021. Now that this roll out is completed, we should close that end point (but keep the backend server running for internal testing). This will reduce confusion within our team, but also for our users and for the larger SRE teams.

AC:

  • query-preview is no longer accessible
  • supporting code and configuration is removed, not exhaustive list:
  • DNS configuration
  • Traffic / caching configuration (ATS)
  • removed from http blackbox tests
  • not in monitoring
  • removed from profile::microsites::query_service
  • customization of UI
  • TLS cert and associated cergen config (puppet private repo)

Details

SubjectRepoBranchLines +/-
wdqs: remove query-preview micrositeoperations/puppetproduction+0 -9
httpbb: remove query-preview.wikidata.from tests for miscweboperations/puppetproduction+0 -5
delete query-preview.wikidata.orgoperations/dnsmaster+0 -1
microsites/query_service: remove query-preview.wikidata.orgoperations/puppetproduction+0 -5
ATS: remove map for query-preview.wikidata.orgoperations/puppetproduction+0 -9
wdqs/wcqs: switch query.wikidata.org and wcqs to bullseye backendsoperations/puppetproduction+4 -4
trafficserver/wdqs: switch query-preview.wikidata.org to new backendoperations/puppetproduction+2 -2
Customize query in gerrit

Event Timeline

Gehel created this task.Mar 31 2023, 9:04 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 31 2023, 9:04 AM
Maintenance_bot added a project: Wikidata.Mar 31 2023, 9:29 AM
Dzahn added a project: collaboration-services.Mar 31 2023, 3:57 PM
RKemper subscribed.Apr 3 2023, 3:41 PM
Gehel triaged this task as High priority.Apr 3 2023, 3:41 PM
Gehel moved this task from Incoming to Operations/SRE on the Wikidata-Query-Service board.
gerritbot added a comment.Apr 3 2023, 9:01 PM

Change 905292 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] trafficserver/wdqs: switch query-preview.wikidata.org to new backend

https://gerrit.wikimedia.org/r/905292

gerritbot added a project: Patch-For-Review.Apr 3 2023, 9:01 PM
gerritbot added a comment.Apr 3 2023, 9:31 PM

Change 905317 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] wdqs/wcqs: switch query.wikidata.org and wcqs to bullseye backends

https://gerrit.wikimedia.org/r/905317

gerritbot added a comment.Apr 3 2023, 9:46 PM

Change 905292 merged by Dzahn:

[operations/puppet@production] trafficserver/wdqs: switch query-preview.wikidata.org to new backend

https://gerrit.wikimedia.org/r/905292

RKemper renamed this task from Decommission query-preview.wikdiata.org to Decommission query-preview.wikidata.org.Apr 3 2023, 9:51 PM
Dzahn subscribed.Apr 3 2023, 10:11 PM

We switched this from eqiad to codfw and from buster to bullseye - There was no need to rush the decom but we wanted to get off of buster.

I think I also misunderstood this ticket at first but we chatted on IRC now.

So.. if you really want this removed from the miscweb* backends and everything about it is gone from wdqs* machines.. it's ok to simply assign this to me. I will gladly clean up the miscweb* part since I am alreayd working on these anyways.

Restricted Application added a comment. · View Herald TranscriptApr 3 2023, 10:11 PM

Hi and thank you for your interest! Please check thoroughly https://www.mediawiki.org/wiki/New_Developers (and all of its communication section!). The page covers how to get started, assigning tasks, task status, how to find a codebase, how to create patches, where to ask general development questions and where to get help with setup problems, and how to ask good questions. Thanks a lot! :)

Dzahn added a comment.Apr 3 2023, 10:17 PM

@Gehel Happy to work on this. how about this:

  • query-preview is no longer accessible (I remove it from DNS)
  • DNS configuration (same as above)
  • Traffic / caching configuration (dont worry, I'll do that)
  • Apache config on backend, monitoring, logging (don't worry, I'll do that)
  • customization of UI (that's for you?)
  • anything on wdqs* machines or in documentation on public wikis (that's for your team)
gerritbot added a comment.Apr 4 2023, 7:52 PM

Change 905317 merged by Dzahn:

[operations/puppet@production] wdqs/wcqs: switch query.wikidata.org and wcqs to bullseye backends

https://gerrit.wikimedia.org/r/905317

Maintenance_bot removed a project: Patch-For-Review.Apr 4 2023, 8:11 PM
gerritbot added a comment.Apr 4 2023, 9:49 PM

Change 905754 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/dns@master] delete query-preview.wikidata.org

https://gerrit.wikimedia.org/r/905754

gerritbot added a project: Patch-For-Review.Apr 4 2023, 9:49 PM
Lydia_Pintscher moved this task from incoming to monitoring on the Wikidata board.Apr 6 2023, 10:08 AM
Dzahn added a subscriber: Lydia_Pintscher.Apr 6 2023, 5:12 PM

@Lydia_Pintscher Any concerns or thoughts on the removal of query-preview.wikidata.org from your side? cheers

Lydia_Pintscher added a comment.Apr 6 2023, 7:11 PM

All good from my side :)

Dzahn added a comment.Apr 6 2023, 7:35 PM

Thank you, I will wait for ack from Gehel and if so just remove it from DNS which is simple to revert. Then after that the other decom steps can follow.

Dzahn moved this task from Incoming to Work in Progress on the collaboration-services board.Apr 7 2023, 6:31 PM
Dzahn added a comment.Apr 11 2023, 8:49 PM

hi @RKemper was wondering if you can bring this one up in your team meeting or so (no rush, but would be nice to have): https://gerrit.wikimedia.org/r/c/operations/dns/+/905754 cheers, Daniel

RKemper added a comment.Apr 12 2023, 8:33 PM
In T333656#8773505, @Dzahn wrote:

hi @RKemper was wondering if you can bring this one up in your team meeting or so (no rush, but would be nice to have): https://gerrit.wikimedia.org/r/c/operations/dns/+/905754 cheers, Daniel

Thanks Daniel.

Yeah, I think we're good to merge this whenever. I'll take a look at merging it tomorrow (Thurs) if it still needs to be.

As for the following bullet points (quoted below for convenience), I think these sound sensible to me as far as divying up the work:

query-preview is no longer accessible (I remove it from DNS)
DNS configuration (same as above)
Traffic / caching configuration (dont worry, I'll do that)
Apache config on backend, monitoring, logging (don't worry, I'll do that)
customization of UI (that's for you?)
anything on wdqs* machines or in documentation on public wikis (that's for your team)
Dzahn added a comment.Apr 12 2023, 8:59 PM

Thank you, Ryan, sounds good !:)

Dzahn claimed this task.Apr 12 2023, 8:59 PM
gerritbot added a comment.Apr 13 2023, 9:16 PM

Change 908631 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] ATS: remove map for query-preview.wikidata.org

https://gerrit.wikimedia.org/r/908631

gerritbot added a comment.Apr 13 2023, 9:19 PM

Change 908631 merged by Dzahn:

[operations/puppet@production] ATS: remove map for query-preview.wikidata.org

https://gerrit.wikimedia.org/r/908631

Stashbot added a comment.Apr 13 2023, 9:28 PM

Mentioned in SAL (#wikimedia-operations) [2023-04-13T21:28:00Z] <mutante> https://query-preview.wikidata.org has been deactivated at ATS layer - T333656

Dzahn updated the task description. (Show Details)Apr 13 2023, 9:31 PM

We have deactivated the service at the caching layer (Apache Traffic Server) first.

Now https://query-preview.wikidata.org redirects to https://wikidata.org due to some rewrite rule.

We are going to delete it from DNS next though.

gerritbot added a comment.Apr 13 2023, 9:41 PM

Change 908633 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] httpbb: remove query-preview.wikidata.from tests for miscweb

https://gerrit.wikimedia.org/r/908633

RKemper updated the task description. (Show Details)Apr 13 2023, 9:41 PM
gerritbot added a comment.Apr 13 2023, 9:43 PM

Change 908633 merged by Dzahn:

[operations/puppet@production] httpbb: remove query-preview.wikidata.from tests for miscweb

https://gerrit.wikimedia.org/r/908633

gerritbot added a comment.Apr 13 2023, 9:46 PM

Change 908634 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] microsites/query_service: remove query-preview.wikidata.org

https://gerrit.wikimedia.org/r/908634

Dzahn updated the task description. (Show Details)Apr 13 2023, 9:49 PM
Dzahn updated the task description. (Show Details)
gerritbot added a comment.Apr 13 2023, 9:51 PM

Change 908635 had a related patch set uploaded (by Ryan Kemper; author: Ryan Kemper):

[operations/puppet@production] wdqs: remove query-preview microsite

https://gerrit.wikimedia.org/r/908635

gerritbot added a comment.Apr 13 2023, 9:53 PM

Change 908634 abandoned by Dzahn:

[operations/puppet@production] microsites/query_service: remove query-preview.wikidata.org

Reason:

duplicates https://gerrit.wikimedia.org/r/c/operations/puppet/+/908635/

https://gerrit.wikimedia.org/r/908634

gerritbot added a comment.Apr 13 2023, 9:57 PM

Change 905754 merged by Ryan Kemper:

[operations/dns@master] delete query-preview.wikidata.org

https://gerrit.wikimedia.org/r/905754

Stashbot added a comment.Apr 13 2023, 10:00 PM

Mentioned in SAL (#wikimedia-operations) [2023-04-13T22:00:30Z] <ryankemper> T333656 ryankemper@dns1001:~$ sudo -i authdns-update after merge of https://gerrit.wikimedia.org/r/905754 => OK - authdns-update successful on all nodes!

RKemper updated the task description. (Show Details)Apr 13 2023, 10:04 PM
gerritbot added a comment.Apr 13 2023, 10:11 PM

Change 908635 merged by Ryan Kemper:

[operations/puppet@production] wdqs: remove query-preview microsite

https://gerrit.wikimedia.org/r/908635

Dzahn reassigned this task from Dzahn to RKemper.EditedApr 13 2023, 10:25 PM

It was nice working with Ryan today on getting this decom'ed.

We did almost all the steps and all done from my side and my team will like this. Thank you.

Handing over for some minor follow-up. By all practical means this is done though. Service is gone from production.

(also double checked that puppet alone, without manual restarts, actually removes the virtual host from the running apaches on miscweb)

Dzahn lowered the priority of this task from High to Medium.Apr 13 2023, 10:27 PM
Maintenance_bot removed a project: Patch-For-Review.Apr 13 2023, 10:30 PM
Gehel added a project: Discovery-Search (Current work).Apr 20 2023, 7:12 PM
Gehel moved this task from Incoming to Blocked/Waiting on the Discovery-Search (Current work) board.
Gehel moved this task from Blocked/Waiting to In Progress on the Discovery-Search (Current work) board.May 2 2023, 8:27 AM
Gehel added a project: Data-Platform-SRE.
Gehel moved this task from Incoming to In Progress on the Data-Platform-SRE board.
Gehel updated the task description. (Show Details)May 4 2023, 6:51 PM
Gehel moved this task from In Progress to Needs Reporting on the Discovery-Search (Current work) board.
RKemper updated the task description. (Show Details)May 4 2023, 6:51 PM
Gehel closed this task as Resolved.May 5 2023, 9:53 AM
Gehel moved this task from In Progress to Done on the Data-Platform-SRE board.Jul 19 2023, 8:53 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL