Page MenuHomePhabricator
Create Task
Maniphest T266703

Deploy query builder to microsites (on top of the wdqs-ui)
Closed, ResolvedPublic8 Estimated Story Points
Actions

Description

In T264710#6562678, T264710#6573814 and T264710#6586070 as part of T264710: Host static sites on kubernetes it was decided that the query ui and querybuilder ui would be deployed on the "static sites" infrastructure. See https://wikitech.wikimedia.org/wiki/Microsites

This ticket currently serves as a placeholder for the Wikidata Query Builder team to use when needed.

The wdqs GUI was moved to microsites in T266702: Move WDQS UI to microsites
Similar steps will be needed for the querybuilder deployment.
Per Lydia in T266703#6590996 the querybuilder will need to live at /srv/org/wikidata/query/querybuilder

Predicted general path to deployment:

  • Deal with follow-ups from the security review T264822
  • Create a repository containing the built code to be deployed (and needed infrastructure / build process around that)
  • Puppet change adding the site to microsites
  • Test that the site is accessible inside the cluster
  • Change the traffic layer so that public access is given at the correct path for the site
  • Puppet tests for the microsite
  • Update microsites docs page on wikitech stating this site is deployed on microsites

Acceptance Criteria:

  • querybuilder is deployed to production

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 28 2020, 7:55 PM
Addshore added a project: User-Addshore.Oct 28 2020, 7:57 PM
Addshore updated the task description. (Show Details)Oct 29 2020, 7:52 PM
Addshore added a subscriber: Lydia_Pintscher.

@Lydia_Pintscher Do we want to serve the querybuilder under query.wikidata.org? or under some other domain?

Lydia_Pintscher added a comment.Oct 30 2020, 11:52 AM
In T266703#6589779, @Addshore wrote:

@Lydia_Pintscher Do we want to serve the querybuilder under query.wikidata.org? or under some other domain?

My plan was to put it at query.wikidata.org/querybuilder or somesuch.

Addshore updated the task description. (Show Details)Oct 30 2020, 4:58 PM
Dzahn added a comment.Nov 3 2020, 2:25 AM

See progress in T266702#6592812 From deployment and other internal servers you can already talk to query.wikidata.org on miscweb, it serves what is in the deploy repo but see follow-up comments. And of course would be pending an ATS change before getting any traffic from external.

Addshore added a comment.Nov 6 2020, 12:54 PM

@Dzahn so the "querybuilder" is a separate frontend, that we would want to deploy to query.wikidata.org/querybuilder.
Do you have any views on the 2 "possible approaches" that are detailed in this ticket description?

Dzahn added a comment.EditedNov 8 2020, 2:56 PM

@Addshore It's easiest if there are 2 separate deploy repos and both also do not live inside each other. 2 repos that git clone into 2 separate directories both under /srv/org/wikidata but on the same hierarchy level. Then the webserver config can map their docroots to desired URLs.

P.S. I'm currently on vacation until Nov 16.

jijiki triaged this task as Medium priority.Nov 10 2020, 4:22 PM
Addshore updated the task description. (Show Details)Jan 18 2021, 1:15 PM
Dzahn added a comment.Jan 18 2021, 5:56 PM

@Addshore I think all the check boxes (except maybe the last one) on this ticket are already done?

Addshore added a comment.Jan 18 2021, 7:53 PM
In T266703#6756059, @Dzahn wrote:

@Addshore I think all the check boxes (except maybe the last one) on this ticket are already done?

This ticket is for a different application / site yet to be deployed :)

Addshore added subscribers: guergana.tzatchkova, Michael.Apr 8 2021, 9:46 AM
Restricted Application added a project: [DEPRECATED] wdwb-tech. · View Herald TranscriptApr 8 2021, 9:46 AM
Addshore moved this task from Inbox to Blocked on the [DEPRECATED] wdwb-tech board.Apr 8 2021, 9:47 AM
Michael changed the task status from Open to Stalled.Apr 8 2021, 10:03 AM

This is blocked by T264822: (MS 7) Security Readiness Review For Wikidata Query Builder

Michael renamed this task from Deploy WDQS query builder to microsites to 🛑 Deploy WDQS query builder to microsites.Apr 8 2021, 10:03 AM
Michael added a subtask: T264822: (MS 7) Security Readiness Review For Wikidata Query Builder.
Addshore moved this task from Unsorted 💣 to Watching 👀 on the User-Addshore board.Apr 15 2021, 2:29 PM
gerritbot added a comment.Jun 18 2021, 8:09 AM

Change 700317 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):

[operations/puppet@production] microsites: Add Query Builder subpage to wdqs gui

https://gerrit.wikimedia.org/r/700317

gerritbot added a project: Patch-For-Review.Jun 18 2021, 8:09 AM
Ladsgroup subscribed.Jun 18 2021, 8:13 AM
Addshore mentioned this in T285761: Add proper security headers to Query Builder.Jul 19 2021, 2:10 PM
Manuel added a project: Wikidata-Campsite.Jul 26 2021, 9:20 AM
Manuel subscribed.
gerritbot added a comment.Jul 28 2021, 6:10 AM

Change 708398 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):

[integration/config@master] jjb: [wikidata] Introduce new job wikidata-query-gui-build

https://gerrit.wikimedia.org/r/708398

gerritbot added a comment.Jul 28 2021, 6:35 AM

Change 708460 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):

[wikidata/query-builder/deploy@master] Add .gitreview

https://gerrit.wikimedia.org/r/708460

gerritbot added a comment.Jul 28 2021, 6:35 AM

Change 708461 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):

[wikidata/query-builder/deploy@master] Initial build

https://gerrit.wikimedia.org/r/708461

Manuel moved this task from Incoming to Unconnected Stories on the Wikidata-Campsite board.Jul 28 2021, 8:45 AM
Addshore moved this task from Blocked to Product Realm on the [DEPRECATED] wdwb-tech board.Jul 28 2021, 10:21 AM
Addshore updated the task description. (Show Details)Jul 28 2021, 10:26 AM
Addshore changed the task status from Stalled to Open.Jul 28 2021, 10:30 AM
Addshore set the point value for this task to 8.
Michael renamed this task from 🛑 Deploy WDQS query builder to microsites to Deploy WDQS query builder to microsites.Jul 28 2021, 10:32 AM
Addshore moved this task from Unconnected Stories to Wikidata-Campsite-Iteration-∞ (On Hold) on the Wikidata-Campsite board.Jul 28 2021, 10:43 AM
Addshore edited projects, added Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)); removed Wikidata-Campsite.
Ladsgroup claimed this task.Jul 28 2021, 10:46 AM
Ladsgroup moved this task from To Do (prioritised from top to bottom) to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.

I'm doing this already. Slow and steady.

Restricted Application added a project: User-Ladsgroup. · View Herald TranscriptJul 28 2021, 10:46 AM
Ladsgroup moved this task from Doing to Peer Review on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Jul 28 2021, 10:46 AM
Addshore renamed this task from Deploy WDQS query builder to microsites to Deploy query builder to microsites (on top of the wdqs-ui).Jul 28 2021, 10:48 AM
gerritbot added a comment.Jul 29 2021, 4:55 AM

Change 708460 merged by Ladsgroup:

[wikidata/query-builder/deploy@master] Add .gitreview

https://gerrit.wikimedia.org/r/708460

gerritbot added a comment.Jul 29 2021, 4:55 AM

Change 708461 merged by Ladsgroup:

[wikidata/query-builder/deploy@master] Initial build

https://gerrit.wikimedia.org/r/708461

gerritbot added a comment.Jul 29 2021, 5:27 AM

Change 708629 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):

[wikidata/query-builder/deploy@production] Initial build

https://gerrit.wikimedia.org/r/708629

gerritbot added a comment.Jul 30 2021, 10:42 AM

Change 708398 merged by jenkins-bot:

[integration/config@master] jjb: [wikidata] Introduce new job wikidata-query-builder-build

https://gerrit.wikimedia.org/r/708398

sbassett closed subtask T264822: (MS 7) Security Readiness Review For Wikidata Query Builder as Resolved.Aug 13 2021, 7:16 PM
gerritbot added a comment.Aug 13 2021, 7:55 PM

Change 708629 merged by Ladsgroup:

[wikidata/query-builder/deploy@production] Initial build

https://gerrit.wikimedia.org/r/708629

gerritbot added a comment.Aug 16 2021, 2:41 PM

Change 700317 merged by Dzahn:

[operations/puppet@production] microsites: Add Query Builder subpage to wdqs gui

https://gerrit.wikimedia.org/r/700317

Stashbot added a comment.Aug 16 2021, 2:42 PM

Mentioned in SAL (#wikimedia-operations) [2021-08-16T14:42:15Z] <mutante> miscweb - deploying new microsite for Wikidata Query Builder subpage (T266703)

gerritbot added a comment.Aug 16 2021, 2:56 PM

Change 713270 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] wdqs: sync query.wikidata.org preview config with prod config

https://gerrit.wikimedia.org/r/713270

gerritbot added a comment.Aug 16 2021, 3:21 PM

Change 713280 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[wikidata/query-builder@master] Change config and variables to actual production

https://gerrit.wikimedia.org/r/713280

gerritbot added a comment.Aug 16 2021, 3:28 PM

Change 713280 merged by jenkins-bot:

[wikidata/query-builder@master] Change config and variables to actual production

https://gerrit.wikimedia.org/r/713280

gerritbot added a comment.Aug 16 2021, 3:34 PM

Change 713282 had a related patch set uploaded (by WDQSGuiBuilder; author: WDQSGuiBuilder):

[wikidata/query-builder/deploy@production] Merging from 0f041142a6c16f6b37fdfeebe53694da149745c2

https://gerrit.wikimedia.org/r/713282

gerritbot added a comment.Aug 16 2021, 3:42 PM

Change 713285 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[integration/config@master] jjb: [wikidata] check out to production branch in build

https://gerrit.wikimedia.org/r/713285

gerritbot added a comment.Aug 16 2021, 3:49 PM

Change 713287 had a related patch set uploaded (by WDQSGuiBuilder; author: WDQSGuiBuilder):

[wikidata/query-builder/deploy@production] Merging from 0f041142a6c16f6b37fdfeebe53694da149745c2

https://gerrit.wikimedia.org/r/713287

gerritbot added a comment.Aug 16 2021, 3:50 PM

Change 713287 merged by Ladsgroup:

[wikidata/query-builder/deploy@production] Merging from 0f041142a6c16f6b37fdfeebe53694da149745c2

https://gerrit.wikimedia.org/r/713287

gerritbot added a comment.Aug 16 2021, 3:52 PM

Change 713282 abandoned by Ladsgroup:

[wikidata/query-builder/deploy@production] Merging from 0f041142a6c16f6b37fdfeebe53694da149745c2

Reason:

https://gerrit.wikimedia.org/r/713282

gerritbot added a comment.Aug 16 2021, 3:53 PM

Change 713285 merged by jenkins-bot:

[integration/config@master] jjb: [wikidata] check out to production branch in build

https://gerrit.wikimedia.org/r/713285

gerritbot added a comment.Aug 16 2021, 4:00 PM

Change 713289 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[wikidata/query-builder@master] Do not append protocol to the short url

https://gerrit.wikimedia.org/r/713289

Dzahn added a comment.Aug 16 2021, 4:06 PM

https://query.wikidata.org/querybuilder/ works now

gerritbot added a comment.Aug 16 2021, 4:52 PM

Change 713270 merged by Dzahn:

[operations/puppet@production] wdqs: sync query.wikidata.org preview config with prod config

https://gerrit.wikimedia.org/r/713270

gerritbot added a comment.Aug 16 2021, 4:52 PM

Change 713289 merged by jenkins-bot:

[wikidata/query-builder@master] Do not append protocol to the short url

https://gerrit.wikimedia.org/r/713289

gerritbot added a comment.Aug 16 2021, 5:08 PM

Change 713297 had a related patch set uploaded (by WDQSGuiBuilder; author: WDQSGuiBuilder):

[wikidata/query-builder/deploy@production] Merging from 1a10aa55244284eb87851bcc7c141e682597499d

https://gerrit.wikimedia.org/r/713297

gerritbot added a comment.Aug 16 2021, 5:09 PM

Change 713297 merged by Ladsgroup:

[wikidata/query-builder/deploy@production] Merging from 1a10aa55244284eb87851bcc7c141e682597499d

https://gerrit.wikimedia.org/r/713297

gerritbot added a comment.Aug 16 2021, 6:47 PM

Change 713306 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[wikidata/query-builder@master] Document deploying to production

https://gerrit.wikimedia.org/r/713306

gerritbot added a comment.Aug 17 2021, 11:57 AM

Change 713454 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/puppet@production] wdqs: Avoid add trailing slash for querybuilder

https://gerrit.wikimedia.org/r/713454

Ladsgroup updated the task description. (Show Details)Aug 17 2021, 11:59 AM
gerritbot added a comment.Aug 17 2021, 12:37 PM

Change 713461 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[wikidata/query/gui@master] Change path of QueryBuilder for metric gathering to production

https://gerrit.wikimedia.org/r/713461

gerritbot added a comment.Aug 17 2021, 12:51 PM

Change 713461 merged by jenkins-bot:

[wikidata/query/gui@master] Change path of QueryBuilder for metric gathering to production

https://gerrit.wikimedia.org/r/713461

Ladsgroup mentioned this in rWDQGe1c99fa2b8d2: Change path of QueryBuilder for metric gathering to production.Aug 17 2021, 12:53 PM
gerritbot added a comment.Aug 17 2021, 3:50 PM

Change 713454 merged by Effie Mouzeli:

[operations/puppet@production] wdqs: Avoid add trailing slash for querybuilder

https://gerrit.wikimedia.org/r/713454

Ladsgroup updated the task description. (Show Details)Aug 17 2021, 4:54 PM
gerritbot added a comment.Aug 17 2021, 5:03 PM

Change 713497 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/puppet@production] miscweb: Add query builder to monitoring probes

https://gerrit.wikimedia.org/r/713497

gerritbot added a comment.Aug 17 2021, 5:27 PM

Change 713497 merged by Dzahn:

[operations/puppet@production] miscweb: Add query builder to monitoring probes

https://gerrit.wikimedia.org/r/713497

Addshore added a comment.Aug 18 2021, 8:18 AM

Macro seal-of-approval:

Ladsgroup added a comment.Aug 18 2021, 9:55 AM

Only https://gerrit.wikimedia.org/r/c/wikidata/query-builder/+/713306 is waiting to be merged and then it can go to test verification

gerritbot added a comment.Aug 18 2021, 11:51 AM

Change 713306 merged by jenkins-bot:

[wikidata/query-builder@master] Document deploying to production

https://gerrit.wikimedia.org/r/713306

Ladsgroup moved this task from Peer Review to Test (Verification) on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Aug 18 2021, 11:52 AM
Ladsgroup updated the task description. (Show Details)
Addshore closed this task as Resolved.Aug 24 2021, 12:08 PM
Lucas_Werkmeister_WMDE mentioned this in T330752: Remove master branch from wikidata/query-builder/deploy.git.Feb 28 2023, 1:54 PM
Maintenance_bot removed a project: Patch-For-Review.Feb 28 2023, 2:12 PM
Maintenance_bot moved this task from incoming to in progress on the Wikidata board.Feb 28 2023, 2:15 PM
Maintenance_bot moved this task from Test (Verification) to Done on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL