Page MenuHomePhabricator
Create Task
Maniphest T356530

clean up phabricator test host situation
Closed, ResolvedPublic
Actions

Description

Currently we have multiple phab/phorge test hosts and multiple webproxy URLs in Horizon
but they all have some issue or another.

Recently a user asked which test host to use.

This ticket is to clean this all up.

  • delete test hosts on old version
  • fix test hosts on new version /compare to production
  • make ONE of the web URLs work and communicate it, delete the other proxies

proxies:

https://phabricator-prod.wmflabs.org -> http://172.16.0.173:443

https://phab.wmflabs.org/ -> http://172.16.0.173:80

https://phab-prod-usercontent.wmflabs.org -> http://172.16.0.173:80

https://phabricator.wmflabs.org -> http://172.16.0.173:80

https://phorge.wmcloud.org -> http://172.16.7.98:80

https://phab-bull.wmcloud.org/ -> http://172.16.4.197:80

instances:

phabricator-bullseye (172.16.4.197)

phabricator-prod-1001 (172.16.0.173)

(deleted) (172.16.7.98) NXDOMAIN

Details

SubjectRepoBranchLines +/-
cloud/devtools: update phabricator domain and altdomainoperations/puppetproduction+2 -2
Customize query in gerrit

Event Timeline

Dzahn created this task.Feb 2 2024, 6:48 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 2 2024, 6:48 PM
Dzahn updated the task description. (Show Details)Feb 2 2024, 7:05 PM
Dzahn updated the task description. (Show Details)Feb 2 2024, 7:07 PM
Dzahn updated the task description. (Show Details)Feb 2 2024, 7:10 PM
Stashbot added a comment.Feb 2 2024, 7:12 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T19:12:13Z] <mutante> deleting web proxy phorge.wmcloud.org which pointed to 172.16.7.98 which doesn't exist anymore T356530

Dzahn added a comment.Feb 2 2024, 7:18 PM

https://phabricator-prod.wmflabs.org - points to buster VM but times out

https://phab.wmflabs.org/ - points to buster VM, shows database connection error

https://phab-prod-usercontent.wmflabs.org - points to buster VM, redirects to https://phab.wmflabs.org/, database connection error

https://phabricator.wmflabs.org - points to buster VM, redirects to https://phabricator.wikimedia.org

https://phab-bull.wmcloud.org - points to bullseye VM, shows "Site Not Found", no site is configured error

Dzahn added a comment.Feb 2 2024, 7:27 PM

virtual hosts actually configured:

buster:

<VirtualHost *:80>
  ServerName phab.wmflabs.org
  ServerAlias phab-prod-usercontent.wmflabs.org
  ServerAlias bugzilla.wikimedia.org
  ServerAlias bugs.wikimedia.org

bullseye:

<VirtualHost *:80>
  ServerName phab-bull.wmcloud.org
  ServerAlias phab-prod-usercontent.wmflabs.org
  ServerAlias bugzilla.wikimedia.org
  ServerAlias bugs.wikimedia.org
Stashbot added a comment.Feb 2 2024, 7:29 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T19:29:39Z] <mutante> deleting web proxy phabricator-prod.wmflabs.org which pointed to port 443 on the buster instance and timed out T356530

Dzahn added a comment.Feb 2 2024, 8:10 PM
dzahn@deploy-1004:/srv/deployment/phabricator/deployment$ scap deploy
20:10:12 Started deploy [phabricator/deployment@24a2a2a]
20:10:12 Deploying Rev: HEAD = 24a2a2a6f90c3ef6883ef1f9b02ff9340cbf7596
20:10:12 Started deploy [phabricator/deployment@24a2a2a]: (no justification provided)
20:10:12 
== DEFAULT ==
:* phabricator-bullseye.devtools.eqiad1.wikimedia.cloud
:* phabricator-prod-1001.devtools.eqiad1.wikimedia.cloud
20:10:15 phabricator/deployment: fetch stage(s):  50% (in-flight: 1; ok: 1; fail: 0; left: 0) /
Stashbot added a comment.Feb 2 2024, 8:13 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T20:13:54Z] <mutante> running "scap deploy" in /srv/deployment/phabricator/deployment on deploy-1004 which deploys to phabricator-bullseye and phabricator-prod-1001 T356530

Stashbot added a comment.Feb 2 2024, 8:17 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T20:17:03Z] <mutante> editing proxies phab.wmflabs.org and phab-prod-usercontent.wmflabs.org to point to bullseye instance instead of buster T356530

Stashbot added a comment.Feb 2 2024, 8:38 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T20:38:34Z] <mutante> deleting proxy phab-bull.wmcloud.org after previous proxy names are switched to bullseye backend T356530

Stashbot added a comment.Feb 2 2024, 8:41 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T20:41:44Z] <mutante> shutting down instance phabricator-prod-1001 (buster), replaced by phab-bullseye (bullseye) T356530

Stashbot added a comment.Feb 2 2024, 8:59 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T20:59:51Z] <mutante> - changing phabricator domain in instance Hiera of phabricator-bullseye to phab.wmflabs.org and running puppet to update apache config/rewrite rules T356530

Stashbot added a comment.Feb 2 2024, 10:27 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T22:26:59Z] <mutante> - deleted proxies phab.wmflabs.org, phab-prod-usercontent.wmflabs.org, phabricator.wmflabs.org - created proxies phabricator.wmcloud.org, phab-usercontent.wmcloud.org - wmflabs names are legacy and should migrate T356530

Stashbot added a comment.Feb 2 2024, 10:31 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T22:31:58Z] <mutante> - phabricator-bullseye, instance hiera: setting phabricator_domain to phabricator.wmcloud.org and phabricator_altdomain to phab-usercontent.wmcloud.org T356530

gerritbot added a comment.Feb 2 2024, 10:32 PM

Change 995366 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] cloud/devtools: update phabricator domain and altdomain

https://gerrit.wikimedia.org/r/995366

gerritbot added a project: Patch-For-Review.Feb 2 2024, 10:32 PM
Stashbot added a comment.Feb 2 2024, 10:37 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T22:37:21Z] <mutante> - phabricator-bullseye - /srv/deployment/phabricator/deployment/phabricator/bin$ sudo ./config set phabricator.base-uri 'http://phabricator.wmcloud.org/' T356530

gerritbot added a comment.Feb 2 2024, 10:38 PM

Change 995366 merged by Dzahn:

[operations/puppet@production] cloud/devtools: update phabricator domain and altdomain

https://gerrit.wikimedia.org/r/995366

Stashbot added a comment.Feb 2 2024, 10:53 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-02T22:53:05Z] <mutante> - phabricator-bullseye sudo ./config set phabricator.base-uri 'http://phabricator.wmcloud.org/' | sudo ./config set security.alternate-file-domain 'https://phab-usercontent.wmcloud.org' | delete proxy phab-prod-usercontent, create proxy phab-usercontent.wmcloud.org, restart apache T356530

Dzahn added a comment.Feb 2 2024, 11:21 PM

https://phabricator.wmcloud.org is now the new and fixed test host for phorge (phabricator) (on bullseye).

We don't have any authentication providers though for now and I think we are not allowed to use wikitech LDAP. So no logins so far.

I could confirm though that the admin user can create test tickets in maniphest.

Dzahn added a comment.Feb 2 2024, 11:39 PM

unlocked the auth config option with shell command:

phabricator/bin$ sudo ./auth unlock

configured the most simple auth provider that lets users register with password

locked the auth config option again.

Dzahn closed this task as Resolved.Feb 2 2024, 11:39 PM
Peachey88 subscribed.Feb 6 2024, 10:00 AM

Can we redirect https://phab.wmflabs.org/ to the current instance, as its the documented testing environment? It's even the main page of our normal phab environment.

Dzahn reopened this task as Open.Feb 6 2024, 1:20 PM

I would prefer to fix the documentation since both the term "phab" and the term "labs" are legacy and should be phased out.

But of course it's valid that any mention of it should be replaced.

taavi subscribed.Feb 6 2024, 1:30 PM

I updated the main page of this instance.

https://wikitech.wikimedia.org/wiki/Nova_Resource:Redirects can be used to serve a redirect for the old name if needed.

Maintenance_bot removed a project: Patch-For-Review.Feb 6 2024, 1:30 PM
LSobanski triaged this task as Medium priority.Feb 6 2024, 2:29 PM
LSobanski moved this task from Incoming to Backlog on the collaboration-services board.
Dzahn added a comment.Feb 7 2024, 5:58 PM
In T356530#9517178, @taavi wrote:

https://wikitech.wikimedia.org/wiki/Nova_Resource:Redirects can be used to serve a redirect for the old name if needed.

Thanks for pointing out this project.

It seems debatable whether I should use "phorge.wmcloud" because Phorge is the upstream name now or "phabricator.wmcloud" because it matches production and is less confusing. Renaming the production service would of course be a bigger deal.

Now I have set it up so that all variants redirect, so:

https://phab.wmflabs.org -> https://phabricator.wmcloud.org
https://phorge.wmflabs.org -> https://phabricator.wmcloud.org
https://phab.wmcloud.org -> https://phabricator.wmcloud.org
https://phorge.wmcloud.org -> https://phabricator.wmcloud.org

Dzahn closed this task as Resolved.Feb 7 2024, 6:02 PM

I don't see much else to update in Google. Editing old ticket titles seems to be going too far and we have the redirects in place. Guess that's it? Correct me if you think I am missing something else please.

Peachey88 added a comment.Feb 8 2024, 8:45 AM

I cleaned up the references I could find on mwwiki, and remarked the pages for translation (i think)

Dzahn added a comment.Feb 8 2024, 4:13 PM

Thank you @Peachey88

Stashbot added a comment.Feb 9 2024, 7:08 PM

Mentioned in SAL (#wikimedia-cloud) [2024-02-09T19:08:40Z] <mutante> deleting instance phabricator-prod-1001 (shut down a couple days ago, buster instance replaced by phabricator-bullseye instance) T356530

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits