Maniphest T331956

Create "excimer" misc database
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Krinkle
	Mar 14 2023, 2:44 AM

Description

Excimer UI Server is a new service for viewing profiles captured with WikimediaDebug. It will be hosted on performance.wikimedia.org. It serves a similar purpose to the XHGui service that we run today. Its main value is the ability to generate detailed flame graphs (more details at T291015). In the long run it might supersede XHGui but that has not yet been decided.

The database will be similar in purpose, size, load, replication, and backup strategy to the xhgui database that exists today (T254795: Database for XHGui profiles).

One notable difference is that the excimer database will not require write access from MediaWiki app servers. Instead, it will only be written to from webperf1003/webperf2003.

Database name: excimer
Database user: excimer_ui_server
Cluster: misc, maybe m2 again like xhgui? https://wikitech.wikimedia.org/wiki/MariaDB#Miscellaneous
Schema: https://gerrit.wikimedia.org/r/plugins/gitiles/performance/excimer-ui-server/+/HEAD/tables.sql
Grants: connections from webperf* hosts only with permissions to SELECT, INSERT, and DELETE.

Details

	Subject	Repo	Branch	Lines +/-
	Define dummy pass for passwords::excimer_ui_server	labs/private	master	+4 -0
	production-m2.sql.erb: New user for excimer database	operations/puppet	production	+14 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Krinkle	T291015 Add per-request flamegraph option to WikimediaDebug
		Resolved		• Marostegui	T331956 Create "excimer" misc database

Event Timeline

Krinkle created this task.Mar 14 2023, 2:44 AM

Krinkle mentioned this in T291015: Add per-request flamegraph option to WikimediaDebug.

Krinkle updated the task description. (Show Details)Mar 14 2023, 2:47 AM

28G xhgui
Should be fine to get the new database on m2.

@Krinkle remember that the connections will need to point to: m2-master.eqiad.wmnet which points to our proxies.

Change 898447 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m2.sql.erb: New user for excimer database

https://gerrit.wikimedia.org/r/898447

gerritbot added a project: Patch-For-Review.Mar 14 2023, 6:32 AM

Change 898447 merged by Marostegui:

[operations/puppet@production] production-m2.sql.erb: New user for excimer database

https://gerrit.wikimedia.org/r/898447

This is done (also created the table) and tested:

root@webperf1003:~# /opt/wmf-mariadb104-client/bin/mysql -hm2-master.eqiad.wmnet -uexcimer_ui_server -p excimer
Enter password:
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 33734618
Server version: 10.4.26-MariaDB-log MariaDB Server

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql:excimer_ui_server@m2-master.eqiad.wmnet [excimer]> select * from excimer_report;
Empty set (0.002 sec)

mysql:excimer_ui_server@m2-master.eqiad.wmnet [excimer]>

@Krinkle I have left the password at mwmaint1002:/home/krinkle/excimer, please make sure to puppetize it like it was done at T260640: Additional database user for XHGui administration
I have updated also: https://wikitech.wikimedia.org/wiki/MariaDB/misc#m2

Maintenance_bot removed a project: Patch-For-Review.Mar 14 2023, 7:10 AM

Mentioned in SAL (#wikimedia-releng) [2023-04-22T19:35:07Z] <Krinkle> Create excimer_ui_server db user in Beta Cluster on deployment-db13 based on prod grants. Password stored in deployment-puppetmaster04:/var/lib/git/labs/private/ (passwords::excimer_ui_server::$excimer_db_pass). Picked db13 because recommendationapi is here (also prod m2), and because mdb (created for this purpose originally) appears broken since several OS iterations (likely forgotten due to unusual name) T301637, T331956