Added tool' users database per user request at https://meta.wikimedia.org/wiki/Research_talk:Quarry#Tool_labs'_user_databases?.

This would be trivial to add to the work on the parent task I just added. Therefore, adding it.

I dug around a little bit and realized it isn't as simple as what I stated above. The reason is that those are read-write databases, which dramatically changes the scope of what Quarry could do. In order to provide such services, this would require a read-only permission to most tables on ToolsDB. It would also require a review of and possible view layer/read-only role for the Quarry database.

This cannot be fitted into the scope of the replica changes. It also may be surprising for developers if their ToolsDB information became dramatically more public than it currently is, but that's more of a topic for discussion.

There's a clear path to adding database patterns to talk to toolsdb. The quarry database is how quarry works in dev mode, so it clearly works. However, I think it should be done with the read-only user used elsewhere. That's all pretty easy. It should also probably be done in two stages (one patch for toolsdb and one for self-query) so that we can roll back something that is found to be problematic.

I think letting users query public toolsdb databases has clear value (but not sure of the utility of querying quarry's internal db).

As the database selector field exists now, we could just check if the dbname has double underscores and ends in _p – that should indicate a tools database. Credentials used for connecting must not have write access to any database.

siddharthvp opened https://github.com/toolforge/quarry/pull/26

siddharthvp closed https://github.com/toolforge/quarry/pull/26

With PR-26 closed, should this task be closed as resolved?

We are finally close to resolving this task! After the work in T348407 I can successfully query ToolsDB from Quarry. Access at the moment is limited to one database for testing (s55771__wsstats_p). As discussed in T348407 I will send an email to cloud-announce to inform everyone that we're opening this type of access to the ToolsDB databases (only for the databases ending with _p).

I will give people a 2-week notice for this change, and enable access to all _p databases on Monday, July 1st. If you would like to have access to a specific database that you are managing and would like to have it enabled before that date, just leave a comment below.

I also created T367393: Allow Superset to query ToolsDB public databases to add a similar type of access from Superset.

This task originally mentioned both access to ToolsDB and access to "The 'local' database that is used to track Quarry's saved queries". Is access to Quarry's own database something that anyone is still interested in? Edit: I split this requirement into its own task T367415: Allow Quarry to query its own database