Page MenuHomePhabricator

Magnus (Magnus Manske)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Oct 23 2014, 3:02 PM (488 w, 2 d)
Availability
Available
LDAP User
Magnus Manske
MediaWiki User
Unknown

Recent Activity

Fri, Mar 1

Magnus created T358837: Allow more connections to the SPARQL query service for specific tools/users.
Fri, Mar 1, 8:13 AM · Wikidata, Wikidata-Query-Service

Thu, Feb 29

Magnus closed T358552: Rust image build on toolforge fails as Resolved.

Ran it again now, works fine. Closing this issue, will re-open if it keeps happening.

Thu, Feb 29, 8:48 AM · Toolforge (Toolforge iteration 06)

Tue, Feb 27

Magnus created T358552: Rust image build on toolforge fails.
Tue, Feb 27, 7:57 AM · Toolforge (Toolforge iteration 06)

Fri, Feb 23

Magnus added a comment to T358211: Wikidata query sometimes returns 403.

Now starting to see error 429 (too many requests), which is better (for debugging). Did something change in the meantime?

Fri, Feb 23, 11:20 AM · Wikidata, Wikidata-Query-Service

Thu, Feb 22

Magnus created T358211: Wikidata query sometimes returns 403.
Thu, Feb 22, 12:41 PM · Wikidata, Wikidata-Query-Service
Magnus added a comment to T358194: [jobs-api] Getting errors when listing jobs.

This happens ~50% of the time, re-running the exact same command often works.

Thu, Feb 22, 10:28 AM · Toolforge (Toolforge iteration 06)

Wed, Feb 21

Magnus closed T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs, a subtask of T356164: [toolforge] several tools get periods of connection refused (104) when connecting to wikis, as Resolved.
Wed, Feb 21, 1:13 PM · Toolforge (Toolforge iteration 06), User-aborrero
Magnus closed T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs as Resolved.
Wed, Feb 21, 1:12 PM · Toolforge
Magnus added a comment to T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs.

Thanks, that works form me. It is much slower than before, as it needs to run full compilation every time, instead of just the changed bits. Ah well.

Wed, Feb 21, 1:12 PM · Toolforge
Magnus added a comment to T358090: Rust compilation fails on jobs framework.

I tried that and got

[step-results] 2024-02-21T11:49:25.959261833Z Built image tools-harbor.wmcloud.org/tool-listeria/tool-listeria:latest@sha256:24ac86ba3d8e4c11568e158a172016dcf9b8e697312866c674ad5ae6f6b4954b

But the tutorial shows me only how to deploy a webservice. How do I start the bot executable as a normal toolforge job?

Wed, Feb 21, 11:53 AM · Toolforge Build Service
Magnus added a comment to T358090: Rust compilation fails on jobs framework.
/mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.29' not found (required by /mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main)
 /mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by /mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main)
 /mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.32' not found (required by /mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main)
 /mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.34' not found (required by /mnt/nfs/labstore-secondary-tools-project/listeria/listeria_rs/target/release/build/openssl-sys-92765f660cd77871/build-script-main)
Wed, Feb 21, 11:28 AM · Toolforge Build Service
Magnus added a comment to T358090: Rust compilation fails on jobs framework.

Ah, gridengine doesn't compile it either... Works fine locally though

Wed, Feb 21, 11:28 AM · Toolforge Build Service
Magnus created T358090: Rust compilation fails on jobs framework.
Wed, Feb 21, 11:20 AM · Toolforge Build Service

Mon, Feb 19

Magnus closed T357911: petscan4 VM inaccessible as Resolved.

Seems fixed now

Mon, Feb 19, 5:31 PM · Cloud-VPS
Magnus created T357911: petscan4 VM inaccessible.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Mon, Feb 19, 3:28 PM · Cloud-VPS

Thu, Feb 8

Magnus added a comment to T357035: webm issue: Some videos on Commons have no duration in their metadata.

The funny thing is, if you click on the movie https://commons.wikimedia.org/wiki/File:The_Sea_Beast_(1926).webm to play it, the moment the player comes up, it shows the correct duration. Where does it get that from?

Thu, Feb 8, 7:24 PM · TimedMediaHandler
Magnus created T357035: webm issue: Some videos on Commons have no duration in their metadata.
Thu, Feb 8, 6:06 PM · TimedMediaHandler

Wed, Feb 7

Magnus added a comment to T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs.

I have limited it to 50 API connection at a time. Still throwing 104 errors. Either I did it wrong, or there is some other issue.

Wed, Feb 7, 2:12 PM · Toolforge
Magnus added a comment to T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs.

Thanks to the recently relaxed limitations per job on Toolforge, I am running this with more async threads, so without actual code change, it would have increased the number of connections.

Wed, Feb 7, 12:35 PM · Toolforge
Magnus added a comment to T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs.

Please use the bot as you like for testing!

Wed, Feb 7, 10:46 AM · Toolforge
Magnus added a comment to T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs.

This issue is persisting for the listeria tool. The bot is now down from ~40K edits/day to ~500. Something needs to be done, soon.

Wed, Feb 7, 9:26 AM · Toolforge

Jan 30 2024

Magnus created T356160: Listeria bot sometimes gets stuck with 104 errors from Wikimedia APIs.
Jan 30 2024, 8:49 AM · Toolforge

Nov 9 2023

Magnus added a comment to T350862: [toolsdb] Migrate mixnmatch db to Trove.

I am open to this, as I already have a Trove instance for baglama2, and it works well (after some initial problems).

Nov 9 2023, 3:16 PM · cloud-services-team (FY2023/2024-Q3-Q4), Data-Services
Magnus added a comment to T349695: [toolsdb] MariaDB process is killed by OOM killer (October 2023).

FWIW I just saw this ticket, and added an index to the log table which should speed things up. I can also rewrite the query if that does not suffice, please let me know. Let's discuss Trove in T350862 .

Nov 9 2023, 3:10 PM · Data-Services, Cloud-Services-Origin-Alert, cloud-services-team (FY2023/2024-Q1-Q2)

Nov 1 2023

Magnus closed T350250: webservice script broken as Resolved.

D'oh!

Nov 1 2023, 12:49 PM · Toolforge
Magnus added a comment to T350250: webservice script broken.

Webservice is not running, returns only blank page, no error

Nov 1 2023, 11:48 AM · Toolforge
Magnus created T350250: webservice script broken.
Nov 1 2023, 11:47 AM · Toolforge
Magnus closed T349687: Cannot edit files of a tool as a user anymore as Resolved.

Seems to be fixed now?

Nov 1 2023, 9:43 AM · Toolforge
Magnus reopened T349687: Cannot edit files of a tool as a user anymore as "Open".

Aaaaand its back again.

Nov 1 2023, 9:33 AM · Toolforge

Oct 26 2023

Magnus closed T349687: Cannot edit files of a tool as a user anymore as Resolved.

@taavi Success! I tried /Users/mm6/php/magnustools/public_html/php/ToolforgeCommon.php which had magically reverted to non-group-writable again, so I changed it to group-writable now, and yes I can edit as before!

Oct 26 2023, 8:36 AM · Toolforge

Oct 25 2023

Magnus added a comment to T349687: Cannot edit files of a tool as a user anymore.

Other test case: /Users/mm6/php/magnustools/public_html/php/ToolforgeCommon.php

Oct 25 2023, 12:38 PM · Toolforge
Magnus added a comment to T349687: Cannot edit files of a tool as a user anymore.

Odd. Now it does. Same issue.

Oct 25 2023, 12:36 PM · Toolforge
Magnus added a comment to T349687: Cannot edit files of a tool as a user anymore.

FWIW, I can edit the files if I become the tool, but I don't like editing in shell, especially for larger code.

Oct 25 2023, 9:52 AM · Toolforge
Magnus updated the task description for T349687: Cannot edit files of a tool as a user anymore.
Oct 25 2023, 9:50 AM · Toolforge
Magnus added a project to T349687: Cannot edit files of a tool as a user anymore: Toolforge.
Oct 25 2023, 9:50 AM · Toolforge
Magnus created T349687: Cannot edit files of a tool as a user anymore.
Oct 25 2023, 9:49 AM · Toolforge

Sep 27 2023

Magnus closed T347367: ORES possibly blocking PetScan from loading? as Resolved.

Changed the query so it's now working as before the ORES change.

Sep 27 2023, 7:58 AM · Machine-Learning-Team, ORES
Magnus closed T347317: petscan expects javascript function callback from ORES as Resolved.

Resolved, see T347367

Sep 27 2023, 7:58 AM · Machine-Learning-Team
Magnus added a comment to T347367: ORES possibly blocking PetScan from loading?.

PetScan restored for now. Waiting for the CORS issue to be resolved.

Sep 27 2023, 7:24 AM · Machine-Learning-Team, ORES

Sep 12 2023

Magnus added a comment to T341190: duplicity returns "504 Gateway Time-out".

Restated again, and filed T346126

Sep 12 2023, 9:27 AM · Tools
Magnus created T346126: Some of my tools (eg wikidata-todo) just start throwing 504 errors.
Sep 12 2023, 7:56 AM · Cloud-VPS, SRE, Toolforge

Aug 22 2023

Magnus created T344692: toolforge command fails for quickstatements tool.
Aug 22 2023, 1:16 PM · Toolforge Jobs framework

Jul 19 2023

Magnus added a comment to T341190: duplicity returns "504 Gateway Time-out".

Done

Jul 19 2023, 9:07 AM · Tools
Magnus closed T342202: glamtools.toolforge.org gives 504 gateway time-out as Resolved.
Jul 19 2023, 8:19 AM · Tools, User-AxelPettersson_WMSE
Magnus added a comment to T342202: glamtools.toolforge.org gives 504 gateway time-out.

Manually restarted webservice, as toolforge cannot possible do that automatically </sarcasm>

Jul 19 2023, 8:18 AM · Tools, User-AxelPettersson_WMSE
Magnus closed T341190: duplicity returns "504 Gateway Time-out" as Resolved.
Jul 19 2023, 8:18 AM · Tools

Jul 7 2023

Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

And it doesn't answer the question why the webservice stops pretty much every time I start kubernetes jobs?

Please report such bugs so they can be fixed. toolforge jobs delete works properly now.

Jul 7 2023, 4:03 PM · User-aborrero, Toolforge Jobs framework, Kubernetes
Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

It might be worth mentioning that the limitations for Mix'n'match have been increased at some point, I can now run a job with 2CPUs/3GB RAM, which is much better.

Jul 7 2023, 4:03 PM · User-aborrero, Toolforge Jobs framework, Kubernetes
Magnus created T341347: Kubernetes milli-CPUs are confusing.
Jul 7 2023, 2:21 PM · Toolforge Jobs framework

Jul 6 2023

Magnus added a comment to T341190: duplicity returns "504 Gateway Time-out".

I have restarted the webservice, all good now.

Jul 6 2023, 11:05 AM · Tools

Jul 3 2023

Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

Ah here's a new one. I start kubernetes job rustbot. It runs. I start rustbot2. Now rustbot2 runs but rustbot has vanished:

tools.mix-n-match@tools-sgebastion-10:~/mixnmatch_rs$ toolforge jobs list
Job name:    Job type:    Status:
-----------  -----------  ---------
rustbot      continuous   Running
tools.mix-n-match@tools-sgebastion-10:~/mixnmatch_rs$ toolforge-jobs delete rustbot2 ; \rm ~/rustbot2.* ; \
> toolforge-jobs run --image tf-php74 --mem 1000Mi --continuous --command '/data/project/mix-n-match/mixnmatch_rs/run.sh second' rustbot2
Jul 3 2023, 10:24 AM · User-aborrero, Toolforge Jobs framework, Kubernetes

Jun 30 2023

Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

@dcaro Listeria was one of them, and quickstatements at some point.

Jun 30 2023, 4:12 PM · User-aborrero, Toolforge Jobs framework, Kubernetes
Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

@aborrero To be fair, Mix'n'match used to fire off small/medium-sized jobs to gridengine, unlikely to bring a machine down. The requirement for uniquely named kubernetes jobs, and the limitation on the number of jobs, with no ""waiting queue", forced me to rewrite much of my code, into my own "job engine" that runs as a single kubernetes job. However, now the restrictions to individual kubernetes jobs bite me.

Jun 30 2023, 4:09 PM · User-aborrero, Toolforge Jobs framework, Kubernetes
Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

And it doesn't answer the question why the webservice stops pretty much every time I start kubernetes jobs?

Jun 30 2023, 3:31 PM · User-aborrero, Toolforge Jobs framework, Kubernetes
Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

That is to say, you say I'd have to move to VPS because you changed the tech stack, not because of resource usage. Resource usage was fine under grid engine. In fact, it was fine running the PHP version of the code. Don't tell me kubernetes can not support the Rust version which uses a lot less resources?

Jun 30 2023, 3:29 PM · User-aborrero, Toolforge Jobs framework, Kubernetes
Magnus added a comment to T340844: Toolforge kubernetes does not meet expectaction of some users/tools.

In principle it would (I am already running the petscan VPS), but this is missing my point.

Jun 30 2023, 3:26 PM · User-aborrero, Toolforge Jobs framework, Kubernetes
Magnus created T340844: Toolforge kubernetes does not meet expectaction of some users/tools.
Jun 30 2023, 1:22 PM · User-aborrero, Toolforge Jobs framework, Kubernetes

Jun 28 2023

Magnus added a comment to T340381: Toolforge: mix-n-match modifies my username in an offensive way.

This should do it. Tested and seems to work.

Jun 28 2023, 8:13 AM · Toolforge-standards-committee
Magnus added a comment to T340381: Toolforge: mix-n-match modifies my username in an offensive way.

I confirm that "Silly Matlin" has been appearing in Mix'n'Match edits, but it is a straight lie that I "refused to comply". Not entirely surprising though. Anyway, it's a real issue, but User:Solidest seems to have found a bug, which I just saw since I don't follow the [[User_talk:Silly_Matlin]] page. I will look into it, again.

Jun 28 2023, 7:49 AM · Toolforge-standards-committee

May 17 2023

Magnus created T336835: Tool 'tooltranslate' webservice PHP hangs forever when trying to write to its data path.
May 17 2023, 8:19 AM · Toolforge

Apr 27 2023

Magnus created T335520: glamtools.toolforge.org webservice throws 504.
Apr 27 2023, 4:01 PM · User-bd808, Tools

Apr 4 2023

Magnus closed T333814: Tool created in toolforge admin but no directory created as Resolved.

All good now

Apr 4 2023, 9:26 AM · Toolforge

Apr 3 2023

Magnus created T333814: Tool created in toolforge admin but no directory created.
Apr 3 2023, 11:00 AM · Toolforge

Mar 23 2023

Magnus added a comment to T332762: New tool not allowed to connect to toolsdb.

Apologies, my mistake, needs two underscores! All is well.

Mar 23 2023, 8:30 AM · cloud-services-team, Toolforge
Magnus added a comment to T332762: New tool not allowed to connect to toolsdb.

Thanks, better, but not quite there yet:

tools.wdqsbe@tools-sgebastion-10:~$ sql local
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 73249977
Server version: 10.1.44-MariaDB MariaDB Server
Mar 23 2023, 8:29 AM · cloud-services-team, Toolforge

Mar 22 2023

Magnus created T332762: New tool not allowed to connect to toolsdb.
Mar 22 2023, 8:59 AM · cloud-services-team, Toolforge

Mar 7 2023

Magnus closed T330880: OAuth authentication changed? as Resolved.

Found the problem, on my side. Apologies.

Mar 7 2023, 11:08 AM · MediaWiki-extensions-OAuth

Mar 6 2023

Magnus added a comment to T330880: OAuth authentication changed?.

Consumer key is b5dc46b99399f49d03757216abd14e66 (QuickStatements). I didn't change the URL, and I think the toolforge clock is working fine.

Mar 6 2023, 8:50 AM · MediaWiki-extensions-OAuth

Mar 1 2023

Magnus added a comment to T330880: OAuth authentication changed?.

Note: Oauth 1, not 2!

Mar 1 2023, 3:34 PM · MediaWiki-extensions-OAuth
Magnus added a comment to T330846: Help community projects on Bitbucket™ to evaluate the adoption of something less external and libre (for example Wikimedia GitLab).

The reason I used bitbucket in the past was a (long removed) policy on github that limited the number of free repos. I also have some repos on github, which is owned by M$ and probably not very libre either.

Mar 1 2023, 2:31 PM · Epic
Magnus added a comment to T330880: OAuth authentication changed?.

Relevant code: https://github.com/magnusmanske/mediawiki_rust/blob/master/src/api.rs#L644

Mar 1 2023, 2:25 PM · MediaWiki-extensions-OAuth
Magnus created T330880: OAuth authentication changed?.
Mar 1 2023, 2:23 PM · MediaWiki-extensions-OAuth

Feb 24 2023

Magnus added a comment to T231891: Create a Generic List-building tool that can meet and exceed the applications of Pagepile.

FWIW I started developing an new tool called GULP, now under early development.

Feb 24 2023, 2:57 PM · Campaign-Registration, WMSE-Content-partnerships-support-2021-Software-development, Campaign-Tools, Technical-Tool-Request

Feb 17 2023

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

After T329853 can we please add something so databases don't stay vanished until I complain at a "a proper support venue" (which seems to be only IRC, with mattermost link broken)?

Feb 17 2023, 10:01 AM · Tools, cloud-services-team (FY2022/2023-Q3)

Feb 16 2023

Magnus created T329853: Trove database vanished.
Feb 16 2023, 3:39 PM · Toolforge

Feb 7 2023

Magnus closed T329066: Oauth2 with Rust as Resolved.

Thanks, I forgot to check the "URL needs to start with" checkbox...

Feb 7 2023, 4:10 PM · MediaWiki-extensions-OAuth
Magnus created T329066: Oauth2 with Rust.
Feb 7 2023, 3:45 PM · MediaWiki-extensions-OAuth

Jan 24 2023

Magnus added a comment to T282796: Design a file format to represent Wikibase edits.

Just for posterity, I'd like to mention my own wikibase diff engine in Rust: https://gitlab.com/tobias47n9e/wikibase_rs/-/blob/master/src/entity_diff.rs

Jan 24 2023, 1:54 PM · OpenRefine
Magnus added a comment to T327748: Remove 1 CPU limit for toolforge-jobs.

3 CPUs would be plenty, I think that's actually the per-tool limit, including the webservice?

Jan 24 2023, 1:52 PM · Toolforge
Magnus added a comment to T327775: toolforge-jobs script stopped working.

This stopped working about an hour ago

Jan 24 2023, 11:57 AM · Toolforge Jobs framework
Magnus created T327775: toolforge-jobs script stopped working.
Jan 24 2023, 11:57 AM · Toolforge Jobs framework
Magnus created T327748: Remove 1 CPU limit for toolforge-jobs.
Jan 24 2023, 9:31 AM · Toolforge

Jan 9 2023

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

I have successfully moved all data over to trove, and took a snapshot of the toolsdb version.
The web interface and the background tools have been switched over to the trove version and are reading/writing successfully.
As far as I am concerned, the toolsdb s51203__baglama2_p can be deleted.
Should I do that, or do you want to do the honors?

Jan 9 2023, 11:04 AM · Tools, cloud-services-team (FY2022/2023-Q3)

Dec 23 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

It took a few days but the database has been successfully copied over to trove. I am taking a final mysqldump from toolsdb now, then s51203__baglama2_p can be removed. I will post here when it's done.

Dec 23 2022, 9:50 AM · Tools, cloud-services-team (FY2022/2023-Q3)

Dec 20 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Yes that's fine. Let me know when I can re-import it

Dec 20 2022, 5:36 PM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Seems to have happened again just now. I was importing a rather large table (views), that has been running for hours(?). Not sure if that's related.

Dec 20 2022, 3:58 PM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

In other words, I would be hesitant to switch to a system where I have to manually restart the MySQL server every other week. I don't have time to work on all my tools as I would like, I can't run around kicking infrastructure as well.

Dec 20 2022, 2:37 PM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

OK I restarted the DB instance via horizon, when I saw that even horizon couldn't connect to it any more.

Dec 20 2022, 2:36 PM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

More concise, from toolforge:

tools.glamtools@tools-sgebastion-10:~$ mysql --defaults-file=~/replica.trove.my.cnf -h pwupvyu6i6k.svc.trove.eqiad1.wikimedia.cloud baglama2
ERROR 2002 (HY000): Can't connect to MySQL server on 'pwupvyu6i6k.svc.trove.eqiad1.wikimedia.cloud' (115)
Dec 20 2022, 1:11 PM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Everything worked fine but (after a few days) I now can't connect to the instance any more:

Used command:  /usr/bin/ssh -v -N -S none -o ControlMaster=no -o ExitOnForwardFailure=yes -o ConnectTimeout=10 -o NumberOfPasswordPrompts=3 -i /Users/mm6/SpiderOak Hive/Configurations/ssh/id_rsa -o TCPKeepAlive=no -o ServerAliveInterval=60 -o ServerAliveCountMax=1 magnus@tools-login.wmflabs.org -L 61284:pwupvyu6i6k.svc.trove.eqiad1.wikimedia.cloud:3306
Dec 20 2022, 1:10 PM · Tools, cloud-services-team (FY2022/2023-Q3)

Dec 14 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

@Andrew I have created a new baglama2 DB there, and am currently importing the tooldb database. For that, I made a new replica file (~/replica.trove.my.cnf), and run in a screen:

mysqldump --defaults-file=~/replica.my.cnf --host=tools-db s51203__baglama2_p | mysql --defaults-file=~/replica.trove.my.cnf -h pwupvyu6i6k.svc.trove.eqiad1.wikimedia.cloud baglama2

This seems to be mostly done (after ~14h). I will then point everything to the trove DB. I might also dump the tooldb, and set up a regular trove dump. What's the best place to store compressed dumps, just the tool directory?

Dec 14 2022, 9:56 AM · Tools, cloud-services-team (FY2022/2023-Q3)

Dec 9 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Is there a case for these large ones to move to their own instance, to take pressure of the toolforge DB system?

The answer to that question is YES! If you're willing to pick a database (not necessarily mix-n-match) and be a test subject I'd love to work on you with that.

Dec 9 2022, 9:21 AM · Tools, cloud-services-team (FY2022/2023-Q3)

Dec 8 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Maybe this is a more general issue as well. I checked and it looks like I "own" 4 of the 10 largest tool databases. Is there a case for these large ones to move to their own instance, to take pressure of the toolforge DB system?

Dec 8 2022, 9:14 AM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

@nskaggs Thanks, the Cloud VPS DB option looks very interesting, but I think it would be overkill to move the 120GB DB over. I'll stick with the 10 connections for now, unless you recommend that this is hosted more efficiently (for both you and me) on Cloud VPS.

Dec 8 2022, 9:09 AM · Tools, cloud-services-team (FY2022/2023-Q3)

Dec 6 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Thank you @nskaggs!

Dec 6 2022, 12:25 PM · Tools, cloud-services-team (FY2022/2023-Q3)

Dec 1 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Also, the per-container limit still seems to be 1 CPU?

Dec 1 2022, 1:38 PM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

Accepted the CPU quota change. The DB request is pending discussion.

Dec 1 2022, 1:34 PM · Tools, cloud-services-team (FY2022/2023-Q3)
Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

And while I'm at it, I would like to request that the maximum number of database connections be increased to 20. This is mostly for the tool user database, not so much for the DB replicas, in case that makes a difference.

Could you explain a bit why this is needed?

Dec 1 2022, 1:33 PM · Tools, cloud-services-team (FY2022/2023-Q3)

Nov 23 2022

Magnus added a comment to T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).

And while I'm at it, I would like to request that the maximum number of database connections be increased to 20. This is mostly for the tool user database, not so much for the DB replicas, in case that makes a difference.

Nov 23 2022, 11:01 AM · Tools, cloud-services-team (FY2022/2023-Q3)

Nov 22 2022

Magnus updated the task description for T323502: Move some of magnus's tools to Trove databases (was: Request increased quota for mix-n-match Toolforge tool).
Nov 22 2022, 7:39 AM · Tools, cloud-services-team (FY2022/2023-Q3)