Page MenuHomePhabricator

zhuyifei1999
*Not* Serious business title.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 13 2014, 10:19 AM (257 w, 3 d)
Availability
Available
IRC Nick
zhuyifei1999
LDAP User
Zhuyifei1999
MediaWiki User
Zhuyifei1999 [ Global Accounts ]

There is currently no text in this page. You can search for this page title in other pages, or search the related logs.

Recent Activity

Sat, Sep 7

zhuyifei1999 committed rPWBC6f0cafd37d59: Deprecate sysopnames (authored by Huji).
Deprecate sysopnames
Sat, Sep 7, 5:50 PM

Thu, Aug 29

zhuyifei1999 edited projects for T230758: Drop database s54020__wsexporttest_p and grant access to Quarry, added: Data-Services; removed Tool-Database-Queries, Toolforge.

By the way, should Quarry be able to access the tools' databases when they have a _p suffix? I'm getting "Access denied for user 's52788'@'%' to database 's54020__wsexport_test_p'". Is it possible to give it access to both databases?

Thu, Aug 29, 3:40 PM · Data-Services
zhuyifei1999 merged T227942: Pushing "Explain" button outputs "Error Hmm... Is the SQL actually running?!" into T205214: EXPLAIN is broken because new analytics wiki replica cluster contains multiple servers.
Thu, Aug 29, 3:35 PM · Patch-For-Review, Quarry
zhuyifei1999 merged task T227942: Pushing "Explain" button outputs "Error Hmm... Is the SQL actually running?!" into T205214: EXPLAIN is broken because new analytics wiki replica cluster contains multiple servers.
Thu, Aug 29, 3:35 PM · Quarry

Wed, Aug 28

zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

This is assuming the default family/lang is Commons. The same applies to any other site if the parameters passed to the Site constructor matches any case given to the usernames dict.

Wed, Aug 28, 6:46 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

True that, it can be just one username per site, the preferred one? But listing that usernames can be actually useful as a safeguard, to not allow an username that's defined, but not allowed in usernames list, in case I don't want to use one username somewhere for some reason. Feel free to make it only default username, that's fine as well, just thinking loud :).

Wed, Aug 28, 6:25 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

BTW Pywikibot tests miss the way to simply switch between several accounts (OAuth, BotPasswords, regular password) as well.

Wed, Aug 28, 6:11 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.
user-config.py
accounts = {
    "oznamovatel": {
        "username": "Oznamovatel",
        "oauth": [ consumer key, consumer secret, client key, client secret ]
    },
    "urbanecmbot": {
        "username": "UrbanecmBot",
        "oauth": [ consumer key, consumer secret, client key, client secret ]
    }
}
usernames['wikipedia']['cs'] = [  'urbanecmbot', 'oznamovatelbot' ] # both urbanecmbot and oznamovatelbot used
usernames['wikipedia']['en'] = [  'urbanecmbot' ] # only urbanecmbot used
Wed, Aug 28, 6:10 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

This is quite common situation on Czech Wikipedia, one bot account and one sysop account for every sysop bot operator, edits by Pywikibot are made from each of them depending on whether sysop rights are needed or not. I suggest somethng like this (pseudocode):

Wed, Aug 28, 5:10 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot

Tue, Aug 27

zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

The only thing needed is to support specifying two accounts, one bot, one sysop and allow to switch between them easily (by a parameter?)

Tue, Aug 27, 11:01 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T231356: Access to 'https://tools.wmflabs.org' blocked by CORS on 'https://test.wikipedia.org' (Header x-wikimedia-debug not allowed).

https://github.com/Krinkle/intuition-web/blob/master/public_html/api.php#L41 ?

Tue, Aug 27, 6:31 PM · cloud-services-team, Toolforge
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

At this point, all that would be left to be done is to devise a strategy for those who need to use different accounts on different wikis (or different accounts for different parts of the same script). The latter is such a rare use case, that I don't think we should prioritize working on it for now.

Tue, Aug 27, 3:22 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot

Fri, Aug 23

zhuyifei1999 awarded T71283: dualism between user and sysop needs to be overtaken a Love token.
Fri, Aug 23, 12:01 AM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

config2.py needs to emit a warning that sysopnames don't work anymore (if we decide to just break it)

Fri, Aug 23, 12:00 AM · Patch-For-Review, Pywikibot-login.py, Pywikibot

Aug 14 2019

zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

I fixed it!

tools.zhuyifei1999-test@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; jsub -continuous -N T229551-zhuyifei1999-test /data/project/zhuyifei1999-test/venv/bin/python -c 'print(__import__("sys").path)'
Your job 7135937 ("T229551-zhuyifei1999-test") has been submitted
tools.zhuyifei1999-test@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/usr/local/lib/python3.5/dist-packages', '/usr/lib/python3/dist-packages']
tools.zhuyifei1999-test@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; ./jsub -continuous -N T229551-zhuyifei1999-test /data/project/zhuyifei1999-test/venv/bin/python -c 'print(__import__("sys").path)'
Your job 7136067 ("T229551-zhuyifei1999-test") has been submitted
tools.zhuyifei1999-test@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/data/project/zhuyifei1999-test/venv/lib/python3.5/site-packages']
tools.zhuyifei1999-test@tools-sgebastion-08:~$ diff `which jsub` ./jsub -u
--- /usr/bin/jsub	2018-11-29 19:39:44.000000000 +0000
+++ ./jsub	2019-08-14 02:17:49.057655606 +0000
@@ -162,15 +162,15 @@
     """
     # Already a full path?
     if prog[0] == os.sep and os.path.exists(prog):
-        return os.path.realpath(prog)
+        return os.path.normpath(prog)
     if prog[0] != os.curdir:
         # Look in each dir of $PATH
         for path in os.environ.get('PATH', '').split(os.pathsep):
             if os.path.exists(os.path.join(path, prog)):
-                return os.path.realpath(os.path.join(path, prog))
+                return os.path.normpath(os.path.join(path, prog))
     # Not found in $PATH so try looking in $PWD
     if os.path.exists(os.path.join(os.getcwd(), prog)):
-        return os.path.realpath(os.path.join(os.getcwd(), prog))
+        return os.path.normpath(os.path.join(os.getcwd(), prog))
     raise argparse.ArgumentTypeError("Program '%s' not found." % prog)
Aug 14 2019, 2:19 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

jstart / jsub -continuous uses an implicit bash wrapper in order to to restart the job when it exits with an error. It has the side effect of keeping not needing those double escapes (T50811), and I thought it would work, but I proved myself wrong:

tools.database-reports@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; jsub -continuous -N T229551-zhuyifei1999-test /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(open("/proc/self/cmdline").read().replace("\0", "\n"))'
Your job 7135679 ("T229551-zhuyifei1999-test") has been submitted
tools.database-reports@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
/usr/bin/python3.5
-c
print(open("/proc/self/cmdline").read().replace("\0", "\n"))
Aug 14 2019, 2:07 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

Root cause is the character set @zhuyifei1999

Aug 14 2019, 1:41 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
01:34:55 0 ✓ zhuyifei1999@tools-sgebastion-08: ~$ virtualenv -p python3 T229551-test
Already using interpreter /usr/bin/python3
Using base prefix '/usr'
New python executable in /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python3
Also creating executable in /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python
Installing setuptools, pkg_resources, pip, wheel...done.
01:35:54 0 ✓ zhuyifei1999@tools-sgebastion-08: ~$ python3 -m venv T229551-test-2
01:36:44 0 ✓ zhuyifei1999@tools-sgebastion-08: ~$ ls -l /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test{,-2}/bin/python*
lrwxrwxrwx 1 zhuyifei1999 wikidev       7 Aug 14 01:36 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test-2/bin/python -> python3
lrwxrwxrwx 1 zhuyifei1999 wikidev      16 Aug 14 01:36 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test-2/bin/python3 -> /usr/bin/python3
lrwxrwxrwx 1 zhuyifei1999 wikidev       7 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python -> python3
-rwxr-xr-x 1 zhuyifei1999 wikidev 4751184 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python3
lrwxrwxrwx 1 zhuyifei1999 wikidev       7 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python3.5 -> python3
-rwxr-xr-x 1 zhuyifei1999 wikidev    2382 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python-config
Aug 14 2019, 1:40 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
tools.database-reports@tools-sgebastion-08:~$ ls -l /data/project/database-reports/reports/database-reports/venv/bin/python*
lrwxrwxrwx 1 tools.database-reports tools.database-reports  7 Jul 17 02:45 /data/project/database-reports/reports/database-reports/venv/bin/python -> python3
lrwxrwxrwx 1 tools.database-reports tools.database-reports 16 Jul 17 02:45 /data/project/database-reports/reports/database-reports/venv/bin/python3 -> /usr/bin/python3
tools.database-reports@tools-sgebastion-08:~$ mv /data/project/database-reports/reports/database-reports/venv/bin/python /data/project/database-reports/reports/database-reports/venv/bin/python.T229551-zhuyifei1999-test
tools.database-reports@tools-sgebastion-08:~$ cp /usr/bin/python3 /data/project/database-reports/reports/database-reports/venv/bin/python
tools.database-reports@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; jsub -N T229551-zhuyifei1999-test /data/project/database-reports/reports/database-reports/venv/bin/python -c "'"'print(open("/proc/self/cmdline").read().replace("\0", "\n"))'"'"
Your job 7134605 ("T229551-zhuyifei1999-test") has been submitted
tools.database-reports@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
/mnt/nfs/labstore-secondary-tools-project/database-reports/reports/database-reports/venv/bin/python
-c
print(open("/proc/self/cmdline").read().replace("\0", "\n"))
Aug 14 2019, 1:33 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

Is SGE nuts?

tools.database-reports@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*
tools.database-reports@tools-sgebastion-08:~$ (exec -a 'python' /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(open("/proc/self/cmdline").read().replace("\0", "\n"))')
python
-c
print(open("/proc/self/cmdline").read().replace("\0", "\n"))
Aug 14 2019, 1:26 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
tools.database-reports@tools-sgebastion-08:~$ (exec -a 'python' /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(__import__("sys").path);import mwclient')
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/usr/local/lib/python3.5/dist-packages', '/usr/lib/python3/dist-packages']
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named 'mwclient'
Aug 14 2019, 1:04 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
tools.database-reports@tools-sgebastion-08:~$ env -i /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(__import__("sys").path);import mwclient'
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/data/project/database-reports/reports/database-reports/venv/lib/python3.5/site-packages']
tools.database-reports@tools-sgebastion-08:~$ jsub -N T229551-zhuyifei1999-test /data/project/database-reports/reports/database-reports/venv/bin/python -c "'"'print(__import__("sys").path);import mwclient'"'"
Your job 7133608 ("T229551-zhuyifei1999-test") has been submitted
tools.database-reports@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named 'mwclient'
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/usr/local/lib/python3.5/dist-packages', '/usr/lib/python3/dist-packages']
Aug 14 2019, 12:58 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

Running it with empty env doesn't do. env -i /data/project/database-reports/reports/database-reports/venv/bin/python -c 'import mwclient' works fine on bastion.

Aug 14 2019, 12:51 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge

Aug 11 2019

zhuyifei1999 added a comment to T230284: Raise spacemedia tool memory limit.

Is this running on Kubernetes or on Grid Engine?

Aug 11 2019, 7:53 AM · Tool-spacemedia, Toolforge

Aug 7 2019

zhuyifei1999 awarded T223052: Server-side upload request for Hurtigruten minutt for minutt videos a Party Time token.
Aug 7 2019, 6:27 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 added a comment to T223052: Server-side upload request for Hurtigruten minutt for minutt videos.

Transcoding all done. Weeeeeee

Aug 7 2019, 2:54 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
Aug 7 2019, 2:52 PM · User-Urbanecm, Commons, Wikimedia-Site-requests

Aug 4 2019

zhuyifei1999 added a comment to T229193: Keep the server running.

but only you, other maintainers of the tool (by default nobody) and Toolforge admins (who must sign an NDA) can see it.

Aug 4 2019, 12:29 AM · PAWS

Aug 3 2019

zhuyifei1999 committed rTVTC926b79e125c8: Do nunjucks... (authored by zhuyifei1999).
Do nunjucks...
Aug 3 2019, 11:08 PM
zhuyifei1999 committed rTVTCa60c7d4edf13: Fix typos (authored by zhuyifei1999).
Fix typos
Aug 3 2019, 11:05 PM
zhuyifei1999 committed rTVTC3ade45866a08: Don't display extractor and use it to target during downloading (authored by zhuyifei1999).
Don't display extractor and use it to target during downloading
Aug 3 2019, 11:01 PM
zhuyifei1999 added a reverting change for rTVTC5e6715921ce1: urlextract: Use extractor instead of extractor_key for... extractor key: rTVTC2c28f36c8835: Revert "urlextract: Use extractor instead of extractor_key for... extractor key".
Aug 3 2019, 10:20 PM
zhuyifei1999 committed rTVTC2c28f36c8835: Revert "urlextract: Use extractor instead of extractor_key for... extractor key" (authored by zhuyifei1999).
Revert "urlextract: Use extractor instead of extractor_key for... extractor key"
Aug 3 2019, 10:20 PM
zhuyifei1999 committed rTVTC5e6715921ce1: urlextract: Use extractor instead of extractor_key for... extractor key (authored by zhuyifei1999).
urlextract: Use extractor instead of extractor_key for... extractor key
Aug 3 2019, 10:16 PM

Aug 2 2019

zhuyifei1999 added a comment to T229649: service.manifest for tools.persondata unexpectedly found using php version 5.6 rather than 7.2.

Interestingly/confusingly there is no mention of webservice in ~tools.persondata/.bash_history at all.

Aug 2 2019, 4:19 PM · Tools, Toolforge

Aug 1 2019

zhuyifei1999 added a project to T229605: File pages are not created: Fatal exception of type "Wikimedia\Rdbms\DBQueryError": MediaWiki-File-management.
Aug 1 2019, 6:44 PM · MediaWiki-Revision-backend, Wikimedia-production-error, video2commons, Commons, Wikimedia-database-error
zhuyifei1999 added a project to T229605: File pages are not created: Fatal exception of type "Wikimedia\Rdbms\DBQueryError": Wikimedia-production-error.
Aug 1 2019, 6:44 PM · MediaWiki-Revision-backend, Wikimedia-production-error, video2commons, Commons, Wikimedia-database-error

Jul 27 2019

zhuyifei1999 added a comment to T194859: Toolforge maintain-kubeusers doesn't fail well when LDAP servers are unreachable.

This might be happening again: SAL:

Jul 27 2019, 11:01 PM · cloud-services-team (Kanban), Toolforge
zhuyifei1999 created P8812 maintain-kubeusers stuck?.
Jul 27 2019, 10:56 PM
zhuyifei1999 added a comment to T229084: Can not submit Grid jobs in Toolforge.

Am I understanding correctly that when you run /usr/bin/jsub -N env_on_jobs -once -quiet node /data/project/cewbot/wikibot/env.js the job env_on_jobs is queued unexpectedly for a very long time?

Jul 27 2019, 4:12 AM · Toolforge

Jul 26 2019

zhuyifei1999 committed rTVTCa813aa2cdaa4: Set package.json to private (authored by zhuyifei1999).
Set package.json to private
Jul 26 2019, 6:33 PM
zhuyifei1999 committed rTVTC405cc5a6d50b: npm audit fix (authored by zhuyifei1999).
npm audit fix
Jul 26 2019, 6:27 PM
zhuyifei1999 committed rTVTC0658a0ab5f0b: Show beforeunload warning if $addTaskDialog is open (authored by zhuyifei1999).
Show beforeunload warning if $addTaskDialog is open
Jul 26 2019, 6:20 PM

Jul 25 2019

zhuyifei1999 committed rTVTC616a7c5c18b5: subtitles: Use langcodes instead of pycountry (authored by zhuyifei1999).
subtitles: Use langcodes instead of pycountry
Jul 25 2019, 8:00 PM

Jul 24 2019

zhuyifei1999 added a comment to T166949: Homedir/UID info breaks after a while in Tools Kubernetes (can't read replica.my.cnf).

OH but you CAN confirm it isn't. Got it.

Jul 24 2019, 5:05 PM · Patch-For-Review, Tool-Global-user-contributions, cloud-services-team (Kanban), Kubernetes, Toolforge, Cloud-VPS

Jul 18 2019

zhuyifei1999 committed rTVTCee67462bee52: download: Use empty UA for YouTube downloading (authored by zhuyifei1999).
download: Use empty UA for YouTube downloading
Jul 18 2019, 6:35 AM

Jul 9 2019

zhuyifei1999 added a comment to T166949: Homedir/UID info breaks after a while in Tools Kubernetes (can't read replica.my.cnf).

This is supposed to be set in the container spec: https://github.com/wikimedia/operations-software-tools-webservice/blob/master/toollabs/webservice/backends/kubernetesbackend.py#L438

Jul 9 2019, 11:06 PM · Patch-For-Review, Tool-Global-user-contributions, cloud-services-team (Kanban), Kubernetes, Toolforge, Cloud-VPS

Jul 1 2019

zhuyifei1999 edited projects for T226949: Query in Toolforge couldn't complete (timeout), added: Data-Services; removed Quarry.
Jul 1 2019, 5:57 PM · Data-Services, Regression

Jun 30 2019

zhuyifei1999 added a comment to T223052: Server-side upload request for Hurtigruten minutt for minutt videos.

Created T226937.

Jun 30 2019, 7:31 PM · User-Urbanecm, Commons, Wikimedia-Site-requests

Jun 26 2019

zhuyifei1999 added a comment to T226507: Port pywikibot-core to new pywikibot IV repository (tracking).

I don't remember what was the proposed solution at the meetup (maybe branch or tags, but no memory of creating a new repo at all), but the problem was discussed AFAICR. You also have to account for that at the meetup there are many of those who are just 'using pywikibot', but here, pretty much everyone is a pywikibot dev, who may have different priorities than end users.

Jun 26 2019, 7:05 AM · Pywikibot-RfCs, Pywikibot

Jun 25 2019

zhuyifei1999 added a comment to T226507: Port pywikibot-core to new pywikibot IV repository (tracking).

pwbc... pywikibot core; pwbd... pywikibot... daemon?

Jun 25 2019, 5:56 PM · Pywikibot-RfCs, Pywikibot

Jun 19 2019

zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.
[pid 27118] write(6, "172.16.6.39 tools.wmflabs.org - [19/Jun/2019:18:02:30 +0000] \"POST /wikiportretdev/upload.php HTTP/1.1\" 302 7506 \"https://tools."..., 248) = 248
Jun 19 2019, 6:21 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

Hmm, that flood of read() syscalls flooded my scrollback (I'm using screen). Would you try a smaller file? This is what it ended with (the file never reached PHP it seems):

373fV-\214\256\265\254!MR@\217\333\234\232O\227YOkk\7\273\357\216_Ll\n\300\232;b\310-"..., 4096) = 3000
[pid 27118] read(8, "", 4096)           = 0
[pid 27118] close(8)                    = 0
[pid 27118] accept4(4, 0x7ffcbd0539f0, [112], SOCK_CLOEXEC|SOCK_NONBLOCK) = -1 EAGAIN (Resource temporarily unavailable)
[pid 27118] open("/proc/loadavg", O_RDONLY) = 8
[pid 27118] read(8, "0.00 0.00 0.01 2/206 26797\n", 64) = 27
Jun 19 2019, 5:55 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

Did not get anything on the 4 PHPs. I just attached to lighttpd as well. Mind doing it again? Just to confirm, the tool is wikiportretdev right?

Jun 19 2019, 5:46 PM · Toolforge
zhuyifei1999 renamed T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened from WMFLabs: File upload fails because temp file can't be opened to Toolforge: File upload to PHP webservice fails because temp file can't be opened.
Jun 19 2019, 5:29 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

Just did some debugging and the issue already occurs on upload (just normal file upload via form POST). I tried to var_dump($_FILES);die(); and it already gives a Internal Server error before I even do anything else with the file.
All the error log says is:
2019-06-19 16:57:51: (chunk.c.553) opening temp-file failed: No such file or directory
2019-06-19 16:58:42: (chunk.c.553) opening temp-file failed: No such file or directory

Jun 19 2019, 5:26 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

What is the path that is being created / opened?

Jun 19 2019, 7:11 AM · Toolforge

Jun 7 2019

zhuyifei1999 committed rTVTC8ebed3fbe58a: urlextract: Remove emojies from titles (authored by zhuyifei1999).
urlextract: Remove emojies from titles
Jun 7 2019, 6:42 PM

May 31 2019

zhuyifei1999 added a comment to T223052: Server-side upload request for Hurtigruten minutt for minutt videos.

Had a delay in the progress because I didn't notice the during the scratch server migration the mount was set read-only.

May 31 2019, 10:36 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
May 31 2019, 10:35 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 updated subscribers of T153068: Consider mounting labs NFS labstore1003.eqiad.wmnet:/scratch for server-side uploads.

I don't mind which server it is mounting as long as it matches the current scratch server used in the video project. The point of this task was to make it easier to do server side uploads by removing the overhead of wget the files, but since @Dereckson hasn't been doing server-side uploads recently, I'd ask if @Reedy wants this.

May 31 2019, 10:28 PM · cloud-services-team (Kanban), Data-Services, Operations, video2commons

May 25 2019

zhuyifei1999 merged T224317: TSV variant of Quarry output is malformed into T224300: Extra tab is prepended to quoted fields in TSV output format.
May 25 2019, 12:20 PM · Patch-For-Review, Quarry
zhuyifei1999 merged task T224317: TSV variant of Quarry output is malformed into T224300: Extra tab is prepended to quoted fields in TSV output format.
May 25 2019, 12:20 PM · Quarry
zhuyifei1999 added a comment to T224317: TSV variant of Quarry output is malformed.

Sorry, T224300

May 25 2019, 12:20 PM · Quarry

May 24 2019

zhuyifei1999 added a comment to T224317: TSV variant of Quarry output is malformed.

Quotes are intended to the extent that any fields that contains a delimiter should be quoted. Extraneous tabs ("delimiters") are caused by T224317

May 24 2019, 10:39 PM · Quarry
zhuyifei1999 added a comment to T224317: TSV variant of Quarry output is malformed.

T224317?

May 24 2019, 9:06 PM · Quarry
zhuyifei1999 awarded T223620: Create a Toolforge tool to search wikitext across all wikis using Elastic Search a Love token.
May 24 2019, 7:45 PM · Tool-global-search, Wikimedia-Hackathon-2019
zhuyifei1999 added a comment to T224300: Extra tab is prepended to quoted fields in TSV output format.

This is from T209226: Quarry can be affected by CSV Injection. It's not supposed to hit every line. I'm looking into it.

May 24 2019, 5:35 PM · Patch-For-Review, Quarry
zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
May 24 2019, 1:37 AM · User-Urbanecm, Commons, Wikimedia-Site-requests

May 21 2019

zhuyifei1999 added a comment to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.

Wednesday, May 22 13:00–15:00 UTC

May 21 2019, 12:33 AM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites

May 20 2019

zhuyifei1999 added a comment to T178520: Find somewhere else (not NFS) to store Quarry's resultsets.

Is the NFS server you're using being shared with other projects e.g. tools?

May 20 2019, 8:09 AM · Quarry

May 19 2019

zhuyifei1999 added a comment to T178520: Find somewhere else (not NFS) to store Quarry's resultsets.

It is a bottleneck only when people attempt to push our limits. T188564#4778741 has some graphs (the Wait I/O is D-sleep, NFS lag). I'm currently unable to reproduce so much NFS lag as in the graphs (maybe the situation with NFS has improved?)

May 19 2019, 11:56 PM · Quarry
zhuyifei1999 added a comment to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.

I'm fine either way

May 19 2019, 1:07 PM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites
zhuyifei1999 added a comment to T223777: Add ca_ES.UTF-8 locale to Toolforge hosts.

is this because ca_ES.UTF-8 locale isn't installed?

May 19 2019, 12:57 PM · Toolforge (Software install/update)
zhuyifei1999 added a project to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese: Wikimedia-Hackathon-2019.
May 19 2019, 12:54 PM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites
zhuyifei1999 added a comment to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.

https://zh.wikivoyage.beta.wmflabs.org/zh-cn/%E6%B5%8B%E8%AF%95
https://zh.wikivoyage.beta.wmflabs.org/zh-hk/%E6%B5%8B%E8%AF%95

May 19 2019, 11:04 AM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites
zhuyifei1999 added a comment to T223777: Add ca_ES.UTF-8 locale to Toolforge hosts.

Please post the output of your locale command.

May 19 2019, 10:10 AM · Toolforge (Software install/update)
Jdlrobson awarded T223770: Please create beta zhwikivoyage a Mountain of Wealth token.
May 19 2019, 8:09 AM · Chinese-Sites, Wikimedia-Hackathon-2019, Patch-For-Review, Beta-Cluster-Infrastructure
zhuyifei1999 added a comment to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.

T223770: Please create beta zhwikivoyage

May 19 2019, 8:05 AM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites
zhuyifei1999 created T223770: Please create beta zhwikivoyage.
May 19 2019, 8:05 AM · Chinese-Sites, Wikimedia-Hackathon-2019, Patch-For-Review, Beta-Cluster-Infrastructure
zhuyifei1999 added a comment to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.

bd808 just gave me steward rights and still https://en.wikivoyage.beta.wmflabs.org/wiki/Special:PageLanguage doesn't exist. I guess it's configuration-disabled rather than lack of permissions. So yeah, let's create that wiki.

May 19 2019, 8:01 AM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites

May 18 2019

zhuyifei1999 added a comment to T223750: Include pinyin for zhwiki damaging model.

These I don't use:

  • an, ang
  • l, n
  • f, h
  • l, r
  • g, k
May 18 2019, 8:22 PM · Chinese-Sites, editquality-modeling, artificial-intelligence, Scoring-platform-team
zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
May 18 2019, 6:53 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
May 18 2019, 6:51 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 added a comment to T221801: Pywikibot meetup wikimedia hackathon 2019 (usage and/or development workshop, issues and future discussion, other stuff to talk about).

k. I'll be there

May 18 2019, 7:38 AM · Pywikibot, Wikimedia-Hackathon-2019
zhuyifei1999 added a comment to T221801: Pywikibot meetup wikimedia hackathon 2019 (usage and/or development workshop, issues and future discussion, other stuff to talk about).

You mean 3PM? Sure. Where though?

May 18 2019, 7:28 AM · Pywikibot, Wikimedia-Hackathon-2019

May 17 2019

zhuyifei1999 added a comment to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.

You can try testing this out on https://en.wikivoyage.beta.wmflabs.org/?uselang=zh !

May 17 2019, 9:17 PM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites
zhuyifei1999 closed T220272: Adoption request for Templatetransclusioncheck as Resolved.

Done. @Adithyak1997 I highly recommend you find a co-maintainer for this tool.

May 17 2019, 5:50 PM · Toolforge-standards-committee
zhuyifei1999 added a comment to T220272: Adoption request for Templatetransclusioncheck.

Does that mean the tool was run externally by just using db?

May 17 2019, 5:46 PM · Toolforge-standards-committee
zhuyifei1999 added a comment to T220272: Adoption request for Templatetransclusioncheck.

Tool does not own any databases:

tools.templatetransclusioncheck@tools-sgebastion-08:~/public_html$ id
uid=52410(tools.templatetransclusioncheck) gid=52410(tools.templatetransclusioncheck) groups=52410(tools.templatetransclusioncheck)
tools.templatetransclusioncheck@tools-sgebastion-08:~/public_html$ sql local
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 113317962
Server version: 10.1.38-MariaDB MariaDB Server
May 17 2019, 5:42 PM · Toolforge-standards-committee
zhuyifei1999 added a comment to T220272: Adoption request for Templatetransclusioncheck.

./.viminfo -- No secret data found
./replica.my.cnf -- Toolforge infra
./.cache -- contains single empty file .cache/motd.legal-displayed
./.ssh -- contains single file known_hosts
./.ssh/known_hosts -- Even if this contains secret data, it is hashed
./crontab.trusty.save -- No secret data found
./.kube/config -- Toolforge infra
./.bash_history -- No secret data found
./.lesshst -- No secret data found

May 17 2019, 5:38 PM · Toolforge-standards-committee
zhuyifei1999 claimed T220272: Adoption request for Templatetransclusioncheck.

(We talked abut this at the hackathon; going ahead)

May 17 2019, 5:19 PM · Toolforge-standards-committee
zhuyifei1999 added a comment to T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.

Let's see if it works correctly next week when it's deployed. (I only tested in vagrant)

May 17 2019, 4:57 PM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites
zhuyifei1999 awarded T221293: PAWS - How it works, what can it do, where can we take it? a Like token.
May 17 2019, 4:47 PM · PAWS, Wikimedia-Hackathon-2019
zhuyifei1999 claimed T217501: Page banner of Wikivoyage can not automatically convert the problem of tranditional or simplified Chinese.
May 17 2019, 2:02 PM · Wikimedia-Hackathon-2019, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), Patch-For-Review, Language-Team, Readers-Web-Backlog (Tracking), Reading-Web-Local-Wiki-Issues, Wikidata-Page-Banner, Chinese-Sites
zhuyifei1999 updated subscribers of T221657: 500 error when deleting ssh key from toolsadmin.
May 17 2019, 12:38 PM · cloud-services-team (Kanban), Striker

May 16 2019

zhuyifei1999 added a comment to T184712: Page.title(as_url=True) should encode also slashes.

No, the title was 'fixed', but is reopened for a (partial) revert afaict.

May 16 2019, 8:00 PM · Patch-For-Review, Pywikibot
zhuyifei1999 added a comment to T221801: Pywikibot meetup wikimedia hackathon 2019 (usage and/or development workshop, issues and future discussion, other stuff to talk about).

Anyone at the bar?

May 16 2019, 6:21 PM · Pywikibot, Wikimedia-Hackathon-2019

May 15 2019

zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
May 15 2019, 3:56 AM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 renamed T223052: Server-side upload request for Hurtigruten minutt for minutt videos from Server-side upload request for Zhuyifei1999 to Server-side upload request for Hurtigruten minutt for minutt videos.
May 15 2019, 3:53 AM · User-Urbanecm, Commons, Wikimedia-Site-requests