Page MenuHomePhabricator

zhuyifei1999
*Not* Serious business title.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Oct 13 2014, 10:19 AM (265 w, 5 d)
Availability
Available
IRC Nick
zhuyifei1999
LDAP User
Zhuyifei1999
MediaWiki User
Zhuyifei1999 [ Global Accounts ]

There is currently no text in this page. You can search for this page title in other pages, or search the related logs.

Recent Activity

Thu, Nov 14

zhuyifei1999 added a comment to T238375: quarry-web-01 leaks files in /tmp.

xlsxwriter creates temp files at two places,

Thu, Nov 14, 10:11 PM · Quarry
zhuyifei1999 added a comment to T238375: quarry-web-01 leaks files in /tmp.

They seem to be uncompressed xlsx worksheets.

Thu, Nov 14, 10:01 PM · Quarry
zhuyifei1999 created T238375: quarry-web-01 leaks files in /tmp.
Thu, Nov 14, 9:52 PM · Quarry
zhuyifei1999 closed T235768: generate_family_file.py crashes when run against private wikis as Resolved.
Thu, Nov 14, 7:24 AM · Pywikibot
zhuyifei1999 added a comment to T188941: Consider different varieties of Cloud VPS instance flavors.

Just so this doesn't get lost:

Thu, Nov 14, 3:09 AM · cloud-services-team (Kanban), Cloud-VPS

Wed, Nov 13

zhuyifei1999 closed T235811: Wikimedia Commons "Collapse captions" gadget not working as Resolved.

Workarounded. https://commons.wikimedia.org/wiki/MediaWiki:Gadget-Collapse-Captions.js Ideally this should still be brought in-house. You now have a MutationObserver.

Wed, Nov 13, 12:19 AM · SDC General, Commons

Tue, Nov 12

zhuyifei1999 added a comment to T235811: Wikimedia Commons "Collapse captions" gadget not working.

@zhuyifei1999: Commons is a project tag dedicated to Commons issues and it is set on this task, so this feels like a valid task under Commons.

Tue, Nov 12, 9:59 PM · SDC General, Commons

Mon, Nov 11

zhuyifei1999 placed T235811: Wikimedia Commons "Collapse captions" gadget not working up for grabs.

So I tried to fix this.

Mon, Nov 11, 6:28 PM · SDC General, Commons
zhuyifei1999 added a comment to T236704: Importation of the youtube channel "Les possédés et leurs mondes".

@zhuyifei1999 I am getting the same "YouTube said: Unable to extract video data" error. Do you think you can take a look?

Mon, Nov 11, 6:03 PM · Wiki-Techstorm-2019, video2commons, Commons
zhuyifei1999 closed T235811: Wikimedia Commons "Collapse captions" gadget not working as Invalid.

Tracking issues with on-wiki gadgets on wiki.

Mon, Nov 11, 2:26 AM · SDC General, Commons
zhuyifei1999 placed T141438: [[Wikimedia:Video2commons-confirmmsg]] i18n issue up for grabs.
Mon, Nov 11, 2:13 AM · video2commons, I18n
zhuyifei1999 placed T141439: [[Wikimedia:Video2commons-notessubtitles]] i18n issue up for grabs.
Mon, Nov 11, 2:13 AM · video2commons, I18n

Wed, Nov 6

zhuyifei1999 added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

Can you use video2commons? I don't know what CDC does, but I'd assume that is the download + transcode + upload, which is the same as what v2c does in the backend, which is on special-purpose instances, unlike toolforge's generic grid.

Wed, Nov 6, 3:27 AM · cloud-services-team (Kanban), Cloud-VPS, video2commons

Tue, Nov 5

zhuyifei1999 added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

If someone can explain how I can legitimately run an FFmpeg recoding job on webgrid and save the files on a WMF server, that would be useful, but this experience, including getting warnings about my work, has seriously discouraged me from relying on WMF cloud services in the future, primarily because of the massive waste of precious volunteer time it takes to keep on testing and rewriting code to fit in with ever changing, non-specific and hard to understand "requirements" of this environment, compared to simply hosting a script on my own ancient kit.

Tue, Nov 5, 5:26 PM · cloud-services-team (Kanban), Cloud-VPS, video2commons
zhuyifei1999 added a comment to T236348: Give suppressredirect right to filemovers on Commons.

Please don't feel pressured to do a translation that you don't want to do. This isn't an urgent matter that has to be resolved immediately. We can wait a little while longer to find a translator. I would never want you to feel forced to do something that you are uncomfortable with.

Tue, Nov 5, 5:03 AM · User-DannyS712, Wikimedia-Site-requests, Commons

Sun, Nov 3

zhuyifei1999 added a comment to T236348: Give suppressredirect right to filemovers on Commons.

I can do a Chinese translation as a last resort tomorrow, but it might not be great / idiomatic and will probably sound weird.

Sun, Nov 3, 7:24 AM · User-DannyS712, Wikimedia-Site-requests, Commons

Fri, Nov 1

zhuyifei1999 added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

Looks like the rate limit is currently lifted :)

Fri, Nov 1, 7:13 PM · cloud-services-team (Kanban), Cloud-VPS, video2commons
zhuyifei1999 added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

@zhuyifei1999 Does v2c typically do the downloads on Toolforge, or are the instances in the video Cloud VPS project actually doing that work? If it is the latter, we could try a temporary solution of adding public IPv4 addresses to the video instances to spread across more IPs which would hopefully give a larger quota from YouTube.

Fri, Nov 1, 5:29 PM · cloud-services-team (Kanban), Cloud-VPS, video2commons
zhuyifei1999 added a comment to T237097: Server side upload for Sporti.

Yeah, stashfailed is somewhat random. For big files (> around 2G), it sometimes works sometimes not. And the worst part is that immediately retrying after a failure almost always fails (due to things like lock issues). If a task was created through v2c than an upload was attempted and failed. Waiting a while a retry might work but not guaranteed.

Fri, Nov 1, 3:07 PM · video2commons, Commons

Thu, Oct 31

zhuyifei1999 committed rTVTCa0a23091f687: Fix StrictRedis LREM as well (authored by zhuyifei1999).
Fix StrictRedis LREM as well
Thu, Oct 31, 7:18 PM

Tue, Oct 29

zhuyifei1999 added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

@Fae .... Try running it in one of the kubernetes python shell

Tue, Oct 29, 3:51 PM · cloud-services-team (Kanban), Cloud-VPS, video2commons

Mon, Oct 28

zhuyifei1999 added a comment to T235627: Toolforge: upgrade main proxy servers to Debian Buster.

No idea how it used to work (T56052 is old), but zhuyifei1999@tools-sgebastion-08: ~$ curl tools.wmflabs.org now hangs.

Mon, Oct 28, 9:49 PM · Toolforge, cloud-services-team (Kanban), Kubernetes
zhuyifei1999 merged T236705: video2commons broken after import attempt into T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.
Mon, Oct 28, 4:43 PM · cloud-services-team (Kanban), Cloud-VPS, video2commons
zhuyifei1999 merged task T236705: video2commons broken after import attempt into T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.
Mon, Oct 28, 4:42 PM · video2commons, Commons
zhuyifei1999 added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

However that's a bit odd considering that the code does work when not on the grid, unless the problem is that IP addresses used by the grid host are getting blocked by YouTube/Google while the IP addresses used via live sessions are not.

Mon, Oct 28, 4:41 PM · cloud-services-team (Kanban), Cloud-VPS, video2commons
Fae awarded T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads a Hungry Hippo token.
Mon, Oct 28, 1:38 PM · cloud-services-team (Kanban), Cloud-VPS, video2commons

Sat, Oct 26

zhuyifei1999 committed rTVTC159730fb161e: requirements.txt: Commont out pywikibot (authored by zhuyifei1999).
requirements.txt: Commont out pywikibot
Sat, Oct 26, 9:58 PM
zhuyifei1999 committed rTVTC7a5109c62adf: Newer redis python are strictredis by default (authored by zhuyifei1999).
Newer redis python are strictredis by default
Sat, Oct 26, 9:58 PM

Fri, Oct 25

zhuyifei1999 claimed T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.
Fri, Oct 25, 12:39 AM · cloud-services-team (Kanban), Cloud-VPS, video2commons
zhuyifei1999 added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

Yeah, https://commons.wikimedia.org/wiki/Commons:Village_pump#video2commons this happened. How do I workaround this....

Fri, Oct 25, 12:39 AM · cloud-services-team (Kanban), Cloud-VPS, video2commons

Oct 13 2019

zhuyifei1999 committed rPWBCe0730be19a7c: site_tests.py: Only threads started by the test for test_lock_page (authored by zhuyifei1999).
site_tests.py: Only threads started by the test for test_lock_page
Oct 13 2019, 7:06 PM
zhuyifei1999 closed T235320: test_articles and test_members methods of category_tests.TestCategoryObject are failing as Resolved.

https://travis-ci.org/wikimedia/pywikibot/jobs/597288441

Oct 13 2019, 4:40 PM · Pywikibot, Pywikibot-tests

Oct 11 2019

zhuyifei1999 committed rPWBCa93412adf7e0: site.py: lock_page release mutex during sleep (authored by zhuyifei1999).
site.py: lock_page release mutex during sleep
Oct 11 2019, 3:29 PM
zhuyifei1999 closed T235245: kaleem-bot as Invalid.
Oct 11 2019, 4:45 AM · Trash

Oct 1 2019

zhuyifei1999 closed T234310: Quarry struggling on the queue (2019-10-01) as Resolved.

I ssh-ed in to both workers, no weird behavior. No logs either. It's as if the celery workers never received the tasks.

Oct 1 2019, 11:56 AM · User-revi, cloud-services-team (Kanban), Quarry

Sep 28 2019

zhuyifei1999 added a comment to T233924: Server side upload for Nederlandse Leeuw.

Error: 'An exception occurred: TaskError: pywikibot.Error: APIError: chunk-too-small: Minimum chunk size is 1,024 bytes for non-final chunks.'

Sep 28 2019, 4:57 AM · Commons, Wikimedia-Site-requests, User-Urbanecm

Sep 26 2019

zhuyifei1999 added a comment to T210959: Make tools-static fontcdn/ and cdnjs/ redact UA.

(Why did I not get a phab notification?)

Sep 26 2019, 5:39 AM · cloud-services-team (Kanban), Toolforge, Privacy

Sep 22 2019

zhuyifei1999 added projects to T233530: When user create tool via toolsadmin, it doesn't create replica.my.cnf: Data-Services, cloud-services-team.
Sep 22 2019, 5:34 PM · cloud-services-team (Kanban), Data-Services, Toolforge

Sep 7 2019

zhuyifei1999 committed rPWBC6f0cafd37d59: Deprecate sysopnames (authored by Huji).
Deprecate sysopnames
Sep 7 2019, 5:50 PM

Aug 29 2019

zhuyifei1999 edited projects for T230758: Drop database s54020__wsexporttest_p and grant access to Quarry, added: Data-Services; removed Tool-Database-Queries, Toolforge.

By the way, should Quarry be able to access the tools' databases when they have a _p suffix? I'm getting "Access denied for user 's52788'@'%' to database 's54020__wsexport_test_p'". Is it possible to give it access to both databases?

Aug 29 2019, 3:40 PM · Data-Services
zhuyifei1999 merged T227942: Pushing "Explain" button outputs "Error Hmm... Is the SQL actually running?!" into T205214: EXPLAIN is broken because new analytics wiki replica cluster contains multiple servers.
Aug 29 2019, 3:35 PM · Patch-For-Review, Quarry
zhuyifei1999 merged task T227942: Pushing "Explain" button outputs "Error Hmm... Is the SQL actually running?!" into T205214: EXPLAIN is broken because new analytics wiki replica cluster contains multiple servers.
Aug 29 2019, 3:35 PM · Quarry

Aug 28 2019

zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

This is assuming the default family/lang is Commons. The same applies to any other site if the parameters passed to the Site constructor matches any case given to the usernames dict.

Aug 28 2019, 6:46 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

True that, it can be just one username per site, the preferred one? But listing that usernames can be actually useful as a safeguard, to not allow an username that's defined, but not allowed in usernames list, in case I don't want to use one username somewhere for some reason. Feel free to make it only default username, that's fine as well, just thinking loud :).

Aug 28 2019, 6:25 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

BTW Pywikibot tests miss the way to simply switch between several accounts (OAuth, BotPasswords, regular password) as well.

Aug 28 2019, 6:11 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.
user-config.py
accounts = {
    "oznamovatel": {
        "username": "Oznamovatel",
        "oauth": [ consumer key, consumer secret, client key, client secret ]
    },
    "urbanecmbot": {
        "username": "UrbanecmBot",
        "oauth": [ consumer key, consumer secret, client key, client secret ]
    }
}
usernames['wikipedia']['cs'] = [  'urbanecmbot', 'oznamovatelbot' ] # both urbanecmbot and oznamovatelbot used
usernames['wikipedia']['en'] = [  'urbanecmbot' ] # only urbanecmbot used
Aug 28 2019, 6:10 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

This is quite common situation on Czech Wikipedia, one bot account and one sysop account for every sysop bot operator, edits by Pywikibot are made from each of them depending on whether sysop rights are needed or not. I suggest somethng like this (pseudocode):

Aug 28 2019, 5:10 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot

Aug 27 2019

zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

The only thing needed is to support specifying two accounts, one bot, one sysop and allow to switch between them easily (by a parameter?)

Aug 27 2019, 11:01 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T231356: Access to 'https://tools.wmflabs.org' blocked by CORS on 'https://test.wikipedia.org' (Header x-wikimedia-debug not allowed).

https://github.com/Krinkle/intuition-web/blob/master/public_html/api.php#L41 ?

Aug 27 2019, 6:31 PM · cloud-services-team, Toolforge
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

At this point, all that would be left to be done is to devise a strategy for those who need to use different accounts on different wikis (or different accounts for different parts of the same script). The latter is such a rare use case, that I don't think we should prioritize working on it for now.

Aug 27 2019, 3:22 PM · Patch-For-Review, Pywikibot-login.py, Pywikibot

Aug 23 2019

zhuyifei1999 awarded T71283: dualism between user and sysop needs to be overtaken a Love token.
Aug 23 2019, 12:01 AM · Patch-For-Review, Pywikibot-login.py, Pywikibot
zhuyifei1999 added a comment to T71283: dualism between user and sysop needs to be overtaken.

config2.py needs to emit a warning that sysopnames don't work anymore (if we decide to just break it)

Aug 23 2019, 12:00 AM · Patch-For-Review, Pywikibot-login.py, Pywikibot

Aug 14 2019

zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

I fixed it!

tools.zhuyifei1999-test@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; jsub -continuous -N T229551-zhuyifei1999-test /data/project/zhuyifei1999-test/venv/bin/python -c 'print(__import__("sys").path)'
Your job 7135937 ("T229551-zhuyifei1999-test") has been submitted
tools.zhuyifei1999-test@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/usr/local/lib/python3.5/dist-packages', '/usr/lib/python3/dist-packages']
tools.zhuyifei1999-test@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; ./jsub -continuous -N T229551-zhuyifei1999-test /data/project/zhuyifei1999-test/venv/bin/python -c 'print(__import__("sys").path)'
Your job 7136067 ("T229551-zhuyifei1999-test") has been submitted
tools.zhuyifei1999-test@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/data/project/zhuyifei1999-test/venv/lib/python3.5/site-packages']
tools.zhuyifei1999-test@tools-sgebastion-08:~$ diff `which jsub` ./jsub -u
--- /usr/bin/jsub	2018-11-29 19:39:44.000000000 +0000
+++ ./jsub	2019-08-14 02:17:49.057655606 +0000
@@ -162,15 +162,15 @@
     """
     # Already a full path?
     if prog[0] == os.sep and os.path.exists(prog):
-        return os.path.realpath(prog)
+        return os.path.normpath(prog)
     if prog[0] != os.curdir:
         # Look in each dir of $PATH
         for path in os.environ.get('PATH', '').split(os.pathsep):
             if os.path.exists(os.path.join(path, prog)):
-                return os.path.realpath(os.path.join(path, prog))
+                return os.path.normpath(os.path.join(path, prog))
     # Not found in $PATH so try looking in $PWD
     if os.path.exists(os.path.join(os.getcwd(), prog)):
-        return os.path.realpath(os.path.join(os.getcwd(), prog))
+        return os.path.normpath(os.path.join(os.getcwd(), prog))
     raise argparse.ArgumentTypeError("Program '%s' not found." % prog)
Aug 14 2019, 2:19 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

jstart / jsub -continuous uses an implicit bash wrapper in order to to restart the job when it exits with an error. It has the side effect of keeping not needing those double escapes (T50811), and I thought it would work, but I proved myself wrong:

tools.database-reports@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; jsub -continuous -N T229551-zhuyifei1999-test /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(open("/proc/self/cmdline").read().replace("\0", "\n"))'
Your job 7135679 ("T229551-zhuyifei1999-test") has been submitted
tools.database-reports@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
/usr/bin/python3.5
-c
print(open("/proc/self/cmdline").read().replace("\0", "\n"))
Aug 14 2019, 2:07 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

Root cause is the character set @zhuyifei1999

Aug 14 2019, 1:41 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
01:34:55 0 ✓ zhuyifei1999@tools-sgebastion-08: ~$ virtualenv -p python3 T229551-test
Already using interpreter /usr/bin/python3
Using base prefix '/usr'
New python executable in /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python3
Also creating executable in /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python
Installing setuptools, pkg_resources, pip, wheel...done.
01:35:54 0 ✓ zhuyifei1999@tools-sgebastion-08: ~$ python3 -m venv T229551-test-2
01:36:44 0 ✓ zhuyifei1999@tools-sgebastion-08: ~$ ls -l /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test{,-2}/bin/python*
lrwxrwxrwx 1 zhuyifei1999 wikidev       7 Aug 14 01:36 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test-2/bin/python -> python3
lrwxrwxrwx 1 zhuyifei1999 wikidev      16 Aug 14 01:36 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test-2/bin/python3 -> /usr/bin/python3
lrwxrwxrwx 1 zhuyifei1999 wikidev       7 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python -> python3
-rwxr-xr-x 1 zhuyifei1999 wikidev 4751184 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python3
lrwxrwxrwx 1 zhuyifei1999 wikidev       7 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python3.5 -> python3
-rwxr-xr-x 1 zhuyifei1999 wikidev    2382 Aug 14 01:35 /mnt/nfs/labstore-secondary-tools-home/zhuyifei1999/T229551-test/bin/python-config
Aug 14 2019, 1:40 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
tools.database-reports@tools-sgebastion-08:~$ ls -l /data/project/database-reports/reports/database-reports/venv/bin/python*
lrwxrwxrwx 1 tools.database-reports tools.database-reports  7 Jul 17 02:45 /data/project/database-reports/reports/database-reports/venv/bin/python -> python3
lrwxrwxrwx 1 tools.database-reports tools.database-reports 16 Jul 17 02:45 /data/project/database-reports/reports/database-reports/venv/bin/python3 -> /usr/bin/python3
tools.database-reports@tools-sgebastion-08:~$ mv /data/project/database-reports/reports/database-reports/venv/bin/python /data/project/database-reports/reports/database-reports/venv/bin/python.T229551-zhuyifei1999-test
tools.database-reports@tools-sgebastion-08:~$ cp /usr/bin/python3 /data/project/database-reports/reports/database-reports/venv/bin/python
tools.database-reports@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*; jsub -N T229551-zhuyifei1999-test /data/project/database-reports/reports/database-reports/venv/bin/python -c "'"'print(open("/proc/self/cmdline").read().replace("\0", "\n"))'"'"
Your job 7134605 ("T229551-zhuyifei1999-test") has been submitted
tools.database-reports@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
/mnt/nfs/labstore-secondary-tools-project/database-reports/reports/database-reports/venv/bin/python
-c
print(open("/proc/self/cmdline").read().replace("\0", "\n"))
Aug 14 2019, 1:33 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

Is SGE nuts?

tools.database-reports@tools-sgebastion-08:~$ truncate -s 0 T229551-zhuyifei1999-test.*
tools.database-reports@tools-sgebastion-08:~$ (exec -a 'python' /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(open("/proc/self/cmdline").read().replace("\0", "\n"))')
python
-c
print(open("/proc/self/cmdline").read().replace("\0", "\n"))
Aug 14 2019, 1:26 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
tools.database-reports@tools-sgebastion-08:~$ (exec -a 'python' /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(__import__("sys").path);import mwclient')
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/usr/local/lib/python3.5/dist-packages', '/usr/lib/python3/dist-packages']
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named 'mwclient'
Aug 14 2019, 1:04 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.
tools.database-reports@tools-sgebastion-08:~$ env -i /data/project/database-reports/reports/database-reports/venv/bin/python -c 'print(__import__("sys").path);import mwclient'
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/data/project/database-reports/reports/database-reports/venv/lib/python3.5/site-packages']
tools.database-reports@tools-sgebastion-08:~$ jsub -N T229551-zhuyifei1999-test /data/project/database-reports/reports/database-reports/venv/bin/python -c "'"'print(__import__("sys").path);import mwclient'"'"
Your job 7133608 ("T229551-zhuyifei1999-test") has been submitted
tools.database-reports@tools-sgebastion-08:~$ cat T229551-zhuyifei1999-test.*
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named 'mwclient'
['', '/usr/lib/python35.zip', '/usr/lib/python3.5', '/usr/lib/python3.5/plat-x86_64-linux-gnu', '/usr/lib/python3.5/lib-dynload', '/usr/local/lib/python3.5/dist-packages', '/usr/lib/python3/dist-packages']
Aug 14 2019, 12:58 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge
zhuyifei1999 added a comment to T229551: Database-reports can't see packages in its virtualenv on the grid.

Running it with empty env doesn't do. env -i /data/project/database-reports/reports/database-reports/venv/bin/python -c 'import mwclient' works fine on bastion.

Aug 14 2019, 12:51 AM · Community-Tech (Kanban (Q1 2019-20)), Patch-For-Review, Tools, Toolforge

Aug 11 2019

zhuyifei1999 added a comment to T230284: Raise spacemedia tool memory limit.

Is this running on Kubernetes or on Grid Engine?

Aug 11 2019, 7:53 AM · Tool-spacemedia, Toolforge

Aug 7 2019

zhuyifei1999 awarded T223052: Server-side upload request for Hurtigruten minutt for minutt videos a Party Time token.
Aug 7 2019, 6:27 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 added a comment to T223052: Server-side upload request for Hurtigruten minutt for minutt videos.

Transcoding all done. Weeeeeee

Aug 7 2019, 2:54 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
Aug 7 2019, 2:52 PM · User-Urbanecm, Commons, Wikimedia-Site-requests

Aug 4 2019

zhuyifei1999 added a comment to T229193: Keep the server running.

but only you, other maintainers of the tool (by default nobody) and Toolforge admins (who must sign an NDA) can see it.

Aug 4 2019, 12:29 AM · PAWS

Aug 3 2019

zhuyifei1999 committed rTVTC926b79e125c8: Do nunjucks... (authored by zhuyifei1999).
Do nunjucks...
Aug 3 2019, 11:08 PM
zhuyifei1999 committed rTVTCa60c7d4edf13: Fix typos (authored by zhuyifei1999).
Fix typos
Aug 3 2019, 11:05 PM
zhuyifei1999 committed rTVTC3ade45866a08: Don't display extractor and use it to target during downloading (authored by zhuyifei1999).
Don't display extractor and use it to target during downloading
Aug 3 2019, 11:01 PM
zhuyifei1999 added a reverting change for rTVTC5e6715921ce1: urlextract: Use extractor instead of extractor_key for... extractor key: rTVTC2c28f36c8835: Revert "urlextract: Use extractor instead of extractor_key for... extractor key".
Aug 3 2019, 10:20 PM
zhuyifei1999 committed rTVTC2c28f36c8835: Revert "urlextract: Use extractor instead of extractor_key for... extractor key" (authored by zhuyifei1999).
Revert "urlextract: Use extractor instead of extractor_key for... extractor key"
Aug 3 2019, 10:20 PM
zhuyifei1999 committed rTVTC5e6715921ce1: urlextract: Use extractor instead of extractor_key for... extractor key (authored by zhuyifei1999).
urlextract: Use extractor instead of extractor_key for... extractor key
Aug 3 2019, 10:16 PM

Aug 2 2019

zhuyifei1999 added a comment to T229649: service.manifest for tools.persondata unexpectedly found using php version 5.6 rather than 7.2.

Interestingly/confusingly there is no mention of webservice in ~tools.persondata/.bash_history at all.

Aug 2 2019, 4:19 PM · Tools, Toolforge

Aug 1 2019

zhuyifei1999 added a project to T229605: File pages are not created: Fatal exception of type "Wikimedia\Rdbms\DBQueryError": MediaWiki-File-management.
Aug 1 2019, 6:44 PM · MediaWiki-Revision-backend, Wikimedia-production-error, video2commons, Commons, Wikimedia-database-error
zhuyifei1999 added a project to T229605: File pages are not created: Fatal exception of type "Wikimedia\Rdbms\DBQueryError": Wikimedia-production-error.
Aug 1 2019, 6:44 PM · MediaWiki-Revision-backend, Wikimedia-production-error, video2commons, Commons, Wikimedia-database-error

Jul 27 2019

zhuyifei1999 added a comment to T194859: Toolforge maintain-kubeusers doesn't fail well when LDAP servers are unreachable.

This might be happening again: SAL:

Jul 27 2019, 11:01 PM · cloud-services-team (Kanban), Toolforge
zhuyifei1999 created P8812 maintain-kubeusers stuck?.
Jul 27 2019, 10:56 PM
zhuyifei1999 added a comment to T229084: Can not submit Grid jobs in Toolforge.

Am I understanding correctly that when you run /usr/bin/jsub -N env_on_jobs -once -quiet node /data/project/cewbot/wikibot/env.js the job env_on_jobs is queued unexpectedly for a very long time?

Jul 27 2019, 4:12 AM · Toolforge

Jul 26 2019

zhuyifei1999 committed rTVTCa813aa2cdaa4: Set package.json to private (authored by zhuyifei1999).
Set package.json to private
Jul 26 2019, 6:33 PM
zhuyifei1999 committed rTVTC405cc5a6d50b: npm audit fix (authored by zhuyifei1999).
npm audit fix
Jul 26 2019, 6:27 PM
zhuyifei1999 committed rTVTC0658a0ab5f0b: Show beforeunload warning if $addTaskDialog is open (authored by zhuyifei1999).
Show beforeunload warning if $addTaskDialog is open
Jul 26 2019, 6:20 PM

Jul 25 2019

zhuyifei1999 committed rTVTC616a7c5c18b5: subtitles: Use langcodes instead of pycountry (authored by zhuyifei1999).
subtitles: Use langcodes instead of pycountry
Jul 25 2019, 8:00 PM

Jul 24 2019

zhuyifei1999 added a comment to T166949: Homedir/UID info breaks after a while in Tools Kubernetes (can't read replica.my.cnf).

OH but you CAN confirm it isn't. Got it.

Jul 24 2019, 5:05 PM · Patch-For-Review, Tool-Global-user-contributions, cloud-services-team (Kanban), Kubernetes, Toolforge, Cloud-VPS

Jul 18 2019

zhuyifei1999 committed rTVTCee67462bee52: download: Use empty UA for YouTube downloading (authored by zhuyifei1999).
download: Use empty UA for YouTube downloading
Jul 18 2019, 6:35 AM

Jul 9 2019

zhuyifei1999 added a comment to T166949: Homedir/UID info breaks after a while in Tools Kubernetes (can't read replica.my.cnf).

This is supposed to be set in the container spec: https://github.com/wikimedia/operations-software-tools-webservice/blob/master/toollabs/webservice/backends/kubernetesbackend.py#L438

Jul 9 2019, 11:06 PM · Patch-For-Review, Tool-Global-user-contributions, cloud-services-team (Kanban), Kubernetes, Toolforge, Cloud-VPS

Jul 1 2019

zhuyifei1999 edited projects for T226949: Query in Toolforge couldn't complete (timeout), added: Data-Services; removed Quarry.
Jul 1 2019, 5:57 PM · Data-Services, Regression

Jun 30 2019

zhuyifei1999 added a comment to T223052: Server-side upload request for Hurtigruten minutt for minutt videos.

Created T226937.

Jun 30 2019, 7:31 PM · User-Urbanecm, Commons, Wikimedia-Site-requests

Jun 26 2019

zhuyifei1999 added a comment to T226507: Port pywikibot-core to new pywikibot IV repository (tracking).

I don't remember what was the proposed solution at the meetup (maybe branch or tags, but no memory of creating a new repo at all), but the problem was discussed AFAICR. You also have to account for that at the meetup there are many of those who are just 'using pywikibot', but here, pretty much everyone is a pywikibot dev, who may have different priorities than end users.

Jun 26 2019, 7:05 AM · Pywikibot-RfCs, Pywikibot

Jun 25 2019

zhuyifei1999 added a comment to T226507: Port pywikibot-core to new pywikibot IV repository (tracking).

pwbc... pywikibot core; pwbd... pywikibot... daemon?

Jun 25 2019, 5:56 PM · Pywikibot-RfCs, Pywikibot

Jun 19 2019

zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.
[pid 27118] write(6, "172.16.6.39 tools.wmflabs.org - [19/Jun/2019:18:02:30 +0000] \"POST /wikiportretdev/upload.php HTTP/1.1\" 302 7506 \"https://tools."..., 248) = 248
Jun 19 2019, 6:21 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

Hmm, that flood of read() syscalls flooded my scrollback (I'm using screen). Would you try a smaller file? This is what it ended with (the file never reached PHP it seems):

373fV-\214\256\265\254!MR@\217\333\234\232O\227YOkk\7\273\357\216_Ll\n\300\232;b\310-"..., 4096) = 3000
[pid 27118] read(8, "", 4096)           = 0
[pid 27118] close(8)                    = 0
[pid 27118] accept4(4, 0x7ffcbd0539f0, [112], SOCK_CLOEXEC|SOCK_NONBLOCK) = -1 EAGAIN (Resource temporarily unavailable)
[pid 27118] open("/proc/loadavg", O_RDONLY) = 8
[pid 27118] read(8, "0.00 0.00 0.01 2/206 26797\n", 64) = 27
Jun 19 2019, 5:55 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

Did not get anything on the 4 PHPs. I just attached to lighttpd as well. Mind doing it again? Just to confirm, the tool is wikiportretdev right?

Jun 19 2019, 5:46 PM · Toolforge
zhuyifei1999 renamed T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened from WMFLabs: File upload fails because temp file can't be opened to Toolforge: File upload to PHP webservice fails because temp file can't be opened.
Jun 19 2019, 5:29 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

Just did some debugging and the issue already occurs on upload (just normal file upload via form POST). I tried to var_dump($_FILES);die(); and it already gives a Internal Server error before I even do anything else with the file.
All the error log says is:
2019-06-19 16:57:51: (chunk.c.553) opening temp-file failed: No such file or directory
2019-06-19 16:58:42: (chunk.c.553) opening temp-file failed: No such file or directory

Jun 19 2019, 5:26 PM · Toolforge
zhuyifei1999 added a comment to T225966: Toolforge: File upload to PHP webservice fails because temp file can't be opened.

What is the path that is being created / opened?

Jun 19 2019, 7:11 AM · Toolforge

Jun 7 2019

zhuyifei1999 committed rTVTC8ebed3fbe58a: urlextract: Remove emojies from titles (authored by zhuyifei1999).
urlextract: Remove emojies from titles
Jun 7 2019, 6:42 PM

May 31 2019

zhuyifei1999 added a comment to T223052: Server-side upload request for Hurtigruten minutt for minutt videos.

Had a delay in the progress because I didn't notice the during the scratch server migration the mount was set read-only.

May 31 2019, 10:36 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 updated the task description for T223052: Server-side upload request for Hurtigruten minutt for minutt videos.
May 31 2019, 10:35 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
zhuyifei1999 updated subscribers of T153068: Consider mounting labs NFS labstore1003.eqiad.wmnet:/scratch for server-side uploads.

I don't mind which server it is mounting as long as it matches the current scratch server used in the video project. The point of this task was to make it easier to do server side uploads by removing the overhead of wget the files, but since @Dereckson hasn't been doing server-side uploads recently, I'd ask if @Reedy wants this.

May 31 2019, 10:28 PM · cloud-services-team (Kanban), Data-Services, Operations, video2commons

May 25 2019

zhuyifei1999 merged T224317: TSV variant of Quarry output is malformed into T224300: Extra tab is prepended to quoted fields in TSV output format.
May 25 2019, 12:20 PM · Patch-For-Review, Quarry