Page MenuHomePhabricator

zhuyifei1999
*Not* Serious business title.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 13 2014, 10:19 AM (285 w, 1 d)
Availability
Available
IRC Nick
zhuyifei1999
LDAP User
Zhuyifei1999
MediaWiki User
Zhuyifei1999 [ Global Accounts ]

There is currently no text in this page. You can search for this page title in other pages, or search the related logs.

Recent Activity

Sun, Mar 29

zhuyifei1999 renamed T123823: Renumber commons TimedText namespace 102 to 710 from Renumber commons namespace 102 to 710 to Renumber commons TimedText namespace 102 to 710.
Sun, Mar 29, 2:07 AM · Commons, Technical-Debt, Wikimedia-Site-requests, TimedMediaHandler

Sat, Mar 28

zhuyifei1999 added a comment to T248581: PROPOSAL: To Design and Develop a tool to correct False depicts claims manually on Wikimedia Commons.

Hence this Project focuses on building such a tool named “WikiCommons Image Verification Tool”

Sat, Mar 28, 11:40 PM · Google-Summer-of-Code (2020)
zhuyifei1999 added a comment to T236341: Decouple UploadWizardConfig.maxUploads and maxUploads for Flickr imports.

Probably the most practical thing to do would be to apply this to beta cluster to test it.

Sat, Mar 28, 9:01 AM · Patch-For-Review, Commons, UploadWizard
zhuyifei1999 edited projects for T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02), added: Toolforge; removed Cloud-Services.
Sat, Mar 28, 8:16 AM · Toolforge, Patch-For-Review
zhuyifei1999 added a comment to T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02).

Ah I see. Wrong path.

Sat, Mar 28, 8:12 AM · Toolforge, Patch-For-Review
zhuyifei1999 updated subscribers of T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02).

@Bstorm @herron I can't see T175964, but I'm pretty sure https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/379239/ somehow broke it.

Sat, Mar 28, 8:07 AM · Toolforge, Patch-For-Review
zhuyifei1999 renamed T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02) from tools.wmflabs.org email isn't received to tools.wmflabs.org email isn't received (puppet failure at tools-mail-02).
Sat, Mar 28, 8:03 AM · Toolforge, Patch-For-Review
zhuyifei1999 added a comment to T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02).
root@tools-mail-02:~# puppet agent -tv
Info: Using configured environment 'production'
Info: Retrieving pluginfacts
Info: Retrieving plugin
Info: Loading facts
Info: Caching catalog for tools-mail-02.tools.eqiad.wmflabs
Notice: /Stage[main]/Base::Environment/Tidy[/var/tmp/core]: Tidying 0 files
Info: Applying configuration version '(1a925f799b) Bstorm - Add rate limiting to profile::toolforge::mailrelay with warn action'
Notice: The LDAP client stack for this host is: classic/sudoldap
Notice: /Stage[main]/Profile::Ldap::Client::Labs/Notify[LDAP client stack]/message: defined 'message' as 'The LDAP client stack for this host is: classic/sudoldap'
Error: /Stage[main]/Profile::Toolforge::Mailrelay/File[/etc/exim4/ratelimits/sender_hourly_limits]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///modules/profile/toolforge/mailrelay/ratelimits/sender_hourly_limits
Error: /Stage[main]/Profile::Toolforge::Mailrelay/File[/etc/exim4/ratelimits/host_hourly_limits]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///modules/profile/toolforge/mailrelay/ratelimits/host_hourly_limits
Notice: /Stage[main]/Profile::Toolforge::Mailrelay/Letsencrypt::Cert::Integrated[tools_mail]/Exec[acme-setup-acme-tools_mail]/returns: executed successfully
Info: Class[Profile::Toolforge::Mailrelay]: Unscheduling all events on Class[Profile::Toolforge::Mailrelay]
Info: Stage[main]: Unscheduling all events on Stage[main]
Notice: Applied catalog in 12.70 seconds
Sat, Mar 28, 8:02 AM · Toolforge, Patch-For-Review
zhuyifei1999 added a comment to T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02).

failed to open /etc/exim4/ratelimits/host_hourly_limits for linear search: No such file or directory

Sat, Mar 28, 8:00 AM · Toolforge, Patch-For-Review
zhuyifei1999 added a comment to T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02).

I see lots of fails that look like config issue in exim4 mainlog:

Sat, Mar 28, 7:57 AM · Toolforge, Patch-For-Review
zhuyifei1999 added a comment to T248731: tools.wmflabs.org email isn't received (puppet failure at tools-mail-02).

DNS looks fine:

Sat, Mar 28, 7:52 AM · Toolforge, Patch-For-Review

Thu, Mar 26

zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

I don't not able to identify if the graphs are unnatural -- I mean, parsing, which is what it is pending a lot of time on, is an expensive problem. Perhaps @Earwig can tell whether the graphs look expected? If so, then probably there is little I can do than say there is just not enough CPU power to solve the requests in a timely manner under the cpu-limiting cgroups k8s.

Thu, Mar 26, 5:32 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

60 second, 25 samples per second profile result for both processes:

Thu, Mar 26, 5:17 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

strace: full of futex(2)...

Thu, Mar 26, 4:53 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.
Thu Mar 26 04:40:44 2020 - *** uWSGI listen queue of socket ":8000" (fd: 7) full !!! (101/100) ***
Thu, Mar 26, 4:41 AM · Tools

Fri, Mar 20

zhuyifei1999 added a comment to T248190: Request creation of <PROJECT-NAME> VPS project.

How does project this relate to Wikimedia?

Fri, Mar 20, 6:37 PM · Cloud-VPS (Project-requests)

Thu, Mar 19

zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

Is it really slow even when it's not heavily loaded? In that case if you
could produce a test case I'll see if I can find what is taking the time.

Thu, Mar 19, 8:00 AM · Tools

Tue, Mar 17

zhuyifei1999 added a comment to T246970: Quarry: Lost connection to MySQL server during query.

a simple request system at https://www.mediawiki.org/wiki/Talk:Quarry

Tue, Mar 17, 9:53 PM · DBA, Quarry, Data-Services
zhuyifei1999 added a comment to T246970: Quarry: Lost connection to MySQL server during query.

@zhuyifei1999 Perhaps there could be some sort of a trusted user set on quarry that can run things for longer?

Tue, Mar 17, 8:41 PM · DBA, Quarry, Data-Services

Sat, Mar 14

zhuyifei1999 added a comment to T246970: Quarry: Lost connection to MySQL server during query.

@zhuyifei1999: But why? The query used to execute in 11 minutes max. Is it a congestion issue, as Mike Peel suspects?

Sat, Mar 14, 7:07 AM · DBA, Quarry, Data-Services

Fri, Mar 13

zhuyifei1999 raised the priority of T245758: Design and Develop a tool to correct false depicts claims manually on Wikimedia Commons from High to Needs Triage.
Fri, Mar 13, 7:41 PM · Technical-Tool-Request, Outreach-Programs-Projects, Google-Summer-of-Code (2020), Africa-Wikimedia-Developers
zhuyifei1999 added a comment to T246970: Quarry: Lost connection to MySQL server during query.

The query was executing for too long then.

Fri, Mar 13, 12:31 AM · DBA, Quarry, Data-Services

Thu, Mar 12

zhuyifei1999 awarded T247576: Proposal: Media Data Verification Tool - GSoC 2020 a Like token.
Thu, Mar 12, 10:14 PM · Google-Summer-of-Code (2020)
zhuyifei1999 added a subtask for T245758: Design and Develop a tool to correct false depicts claims manually on Wikimedia Commons: T247576: Proposal: Media Data Verification Tool - GSoC 2020.
Thu, Mar 12, 10:11 PM · Technical-Tool-Request, Outreach-Programs-Projects, Google-Summer-of-Code (2020), Africa-Wikimedia-Developers
zhuyifei1999 added a parent task for T247576: Proposal: Media Data Verification Tool - GSoC 2020: T245758: Design and Develop a tool to correct false depicts claims manually on Wikimedia Commons.
Thu, Mar 12, 10:11 PM · Google-Summer-of-Code (2020)

Wed, Mar 11

zhuyifei1999 reopened T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER' as "Open".

Sorry, was extremely busy last two weeks. I think if it's a bug it should stay open. I'll work on it next week.

Wed, Mar 11, 8:22 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

You just need to confirm your email and then you're all set. Also make sure alert@uptimerobot.com is on your contact list, since Gmail mistakes it for spam.

Wed, Mar 11, 8:20 PM · Tools

Sun, Mar 8

zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

zhuyifei1999 [at] gmail [dot] com

Sun, Mar 8, 9:00 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

If you'd like I can add you to our UptimeRobot reports, where you get emailed as soon as theirs downtime

Sun, Mar 8, 9:00 AM · Tools

Sat, Mar 7

zhuyifei1999 added a comment to T246970: Quarry: Lost connection to MySQL server during query.

I don't see quarry's killer doing anything. The last command at T246970#5946798 still yields nothing

Sat, Mar 7, 9:24 PM · DBA, Quarry, Data-Services
zhuyifei1999 added a comment to T246970: Quarry: Lost connection to MySQL server during query.

I don't see quarry's killer doing anything. The last command at T246970#5946798 still yields nothing

Sat, Mar 7, 8:19 PM · DBA, Quarry, Data-Services
zhuyifei1999 changed the status of T245426: Earwig's copyvio tool 504 gateway time-out issues from Stalled to Open.

Can confirm that there are lots of messages like this in the logs today:

Sat, Mar 7, 2:42 AM · Tools

Fri, Mar 6

zhuyifei1999 updated subscribers of T246970: Quarry: Lost connection to MySQL server during query.

Hmm I can see that quarry s indeed running on web rather than analytics.

Fri, Mar 6, 6:33 AM · DBA, Quarry, Data-Services

Thu, Mar 5

zhuyifei1999 added a comment to T246970: Quarry: Lost connection to MySQL server during query.

This isn't just a quarry issue: (logs)

Thu, Mar 5, 11:48 PM · DBA, Quarry, Data-Services
zhuyifei1999 edited projects for T246970: Quarry: Lost connection to MySQL server during query, added: Data-Services; removed Cloud-Services, Quarry.
Thu, Mar 5, 10:47 PM · DBA, Quarry, Data-Services
zhuyifei1999 added a comment to T246885: Replacing url links of static assets (js ,css ) hosted on external servers to proxy links.

But as stated by you, this doesn't comply with Wikimedia's policies, so should I do the opposite of that ?

Thu, Mar 5, 11:39 AM · ISA

Wed, Mar 4

zhuyifei1999 updated subscribers of T246885: Replacing url links of static assets (js ,css ) hosted on external servers to proxy links.

However, we can consider adding some caching for out cdnjs proxy for better response times. @Bstorm thoughts?

Wed, Mar 4, 8:28 PM · ISA
zhuyifei1999 added a comment to T246885: Replacing url links of static assets (js ,css ) hosted on external servers to proxy links.

-1. TOU issue. https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web#External_assets

Wed, Mar 4, 8:24 PM · ISA

Feb 28 2020

zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

Whichever is simplest.

Feb 28 2020, 8:19 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 added a project to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER': Upstream.
Feb 28 2020, 7:45 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

I will be running the script with pdb + save all sseclient trace over the weekend.

Feb 28 2020, 7:45 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py

Feb 27 2020

zhuyifei1999 closed T246364: Unable to access Quarry: 504 timeout as Invalid.
Feb 27 2020, 6:38 PM · Quarry, User-DannyS712
zhuyifei1999 added a comment to T246364: Unable to access Quarry: 504 timeout.

Can't reproduce. Probably related to NFS maintenance a few hours ago.

Feb 27 2020, 6:33 PM · Quarry, User-DannyS712

Feb 26 2020

zhuyifei1999 updated subscribers of T246201: Request for sysop right on zh Beta Cluster for Sunny00217.

I don't see any local crats, and nom has no user groups on zhwp.

Feb 26 2020, 5:47 PM · Chinese-Sites, Beta-Cluster-Infrastructure
zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

Yes, what I was saying was, the first and the third and two separate consumers, so events on first should also be received on the third. If there were something fundamentally wrong with the event data, then both would crash. Since this is not the case, there is nothing fundamentally wrong with the event data and therefore the error must be in other places, such as transmission / decoding, which leads to the linked bug report / PR.

Feb 26 2020, 2:41 AM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py

Feb 25 2020

zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

@zhuyifei1999 the first and second traceback are from "production" worker instances and pop items off of the same redis queue (all fed by a single instance of rcwatcher.py), thus they wouldn't get the same image. So it isn't feasible that they would crash all at once. They basically get images first-come, first-serve from recent changes.

Feb 25 2020, 5:31 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 updated subscribers of T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

So while the event data are loaded from json, hex escaping non-acsii are optional:

Feb 25 2020, 5:30 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

The first traceback above
2020-02-22 20:02:09 <- start
2020-02-24 08:42:16 <- crash
The second traceback I posted above
2020-02-22 20:02:20 <-start
2020-02-23 19:44:35 <-crash
2020-02-23 07:46:35 <- test_rc.py launched
2020-02-24 19:52:12 <- crash

Feb 25 2020, 5:17 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

Would you mind posting the code of the 'minimal test case' somewhere?

Feb 25 2020, 11:39 AM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py

Feb 24 2020

zhuyifei1999 changed the status of T245426: Earwig's copyvio tool 504 gateway time-out issues from Open to Stalled.

I see. Thanks for explaining.

Feb 24 2020, 7:39 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.
...The work of process 5885 is done. Seeya!
worker 2 killed successfully (pid: 5885)
Respawned uWSGI worker 2 (new pid: 5911)
Feb 24 2020, 4:19 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

I guess a flame graph is the way to go then. Gotta find the bottleneck.

Feb 24 2020, 12:32 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

perhaps because their requests are taking too long to complete

Feb 24 2020, 12:32 AM · Tools

Feb 23 2020

zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

Though, I don't see the uWSGI listen queue of socket ":8000" (fd: 7) full messages mentioned earlier.

Feb 23 2020, 11:40 PM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

I see the uwsgi.log:

Feb 23 2020, 11:39 PM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

This is the other process.

Feb 23 2020, 11:33 PM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

This is the other process.

Feb 23 2020, 11:30 PM · Tools
zhuyifei1999 edited P10481 (An Untitled Masterwork).
Feb 23 2020, 11:29 PM
zhuyifei1999 created P10481 (An Untitled Masterwork).
Feb 23 2020, 11:26 PM
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

@Earwig I'm unfamiliar with the code base. Getting a flame graph profiler will probably be a massive PITA. Do you see anything odd in the backtraces?

Feb 23 2020, 11:19 PM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

Finally. Reliable backtrace:

Feb 23 2020, 11:09 PM · Tools
zhuyifei1999 created P10480 (An Untitled Masterwork).
Feb 23 2020, 11:09 PM
zhuyifei1999 created P10479 py-bt-linked.py.
Feb 23 2020, 11:08 PM
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

Can't get the frame object for quite a few frames by enumerating the registers. I can probably use PyFrameObject's f_back as a linked list but that is not something libpython.py gdb script supports. Time for custom code :/

Feb 23 2020, 10:09 PM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.
(gdb) f
#8  PyEval_EvalFrameEx (f=< at remote 0x1b9fc10>, throwflag=1224238336) at ../Python/ceval.c:2679
2679	in ../Python/ceval.c
(gdb) info reg
rax            0xfffffffffffffe00	-512
rbx            0x7ff048f86500	140669993116928
rcx            0x7ff04f093010	140670094880784
rdx            0x0	0
rsi            0x80	128
rdi            0x1c36570	29582704
rbp            0x7ff0495fbfac	0x7ff0495fbfac
rsp            0x7fff99b48670	0x7fff99b48670
r8             0x3	3
r9             0x7ff01aff8bf8	140669221833720
r10            0x0	0
r11            0x246	582
r12            0x1b9fc10	28965904
r13            0x7ff019865f30	140669197115184
r14            0x3	3
r15            0x7ff03c007ca0	140669775543456
rip            0x7ff04ba3227d	0x7ff04ba3227d <PyEval_EvalFrameEx+22749>
eflags         0x246	[ PF ZF IF ]
cs             0x33	51
ss             0x2b	43
ds             0x0	0
es             0x0	0
fs             0x0	0
gs             0x0	0
(gdb) p (PyObject *)0x7ff03c007ca0
$11 = Frame 0x7ff03c007ca0, for file /data/project/copyvios/git/earwigbot/earwigbot/wiki/copyvios/exclusions.py, line 189, in check (self=<ExclusionsDB(_dbfile='.earwigbot/exclusions.db', _logger=<Logger(name='earwigbot.wiki.exclusionsdb', parent=<Logger(name='earwigbot.wiki', parent=<Logger(name='earwigbot', parent=<RootLogger(name='root', parent=None, handlers=[], level=30, disabled=0, propagate=1, filters=[]) at remote 0x7ff04a4c2a10>, handlers=[<TimedRotatingFileHandler(utc=False, interval=86400, backupCount=7, suffix='%Y-%m-%d', stream=<file at remote 0x7ff045b11f60>, encoding=None, lock=<_RLock(_Verbose__verbose=False, _RLock__owner=None, _RLock__block=<thread.lock at remote 0x7ff045983450>, _RLock__count=0) at remote 0x7ff045a8f290>, level=20, when='MIDNIGHT', _name=None, delay=False, rolloverAt=1582502400, baseFilename='/data/project/copyvios/git/copyvios/.earwigbot/logs/bot.log', mode='a', filters=[], extMatch=<_sre.SRE_Pattern at remote 0x7ff0459aac90>, formatter=<BotFormatter(_format=<instancemethod at r...(truncated)
Feb 23 2020, 9:33 PM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.
(gdb) bt
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00007ff04b9a5068 in PyThread_acquire_lock (lock=lock@entry=0x1c36570, waitflag=waitflag@entry=1) at ../Python/thread_pthread.h:324
#2  0x00007ff04ba2c3e6 in PyEval_RestoreThread (tstate=0x1b9fc10) at ../Python/ceval.c:357
#3  0x00007ff04997a7d2 in _pysqlite_fetch_one_row () from /data/project/copyvios/www/python/venv/lib/python2.7/lib-dynload/_sqlite3.x86_64-linux-gnu.so
#4  0x00007ff04997a631 in pysqlite_cursor_iternext () from /data/project/copyvios/www/python/venv/lib/python2.7/lib-dynload/_sqlite3.x86_64-linux-gnu.so
#5  0x00007ff04ba2d93e in PyEval_EvalFrameEx (f=<p at remote 0x7ff03c007e88>, throwflag=1270237784) at ../Python/ceval.c:2510
#6  0x00007ff04ba3227d in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=<optimized out>, func=<optimized out>) at ../Python/ceval.c:4119
#7  call_function (oparg=<optimized out>, pp_stack=<optimized out>) at ../Python/ceval.c:4054
#8  PyEval_EvalFrameEx (f=< at remote 0x1b9fc10>, throwflag=1224238336) at ../Python/ceval.c:2679
#9  0x00007ff04baa5190 in PyEval_EvalCodeEx (co=0x7ff0496022b0, globals=<unknown at remote 0x80>, locals=0x0, args=0x7ff0341060d8, argcount=3, kws=0x7ff01aff8bf8, kwcount=0, defs=0x0, 
    defcount=0, closure=(<cell at remote 0x7ff01ad2ac58>,)) at ../Python/ceval.c:3265
#10 0x00007ff04ba32171 in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=<optimized out>, func=<optimized out>) at ../Python/ceval.c:4129
#11 call_function (oparg=<optimized out>, pp_stack=<optimized out>) at ../Python/ceval.c:4054
#12 PyEval_EvalFrameEx (f=<unknown at remote 0x7ff0341060e0>, throwflag=430033928) at ../Python/ceval.c:2679
#13 0x00007ff04baa5190 in PyEval_EvalCodeEx (co=0x7ff0492e0930, globals=<unknown at remote 0x80>, locals=0x0, args=0x1e13d60, argcount=3, kws=0x7ff01aff8bf8, kwcount=0, 
    defs=0x7ff0492eaca8, defcount=1, closure=0x0) at ../Python/ceval.c:3265
#14 0x00007ff04ba32171 in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=<optimized out>, func=<optimized out>) at ../Python/ceval.c:4129
#15 call_function (oparg=<optimized out>, pp_stack=<optimized out>) at ../Python/ceval.c:4054
Feb 23 2020, 9:24 PM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

Can confirm. A lot of CPU is being used. gdb is taking forever to attach for some reason.

Feb 23 2020, 9:01 PM · Tools
zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

rcworker.py would just be reduced to a few lines

Feb 23 2020, 7:31 AM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 changed the status of T245426: Earwig's copyvio tool 504 gateway time-out issues from Open to Stalled.

(Waiting for failure)

Feb 23 2020, 12:02 AM · Tools

Feb 22 2020

zhuyifei1999 added a comment to T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'.

What is the traceback?

Feb 22 2020, 11:55 PM · Upstream, User-TheSandDoctor, Pywikibot, Commons, Pywikibot-category.py
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

Since there are mentions of some sockets above, so I checked if fds look sane. Installed lsof and strace inside the pod, and:

Feb 22 2020, 8:45 AM · Tools
zhuyifei1999 created P10476 (An Untitled Masterwork).
Feb 22 2020, 8:41 AM
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

Is this concerning the URL https://tools.wmflabs.org/copyvios/? If so, it is not giving me 504 right now. Mind pinging when it does?

Feb 22 2020, 7:34 AM · Tools
zhuyifei1999 claimed T245426: Earwig's copyvio tool 504 gateway time-out issues.
Feb 22 2020, 7:29 AM · Tools
zhuyifei1999 added a comment to T245426: Earwig's copyvio tool 504 gateway time-out issues.

@zhuyifei1999 can I nerd snipe you into helping @Earwig debug a misbehaving Flask app on the 2020 Kubernetes cluster? I know you are better that kind of deep dive than I am. :)

Feb 22 2020, 7:29 AM · Tools
zhuyifei1999 added a comment to T245898: webservice command should not consume control-p (Docker + Kubernetes).

screen: Ctrl-A D
ssh: Enter ~ .
docker: Ctrl-P Ctrl-Q

Feb 22 2020, 1:26 AM · Upstream, cloud-services-team (Kanban), Kubernetes

Feb 19 2020

zhuyifei1999 added a comment to T245550: Request for Cloud VPS Instance for Project: VideoCutTool.

Thought of using https://wikitech.wikimedia.org/wiki/Nova_Resource:Video ?

Feb 19 2020, 4:50 AM · Cloud-VPS (Project-requests), VideoCutTool

Feb 18 2020

zhuyifei1999 added a comment to T245209: Create symlink to PWB py2 version in /shared/pywikibot.

(idc)

Feb 18 2020, 6:15 PM · Toolforge, Pywikibot
zhuyifei1999 added a comment to T245487: mkwiki isCategoryRedirect causes RuntimeError.

Yeah thanks. I 'fixed' it by deleting apicache directory

Feb 18 2020, 6:46 AM · Pywikibot
zhuyifei1999 closed T245487: mkwiki isCategoryRedirect causes RuntimeError as Invalid.

Looks like API cache have the namespace dict.

Feb 18 2020, 6:46 AM · Pywikibot
zhuyifei1999 added a comment to T245487: mkwiki isCategoryRedirect causes RuntimeError.

Looks like the localization of namepace names is broken:

Feb 18 2020, 6:41 AM · Pywikibot
zhuyifei1999 created T245487: mkwiki isCategoryRedirect causes RuntimeError.
Feb 18 2020, 6:28 AM · Pywikibot
zhuyifei1999 added a comment to T245209: Create symlink to PWB py2 version in /shared/pywikibot.

https://github.com/pywikibot/Pywikibot-nightly-creator/commit/f97f3901fb79a13967b04896005b344ffc8a36a5 ?

Feb 18 2020, 6:00 AM · Toolforge, Pywikibot

Feb 15 2020

zhuyifei1999 added a comment to T245209: Create symlink to PWB py2 version in /shared/pywikibot.

I think too long is fine because it will soon be unsupported. Annoyance is sometimes a good thing :)

Feb 15 2020, 1:35 AM · Toolforge, Pywikibot

Feb 2 2020

zhuyifei1999 added a comment to T244036: parliamentdiagram tool webservice repeatedly stopping.

Looking at:

Feb 2 2020, 10:30 PM · Tools
zhuyifei1999 added a comment to T244036: parliamentdiagram tool webservice repeatedly stopping.

I can do some profiling. Do you have the data that is passed into the service right before it fails?

Feb 2 2020, 10:02 PM · Tools

Jan 31 2020

zhuyifei1999 placed T244036: parliamentdiagram tool webservice repeatedly stopping up for grabs.
Jan 31 2020, 11:34 PM · Tools
zhuyifei1999 added a comment to T244036: parliamentdiagram tool webservice repeatedly stopping.
for x in range(sumdelegates['head']):
    poslist['head'].append(
        [5.0+blocksize*(x+optionlist['spacing']/2), centertop])
# Cross-bench parties are 5 from the edge, vertically centered:
for x in range(optionlist['centercols']):
    # How many rows in this column of the cross-bench
    thiscol = int(min(centerrows, sumdelegates['center']-x*centerrows))
    for y in range(thiscol):
        poslist['center'].append([svgwidth-5.0-(optionlist['centercols']-x-optionlist['spacing']/2)
                                  * blocksize, ((svgheight-thiscol*blocksize)/2)+blocksize*(y+optionlist['spacing']/2)])
        poslist['center'].sort(key=lambda point: point[1])
# Left parties are in the top block:
for x in range(wingcols):
    for y in range(optionlist['wingrows']['left']):
        poslist['left'].append(
            [5+(leftoffset+x+optionlist['spacing']/2)*blocksize, centertop-(1.5+y)*blocksize])
# Right parties are in the bottom block:
for x in range(wingcols):
    for y in range(optionlist['wingrows']['right']):
        poslist['right'].append(
            [5+(leftoffset+x+optionlist['spacing']/2)*blocksize, centertop+(1.5+y)*blocksize])
Jan 31 2020, 11:34 PM · Tools
zhuyifei1999 added a comment to T244030: inteGraality queries feature is painfully slow, potentially pywikibot related.

So you mean read accesses should ignore maxlag? hmm

Jan 31 2020, 11:16 PM · Tool-inteGraality
zhuyifei1999 added a comment to T244036: parliamentdiagram tool webservice repeatedly stopping.

maxvemem is above 4GiB and h_vmem=4G, so yes, this is killed by VMS limit exceeded. Are you mapping files into memory?

Jan 31 2020, 10:48 PM · Tools
zhuyifei1999 added a comment to T244036: parliamentdiagram tool webservice repeatedly stopping.

sge_status(5): failed status 37 means qmaster enforced h_rt, h_cpu, or h_vmem limit

Jan 31 2020, 10:44 PM · Tools
zhuyifei1999 added a comment to T244036: parliamentdiagram tool webservice repeatedly stopping.

Checking last entry, adapting code from https://phabricator.wikimedia.org/source/tool-grid-jobs/browse/master/grid_jobs/__init__.py$27:

Jan 31 2020, 10:39 PM · Tools
zhuyifei1999 added a comment to T244036: parliamentdiagram tool webservice repeatedly stopping.
10:18:08 0 ✓ zhuyifei1999@tools-sgebastion-09: ~$ grep parliamentdiagram /data/project/.system_sge/gridengine/default/common/accounting
task:tools-sgeexec-0933.tools.eqiad.wmflabs:tools.parliamentdiagram:tools.parliamentdiagram:cron-tools.parliamentdiagram-1:143498:sge:0:1580021582:1580021592:1580021593:0:0:1:0.004000:0.012000:3852.000000:0:0:0:0:983:0:0:8.000000:8:0:0:0:457:10:NONE:defaultdepartment:NONE:1:0:0.016000:0.000000:0.000000:-q task -l h_vmem=524288k:0.000000:NONE:0.000000:0:0
[...]
webgrid-lighttpd:tools-sgewebgrid-lighttpd-0916.tools.eqiad.wmflabs:tools.parliamentdiagram:tools.parliamentdiagram:lighttpd-parliamentdiagram:460252:sge:0:1579694757:1579694764:1580077607:37:0:382843:0.016000:0.004000:6456.000000:0:0:0:0:857:28:0:6280.000000:0:0:0:0:72:9:NONE:defaultdepartment:NONE:1:0:191.790000:72.662859:9.654144:-q webgrid-lighttpd -l h_vmem=4G:0.000000:NONE:4779155456.000000:0:0
[...]
webgrid-lighttpd:tools-sgewebgrid-lighttpd-0912.tools.eqiad.wmflabs:tools.parliamentdiagram:tools.parliamentdiagram:lighttpd-parliamentdiagram:237421:sge:0:1580161168:1580161182:1580401877:37:0:240695:0.020000:0.004000:6348.000000:0:0:0:0:863:2:0:24.000000:8:0:0:0:10:8:NONE:defaultdepartment:NONE:1:0:1641.300000:34.918114:4.651640:-q webgrid-lighttpd -l h_vmem=4G:0.000000:NONE:4420464640.000000:0:0
[...]
webgrid-lighttpd:tools-sgewebgrid-lighttpd-0922.tools.eqiad.wmflabs:tools.parliamentdiagram:tools.parliamentdiagram:lighttpd-parliamentdiagram:391323:sge:0:1580412371:1580412372:1580474692:37:0:62320:0.068000:0.036000:6216.000000:0:0:0:0:820:0:0:0.000000:0:0:0:0:9:15:NONE:defaultdepartment:NONE:1:0:239.950000:233.663917:0.889195:-q webgrid-lighttpd -l h_vmem=4G:0.000000:NONE:4334555136.000000:0:0
[...]
Jan 31 2020, 10:38 PM · Tools
zhuyifei1999 added a project to T244036: parliamentdiagram tool webservice repeatedly stopping: Tools.
Jan 31 2020, 10:08 PM · Tools
zhuyifei1999 added a comment to T244030: inteGraality queries feature is painfully slow, potentially pywikibot related.

So this is https://www.mediawiki.org/wiki/Manual:Maxlag_parameter I guess in theory you could increase it to make it more aggressive, but I think it's better to get the lag fixed.

Jan 31 2020, 9:39 PM · Tool-inteGraality
zhuyifei1999 added a comment to T244030: inteGraality queries feature is painfully slow, potentially pywikibot related.

Do you have some pywikibot-only test case?

Jan 31 2020, 6:59 PM · Tool-inteGraality
zhuyifei1999 added a comment to T243972: bigdisk2 instace shows just 19G of HD.

Yes. You need to file a ticket for that. https://wikitech.wikimedia.org/wiki/Help:Shared_storage

Jan 31 2020, 6:50 PM · Cloud-VPS

Jan 30 2020

zhuyifei1999 added a comment to T243972: bigdisk2 instace shows just 19G of HD.

See https://wikitech.wikimedia.org/wiki/Help:Adding_Disk_Space

Jan 30 2020, 8:58 PM · Cloud-VPS

Jan 27 2020

zhuyifei1999 renamed T115231: dplbot webservice on Toolforge repeatedly have its dynamicproxy entry removed (because qsub schedules tasks to webgrid queues, causing portreleaser to run as job epilogue) from dplbot webservice on Toolforge repeatedly have its dynamicproxy removed (because qsub schedules tasks to webgrid queues, causing portreleaser to run as job epilogue) to dplbot webservice on Toolforge repeatedly have its dynamicproxy entry removed (because qsub schedules tasks to webgrid queues, causing portreleaser to run as job epilogue).
Jan 27 2020, 11:07 PM · Toolforge
zhuyifei1999 renamed T115231: dplbot webservice on Toolforge repeatedly have its dynamicproxy entry removed (because qsub schedules tasks to webgrid queues, causing portreleaser to run as job epilogue) from dplbot webservice on Tools Labs fails repeatedly to dplbot webservice on Toolforge repeatedly have its dynamicproxy removed (because qsub schedules tasks to webgrid queues, causing portreleaser to run as job epilogue).
Jan 27 2020, 11:07 PM · Toolforge