zhuyifei1999
*Not* Serious business title.

Projects (19)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Oct 13 2014, 10:19 AM (223 w, 11 h)
Availability
Available
IRC Nick
zhuyifei1999
LDAP User
Zhuyifei1999
MediaWiki User
Zhuyifei1999 [ Global Accounts ]

There is currently no text in this page. You can search for this page title in other pages, or search the related logs.

Recent Activity

Today

zhuyifei1999 added a comment to T214230: Please switch crosswiki uploads off.

See also T137269

Mon, Jan 21, 8:50 PM · Wikimedia-Site-requests, Crosswiki, Commons
zhuyifei1999 added a comment to T214315: Raise tool memory limit for tools.meta.

With php7.2 container you get 2GiB of memory (not sure whether virtual or resident). AFAICT, the default php-cgi has a queue with 4 'workers' that polls on the queue, so you can handle maximum 4 concurrent requests, so memory usage is bounded by the 4 concurrent requests. Is 2GiB not enough for 4 requests (like, if you are doing massive data processing in memory rather than in an external database server)?

Mon, Jan 21, 6:15 PM · cloud-services-team, Toolforge

Mon, Jan 14

zhuyifei1999 added a comment to T213646: Stretch grid problem: Please install packages libmariadbclient-dev-compat and libssl-dev.

Did you rebuild your /data/project/yifeibot/.local/local/lib/python2.7 packages on a Stretch host yet?

Mon, Jan 14, 5:59 PM · cloud-services-team (Kanban), Toolforge
zhuyifei1999 added a comment to T213646: Stretch grid problem: Please install packages libmariadbclient-dev-compat and libssl-dev.

I'm hitting this well:

Traceback (most recent call last):
  File "/data/project/yifeibot/o/toolserver/bryan/flickr/bots/flickreviewr.py", line 35, in <module>
    from botbase import FlickrBotBase
  File "/mnt/nfs/labstore-secondary-tools-project/yifeibot/o/toolserver/bryan/flickr/bots/botbase.py", line 37, in <module>
    import database
  File "/data/project/yifeibot/o/toolserver/bryan/flickr/shared/database.py", line 1, in <module>
    import MySQLdb
  File "/data/project/yifeibot/.local/local/lib/python2.7/site-packages/MySQLdb/__init__.py", line 19, in <module>
    import _mysql
ImportError: libmariadb.so.2: cannot open shared object file: No such file or directory

This libmariadb.so.2 is provided by libmariadb2, which has a dependency chain default-libmysqlclient-dev -> libmariadbclient-dev-compat -> libmariadb-dev-compat -> libmariadb-dev -> libmariadb2. Yes this error only happens on grid exec nodes; the bastion has the package installed for idek why.

Mon, Jan 14, 9:23 AM · cloud-services-team (Kanban), Toolforge

Wed, Jan 9

zhuyifei1999 added a comment to T213252: toolscheckerctl fails to stop/start checks.

The checkers that weren't started are those that doesn't seem to be managed by puppet. Looking at the list:

toolschecker_nfs_showmount stop/waiting

No idea what this is. I stopped it again.

toolschecker_labsdb_labsdb1003 stop/waiting
toolschecker_labsdb_labsdb1003rw stop/waiting
toolschecker_labsdb_labsdb1001 stop/waiting
toolschecker_labsdb_labsdb1001rw stop/waiting

These labsdb100[13] are some very old databases that have been decommissioned in T184832

toolschecker_grid_start_precise stop/waiting
toolschecker_continuous_job_precise stop/waiting

Precise is dead.

Wed, Jan 9, 2:26 PM · Toolforge, cloud-services-team (Kanban)
zhuyifei1999 added a comment to T213252: toolscheckerctl fails to stop/start checks.

The boot service starting seemed all failed:

Jan  9 09:58:43 tools-checker-01 kernel: [   15.743269] FS-Cache: Netfs 'nfs' registered for caching
Jan  9 09:58:43 tools-checker-01 kernel: [   15.760279] init: Failed to spawn toolschecker main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.784213] init: Failed to spawn toolschecker_labsdb_labsdb1003 main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.802854] init: Failed to spawn toolschecker_continuous_job_trusty main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.815255] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Jan  9 09:58:43 tools-checker-01 kernel: [   15.829076] init: Failed to spawn toolschecker_flannel_etcd main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.853230] init: Failed to spawn toolschecker_labsdb_labsdb1001 main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.855349] init: Failed to spawn toolschecker_puppet_catalog main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.888520] init: Failed to spawn toolschecker_nfs_secondary_cluster_showmount main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.891387] init: Failed to spawn toolschecker_grid_start_trusty main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.915945] init: Failed to spawn toolschecker_labsdb_labsdb1001rw main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.949428] init: Failed to spawn toolschecker_labsdb_labsdb1003rw main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.951630] init: Failed to spawn toolschecker_service_start main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   15.976144] init: Failed to spawn toolschecker_kubernetes_etcd main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.024132] init: Failed to spawn toolschecker_labsdb_labsdb1005 main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.035022] init: Failed to spawn toolschecker_redis main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.044197] init: Failed to spawn toolschecker_toolsdb main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.046291] init: Failed to spawn toolschecker_continuous_job_precise main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.052201] init: Failed to spawn toolschecker_ldap main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.059837] init: Failed to spawn toolschecker_dumps main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.069203] init: Failed to spawn toolschecker_nfs_home main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.071314] init: Failed to spawn toolschecker_labs_private main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.080757] init: Failed to spawn toolschecker_labsdb_labsdb1004rw main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.082921] init: Failed to spawn toolschecker_nfs_showmount main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.101206] init: Failed to spawn toolschecker_self main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.115024] init: Failed to spawn toolschecker_grid_start_precise main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.116600] init: Failed to spawn toolschecker_webservice_kubernetes main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.129750] init: Failed to spawn toolschecker_cron main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.140133] init: Failed to spawn toolschecker_kubernetes_nodes_ready main process: unable to getpwnam: No such file or directory
Jan  9 09:58:43 tools-checker-01 kernel: [   16.759673] init: idmapd main process (939) terminated with status 1
Jan  9 09:58:43 tools-checker-01 kernel: [   16.759688] init: idmapd main process ended, respawning

The current batch was started by puppet:

Jan  9 09:59:58 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/File[/run/toolschecker]/ensure) created
Jan  9 09:59:59 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[self]/Service[toolschecker_self]/ensure) ensure changed 'stopped' to 'running'
Jan  9 09:59:59 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[self]/Service[toolschecker_self]) Unscheduling refresh on Service[toolschecker_self]
Jan  9 09:59:59 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[puppet_catalog]/Service[toolschecker_puppet_catalog]/ensure) ensure changed 'stopped' to 'running'
Jan  9 09:59:59 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[puppet_catalog]/Service[toolschecker_puppet_catalog]) Unscheduling refresh on Service[toolschecker_puppet_catalog]
Jan  9 09:59:59 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[labs_private]/Service[toolschecker_labs_private]/ensure) ensure changed 'stopped' to 'running'
Jan  9 09:59:59 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[labs_private]/Service[toolschecker_labs_private]) Unscheduling refresh on Service[toolschecker_labs_private]
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[nfs_secondary_cluster_showmount]/Service[toolschecker_nfs_secondary_cluster_showmount]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[nfs_secondary_cluster_showmount]/Service[toolschecker_nfs_secondary_cluster_showmount]) Unscheduling refresh on Service[toolschecker_nfs_secondary_cluster_showmount]
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[ldap]/Service[toolschecker_ldap]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[ldap]/Service[toolschecker_ldap]) Unscheduling refresh on Service[toolschecker_ldap]
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[nfs_home]/Service[toolschecker_nfs_home]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[nfs_home]/Service[toolschecker_nfs_home]) Unscheduling refresh on Service[toolschecker_nfs_home]
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[redis]/Service[toolschecker_redis]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:00 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[redis]/Service[toolschecker_redis]) Unscheduling refresh on Service[toolschecker_redis]
Jan  9 10:00:01 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[labsdb_labsdb1005]/Service[toolschecker_labsdb_labsdb1005]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:01 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[labsdb_labsdb1005]/Service[toolschecker_labsdb_labsdb1005]) Unscheduling refresh on Service[toolschecker_labsdb_labsdb1005]
Jan  9 10:00:02 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[labsdb_labsdb1004rw]/Service[toolschecker_labsdb_labsdb1004rw]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:02 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[labsdb_labsdb1004rw]/Service[toolschecker_labsdb_labsdb1004rw]) Unscheduling refresh on Service[toolschecker_labsdb_labsdb1004rw]
Jan  9 10:00:03 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[toolsdb]/Service[toolschecker_toolsdb]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:03 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[toolsdb]/Service[toolschecker_toolsdb]) Unscheduling refresh on Service[toolschecker_toolsdb]
Jan  9 10:00:03 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[dumps]/Service[toolschecker_dumps]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:03 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[dumps]/Service[toolschecker_dumps]) Unscheduling refresh on Service[toolschecker_dumps]
Jan  9 10:00:03 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[continuous_job_trusty]/Service[toolschecker_continuous_job_trusty]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:03 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[continuous_job_trusty]/Service[toolschecker_continuous_job_trusty]) Unscheduling refresh on Service[toolschecker_continuous_job_trusty]
Jan  9 10:00:04 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[grid_start_trusty]/Service[toolschecker_grid_start_trusty]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:04 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[grid_start_trusty]/Service[toolschecker_grid_start_trusty]) Unscheduling refresh on Service[toolschecker_grid_start_trusty]
Jan  9 10:00:04 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[cron]/Service[toolschecker_cron]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:04 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[cron]/Service[toolschecker_cron]) Unscheduling refresh on Service[toolschecker_cron]
Jan  9 10:00:05 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[flannel_etcd]/Service[toolschecker_flannel_etcd]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:05 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[flannel_etcd]/Service[toolschecker_flannel_etcd]) Unscheduling refresh on Service[toolschecker_flannel_etcd]
Jan  9 10:00:05 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[kubernetes_etcd]/Service[toolschecker_kubernetes_etcd]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:05 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[kubernetes_etcd]/Service[toolschecker_kubernetes_etcd]) Unscheduling refresh on Service[toolschecker_kubernetes_etcd]
Jan  9 10:00:06 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[kubernetes_nodes_ready]/Service[toolschecker_kubernetes_nodes_ready]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:06 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[kubernetes_nodes_ready]/Service[toolschecker_kubernetes_nodes_ready]) Unscheduling refresh on Service[toolschecker_kubernetes_nodes_ready]
Jan  9 10:00:06 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[webservice_kubernetes]/Service[toolschecker_webservice_kubernetes]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:06 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[webservice_kubernetes]/Service[toolschecker_webservice_kubernetes]) Unscheduling refresh on Service[toolschecker_webservice_kubernetes]
Jan  9 10:00:07 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[service_start]/Service[toolschecker_service_start]/ensure) ensure changed 'stopped' to 'running'
Jan  9 10:00:07 tools-checker-01 puppet-agent[1717]: (/Stage[main]/Toollabs::Checker/Toollabs::Check[service_start]/Service[toolschecker_service_start]) Unscheduling refresh on Service[toolschecker_service_start]
Wed, Jan 9, 2:17 PM · Toolforge, cloud-services-team (Kanban)
zhuyifei1999 added a comment to T213252: toolscheckerctl fails to stop/start checks.

Are they simply not enabled (start on boot)?

Wed, Jan 9, 2:11 PM · Toolforge, cloud-services-team (Kanban)
zhuyifei1999 added a comment to T213252: toolscheckerctl fails to stop/start checks.
02:05:28 0 ✓ zhuyifei1999@tools-checker-01: ~$ sudo service toolschecker_nfs_showmount status
toolschecker_nfs_showmount stop/waiting
02:06:18 0 ✓ zhuyifei1999@tools-checker-01: ~$ sudo service toolschecker_nfs_showmount start
toolschecker_nfs_showmount start/running, process 14698
02:06:22 0 ✓ zhuyifei1999@tools-checker-01: ~$ sudo service toolschecker_nfs_showmount status
toolschecker_nfs_showmount start/running, process 14698

Starting the first one manually did seem to work. Are they simply not enabled (start on boot)?

Wed, Jan 9, 2:08 PM · Toolforge, cloud-services-team (Kanban)

Tue, Jan 8

zhuyifei1999 added a comment to T213152: How to STOP running a Query?.

What is the use case for stopping the query? The query being running
doesn’t prevent you from editing the query and submitting it again.

Tue, Jan 8, 9:41 AM · Quarry

Mon, Jan 7

zhuyifei1999 changed the status of T213041: Change Chinese Wikivoyage Logo from Resolved to Invalid.
Mon, Jan 7, 3:15 AM · Wikimedia-Site-requests, Chinese-Sites
zhuyifei1999 added a comment to T213041: Change Chinese Wikivoyage Logo.

Just change it via CSS. Wiki configuration changes are for more permanent changes.

Mon, Jan 7, 2:34 AM · Wikimedia-Site-requests, Chinese-Sites

Sat, Jan 5

zhuyifei1999 added a comment to T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.

Yeah, I also suspected Windows, as the only possible permission for files coming from Windows is 777.

Sat, Jan 5, 2:23 PM · Pywikibot
zhuyifei1999 added a comment to T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.

https://bugs.python.org/issue29214 sigh...

Sat, Jan 5, 1:00 PM · Pywikibot
zhuyifei1999 renamed T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security from user-config.py with mode 777 is not readable to generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.
Sat, Jan 5, 12:39 PM · Pywikibot
zhuyifei1999 added a comment to T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.

oh, os.open default mode is 777. Why doesn't WSL have a sane umask?

Sat, Jan 5, 12:37 PM · Pywikibot
zhuyifei1999 added a comment to T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.

Could it be https://github.com/wikimedia/pywikibot/blob/e57dbff2bf6d4dd719a6f576d96a3b285acbc4ea/pywikibot/config2.py#L1054:

if OSWIN32 or _filemode & 0o02 == 0:
    with open(_filename, 'rb') as f:
        exec(compile(f.read(), _filename, 'exec'), _uc)
else:
    warning("Skipped '%(fn)s': writeable by others."
            % {'fn': _filename})
Sat, Jan 5, 12:31 PM · Pywikibot
zhuyifei1999 added a comment to T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.

Though, POSIX ACLs might be able to prevent reading 777 files; I have not looked into that. However, POSIX ACLs should not be 'enabled' for a clean install, and even if it's 'enabled' ls should show clearly that the file has ACLs.

Sat, Jan 5, 12:22 PM · Pywikibot
zhuyifei1999 added a comment to T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.

mode 777 being un-readable is not POSIX-conformant and is not Linux bahavior. filesystem default to 777 is also not Linux bahavior (which is mode to open(2) - umask).

Sat, Jan 5, 12:19 PM · Pywikibot

Fri, Jan 4

zhuyifei1999 added a comment to T212930: Reset LDAP password for Neechalkaran.

https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Neechalkaran was from 2015. Is that not you?

Fri, Jan 4, 2:12 PM · Toolforge
zhuyifei1999 added a comment to T212930: Reset LDAP password for Neechalkaran.

@Neechalkaran ok so, how are you logging into toolforge? With what software? What steps have you performed? what error messages are you getting?

Fri, Jan 4, 1:38 PM · Toolforge
zhuyifei1999 added a comment to T212930: Reset LDAP password for Neechalkaran.

And we don't accept password logins in SSH; we accept only public key authentication.

Fri, Jan 4, 1:35 PM · Toolforge
zhuyifei1999 added a comment to T212930: Reset LDAP password for Neechalkaran.

Your shell account name is neechal. I don't see either neechal or Neechalkaran in auth.log for login.tools.eqiad.wmflabs.

Fri, Jan 4, 1:33 PM · Toolforge
zhuyifei1999 added a comment to T125589: Allow each tool to have its own subdomain for browser sandbox/cookie isolation.

Sufficiently privileged users can see e. g. T211424 for some more details on possible attacks, though I doubt it’s the only relevant task.

Fri, Jan 4, 3:22 AM · Security, Toolforge
zhuyifei1999 awarded Blog Post: Migrating tools.wmflabs.org to HTTPS a Love token.
Fri, Jan 4, 3:07 AM

Wed, Jan 2

zhuyifei1999 removed a project from T212760: Need to free up space in both Discourse instances: Toolforge.
Wed, Jan 2, 9:58 AM · Discourse

Tue, Jan 1

zhuyifei1999 added a comment to T212737: A mono-based program doesn't work on grid, but works on login server.

FWIW:

root@tools-exec-1413:~# cat /proc/23190/limits
Limit                     Soft Limit           Hard Limit           Units     
[...]
Max address space         524288000            524288000            bytes
Tue, Jan 1, 6:24 AM · Toolforge
zhuyifei1999 added a comment to T212737: A mono-based program doesn't work on grid, but works on login server.
root@tools-exec-1413:~# ps uf -u tools.mbh
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
tools.m+ 23190 80.0  0.8 452612 67680 ?        Ssl  06:13   4:36 /usr/bin/mono-sgen visit_peaks.exe
root@tools-exec-1413:~# gdb -p 23190 -batch -ex 'thread apply all bt'
[New LWP 23206]
[New LWP 23205]
[New LWP 23204]
[New LWP 23203]
[New LWP 23202]
[New LWP 23194]
[New LWP 23193]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
185	../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S: No such file or directory.
Tue, Jan 1, 6:21 AM · Toolforge
zhuyifei1999 added a comment to T212737: A mono-based program doesn't work on grid, but works on login server.

Which tool is this? Could you submit the job again and I'll see what its doing with gdb?

Tue, Jan 1, 6:12 AM · Toolforge

Mon, Dec 31

zhuyifei1999 added a comment to T212723: generate_user_files creates user-config.py with mode 777 on WSL, and then pywikibot refuse to load the config for security.

I think it's loading a wrong user-config.py or something...

Mon, Dec 31, 2:27 PM · Pywikibot
zhuyifei1999 updated the task description for T38118: When a local image and an image redirect on Commons have the same name, the wrong description page is linked.
Mon, Dec 31, 1:44 PM · Commons, Multimedia, MediaWiki-File-management
zhuyifei1999 updated the task description for T30299: An image redirect from a foreign File Repo overrides local wiki page..
Mon, Dec 31, 1:44 PM · MediaWiki-Redirects
zhuyifei1999 added a project to T212687: Local file page has bugs if there is a redirect on Shared under the same name: MediaWiki-File-management.
Mon, Dec 31, 1:42 PM · Multimedia, Commons, MediaWiki-File-management, MediaWiki-Redirects
zhuyifei1999 merged T208368: Redirect on Commons causes problems on local wiki if the file name already exists into T212687: Local file page has bugs if there is a redirect on Shared under the same name.
Mon, Dec 31, 1:42 PM · Multimedia, Commons, MediaWiki-File-management, MediaWiki-Redirects
zhuyifei1999 merged task T208368: Redirect on Commons causes problems on local wiki if the file name already exists into T212687: Local file page has bugs if there is a redirect on Shared under the same name.
Mon, Dec 31, 1:42 PM · Multimedia, MediaWiki-File-management, Commons
zhuyifei1999 added a project to T208368: Redirect on Commons causes problems on local wiki if the file name already exists: MediaWiki-File-management.
Mon, Dec 31, 1:39 PM · Multimedia, MediaWiki-File-management, Commons
zhuyifei1999 merged T163535: Upload verification-error possibly triggered by EXIF into T27707: Allow "html" in exif tags.
Mon, Dec 31, 5:51 AM · Multimedia, MediaWiki-Uploading
zhuyifei1999 merged task T163535: Upload verification-error possibly triggered by EXIF into T27707: Allow "html" in exif tags.
Mon, Dec 31, 5:51 AM · MediaWiki-Uploading, Multimedia, Commons
zhuyifei1999 merged T212693: Remove or escape HTML code in the EXIF when uploading files (Currently uploading is not possible) into T27707: Allow "html" in exif tags.
Mon, Dec 31, 5:48 AM · Multimedia, MediaWiki-Uploading
zhuyifei1999 merged task T212693: Remove or escape HTML code in the EXIF when uploading files (Currently uploading is not possible) into T27707: Allow "html" in exif tags.
Mon, Dec 31, 5:48 AM · Multimedia, MediaWiki-Uploading, Commons

Wed, Dec 26

zhuyifei1999 added a comment to T212620: When starting webservice, ConfigParser.NoSectionError: No section: 'Default'.

@Amitie_10g Do you have a ~/.webservicerc file?

Wed, Dec 26, 10:22 AM · Toolforge
zhuyifei1999 created T212620: When starting webservice, ConfigParser.NoSectionError: No section: 'Default'.
Wed, Dec 26, 8:44 AM · Toolforge

Mon, Dec 24

zhuyifei1999 added a comment to T212594: tools-bastion-03 is having problems talking to the grid master.

Looking at the bash history of root and auth.log.1 I think @Andrew was checking / editing /etc/hosts around 2018-12-23 18:42. I guess some sort of mistake?

Mon, Dec 24, 10:07 PM · Toolforge
zhuyifei1999 closed T212598: Grammar in "My Options" as Resolved.
Mon, Dec 24, 9:41 PM · Patch-For-Review, Quarry
zhuyifei1999 added a comment to T212594: tools-bastion-03 is having problems talking to the grid master.

syslog is full of prometheus and nslcd :(

Mon, Dec 24, 9:34 PM · Toolforge
zhuyifei1999 updated subscribers of T212594: tools-bastion-03 is having problems talking to the grid master.

This was removed in commit 13bae9b CC @Bstorm

Mon, Dec 24, 9:26 PM · Toolforge
zhuyifei1999 added a comment to T212594: tools-bastion-03 is having problems talking to the grid master.

Puppet definitely isn't doing anything:

09:17:27 0 ✓ zhuyifei1999@tools-bastion-03: ~$ sudo puppet agent -tv
Info: Using configured environment 'production'
Info: Retrieving pluginfacts
Info: Retrieving plugin
Info: Loading facts
Info: Caching catalog for tools-bastion-03.tools.eqiad.wmflabs
Notice: /Stage[main]/Base::Environment/Tidy[/var/tmp/core]: Tidying 0 files
Info: Applying configuration version '1545686263'
Notice: Applied catalog in 54.61 seconds

And searching for Temporarily puppetized until we can get DNS properly setup in ops/puppet gives no results.

Mon, Dec 24, 9:19 PM · Toolforge
zhuyifei1999 added a comment to T212594: tools-bastion-03 is having problems talking to the grid master.

Weirdly /etc/hosts says # Temporarily puppetized until we can get DNS properly setup, so I assume this file is puppetized, but with so many hours passed I don't see any changes happening to that file on tools-bastion-03 (I assume at least added comments should be gone).

Mon, Dec 24, 9:17 PM · Toolforge

Sun, Dec 23

zhuyifei1999 added a comment to T212573: Request creation of indico VPS project.

Right but my point is Cloud VPS is not intended for production usage.

Sun, Dec 23, 6:11 PM · Cloud-VPS (Project-requests)

Dec 21 2018

zhuyifei1999 added a comment to T212046: --help option should works too.

Pywikibot was warned multiple times about this issue.

Dec 21 2018, 6:02 PM · Pywikibot

Dec 19 2018

zhuyifei1999 added a comment to T151656: Install librsvg 2.40.18 on Jessie for K8s webservice.

Oh great. Dependency fun.... (Looking at the dependency for compilation in Gentoo)

 * dependency graph for gnome-base/librsvg-2.40.20
 `--  gnome-base/librsvg-2.40.20  ~amd64 
   `--  dev-libs/glib-2.58.2  (>=dev-libs/glib-2.34.3) ~amd64  [abi_x86_32(-)? abi_x86_64(-)? abi_x86_x32(-)? abi_mips_n32(-)? abi_mips_n64(-)? abi_mips_o32(-)? abi_ppc_32(-)? abi_ppc_64(-)? abi_s390_32(-)? abi_s390_64(-)?]
   `--  x11-libs/cairo-1.16.0-r2  (>=x11-libs/cairo-1.12.14-r4) ~amd64  [abi_x86_32(-)? abi_x86_64(-)? abi_x86_x32(-)? abi_mips_n32(-)? abi_mips_n64(-)? abi_mips_o32(-)? abi_ppc_32(-)? abi_ppc_64(-)? abi_s390_32(-)? abi_s390_64(-)?]
   `--  x11-libs/pango-1.42.4  (>=x11-libs/pango-1.38.0) amd64  [abi_x86_32(-)? abi_x86_64(-)? abi_x86_x32(-)? abi_mips_n32(-)? abi_mips_n64(-)? abi_mips_o32(-)? abi_ppc_32(-)? abi_ppc_64(-)? abi_s390_32(-)? abi_s390_64(-)?]
   `--  dev-libs/libxml2-2.9.8  (>=dev-libs/libxml2-2.9.1-r4) amd64  [abi_x86_32(-)? abi_x86_64(-)? abi_x86_x32(-)? abi_mips_n32(-)? abi_mips_n64(-)? abi_mips_o32(-)? abi_ppc_32(-)? abi_ppc_64(-)? abi_s390_32(-)? abi_s390_64(-)?]
   `--  dev-libs/libcroco-0.6.12-r1  (>=dev-libs/libcroco-0.6.8-r1) amd64  [abi_x86_32(-)? abi_x86_64(-)? abi_x86_x32(-)? abi_mips_n32(-)? abi_mips_n64(-)? abi_mips_o32(-)? abi_ppc_32(-)? abi_ppc_64(-)? abi_s390_32(-)? abi_s390_64(-)?]
   `--  x11-libs/gdk-pixbuf-2.36.12  (>=x11-libs/gdk-pixbuf-2.30.7) amd64  [introspection? abi_x86_32(-)? abi_x86_64(-)? abi_x86_x32(-)? abi_mips_n32(-)? abi_mips_n64(-)? abi_mips_o32(-)? abi_ppc_32(-)? abi_ppc_64(-)? abi_s390_32(-)? abi_s390_64(-)?]
   `--  dev-libs/gobject-introspection-1.56.1  (>=dev-libs/gobject-introspection-0.10.8) ~amd64 
   `--  x11-libs/gtk+-3.24.1  (>=x11-libs/gtk+-3.10.0) ~amd64 
   `--  dev-libs/gobject-introspection-common-1.56.1  (dev-libs/gobject-introspection-common) ~amd64 
   `--  dev-libs/vala-common-0.36.15  (dev-libs/vala-common) ~amd64 
   `--  dev-util/glib-utils-2.58.2  (dev-util/glib-utils) ~amd64 
   `--  dev-util/gtk-doc-am-1.25-r1  (>=dev-util/gtk-doc-am-1.13) amd64 
   `--  virtual/pkgconfig-0-r1  (>=virtual/pkgconfig-0-r1) amd64  [abi_x86_32(-)? abi_x86_64(-)? abi_x86_x32(-)? abi_mips_n32(-)? abi_mips_n64(-)? abi_mips_o32(-)? abi_ppc_32(-)? abi_ppc_64(-)? abi_s390_32(-)? abi_s390_64(-)?]
   `--  dev-lang/vala-0.36.15  (dev-lang/vala) ~amd64  [vapigen(+)]
   `--  dev-lang/vala-0.34.16  (dev-lang/vala) amd64  [vapigen(+)]
   `--  dev-lang/vala-0.32.1  (dev-lang/vala) amd64  [vapigen(+)]
   `--  app-portage/elt-patches-20170826.1  (>=app-portage/elt-patches-20170815) ~amd64 
   `--  sys-devel/automake-1.16.1-r1  (>=sys-devel/automake-1.16.1) ~amd64 
   `--  sys-devel/automake-1.15.1-r2  (>=sys-devel/automake-1.15.1) amd64 
   `--  sys-devel/autoconf-2.69-r4  (>=sys-devel/autoconf-2.69) amd64 
   `--  sys-devel/libtool-2.4.6-r5  (>=sys-devel/libtool-2.4) ~amd64 
   `--  app-arch/xz-utils-5.2.4-r2  (app-arch/xz-utils) ~amd64 
   `--  sys-apps/sed-4.5  (>=sys-apps/sed-4) amd64 
   `--  dev-util/desktop-file-utils-0.23  (dev-util/desktop-file-utils) amd64 
   `--  x11-misc/shared-mime-info-1.10  (x11-misc/shared-mime-info) amd64 
[ gnome-base/librsvg-2.40.20 stats: packages (26), max depth (1) ]
Dec 19 2018, 11:15 PM · cloud-services-team (Kanban), Patch-For-Review, Toolforge
zhuyifei1999 added a comment to T151656: Install librsvg 2.40.18 on Jessie for K8s webservice.

@MaxSem May I suggest doing the compilation of RSVG locally in the tool?

Dec 19 2018, 8:06 PM · cloud-services-team (Kanban), Patch-For-Review, Toolforge

Dec 16 2018

zhuyifei1999 placed T136216: Delete tool 'rcm' up for grabs.
Dec 16 2018, 7:59 AM · Cleanup, Toolforge

Dec 15 2018

zhuyifei1999 merged T211882: New uploads receiving apparently false empty-file API errors into T211886: Fatal error: request has exceeded memory limit in /srv/mediawiki/php-1.33.0-wmf.8/vendor/guzzlehttp/psr7/src/Stream.php on line 97 .
Dec 15 2018, 5:25 PM · MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), MediaWiki-Vendor
zhuyifei1999 merged task T211882: New uploads receiving apparently false empty-file API errors into T211886: Fatal error: request has exceeded memory limit in /srv/mediawiki/php-1.33.0-wmf.8/vendor/guzzlehttp/psr7/src/Stream.php on line 97 .
Dec 15 2018, 5:25 PM · Pywikibot

Dec 13 2018

zhuyifei1999 added a comment to T210827: Help to run Java8 web-app.

What have you tried and what error messages you get?

Dec 13 2018, 11:58 PM · Toolforge
zhuyifei1999 added a comment to T211882: New uploads receiving apparently false empty-file API errors.

Likely same as T211900 -> T211886

Dec 13 2018, 10:55 PM · Pywikibot
zhuyifei1999 added a comment to T211917: "KeyError: 'request_token'" in /oauth-callback on local instance.

The only reason I can think of'you just have to go back to the main page to be connected' is that the browser requests oauth-callback twice. Is this the case for you?

Dec 13 2018, 10:44 PM · Quarry
zhuyifei1999 closed T211628: Adoption request for svgtranslate as Invalid.

Ah I see. Thanks. No need to redact any info then :) It's easier this way anyways.

Dec 13 2018, 6:56 AM · Toolforge-standards-committee, Community-Tech
zhuyifei1999 added a comment to T211628: Adoption request for svgtranslate.

Wait a sec... @Niharika I see you under https://tools.wmflabs.org/admin/tool/svgtranslate, what is going on? Is this request still necessary?

Dec 13 2018, 6:50 AM · Toolforge-standards-committee, Community-Tech
zhuyifei1999 added a comment to T211628: Adoption request for svgtranslate.

Other files:

Dec 13 2018, 6:48 AM · Toolforge-standards-committee, Community-Tech
zhuyifei1999 added a comment to T211628: Adoption request for svgtranslate.

This tool has a git repo:

tools.svgtranslate@tools-bastion-05:~/public_html$ git status
On branch master
Your branch is up-to-date with 'origin/master'.
Dec 13 2018, 6:40 AM · Toolforge-standards-committee, Community-Tech
zhuyifei1999 claimed T211628: Adoption request for svgtranslate.

Nobody :(

Dec 13 2018, 6:21 AM · Toolforge-standards-committee, Community-Tech

Dec 12 2018

zhuyifei1999 added a comment to T107878: Limit webservice manifest restarts.

Why is max 3 times an hour limit not good enough?

Dec 12 2018, 2:30 PM · Patch-For-Review, Toolforge
zhuyifei1999 added a comment to T211745: Automatically convert .heic image format files to .jpg or .webp.

An 'ideal' converter should be about to keep them in EXIF, if that is the intention.

Dec 12 2018, 7:23 AM · Multimedia, MediaWiki-Uploading, Commons

Dec 11 2018

zhuyifei1999 added a comment to T211323: The Chinese Wikivoyage mobile version only shows part of the map; some tiles remain white/blank (due to local incorrect CSS).

This is weird, I was able to reproduce it the first time doing that (in Firefox mobile mode), but unable to reproduce it since.

Dec 11 2018, 7:02 PM · Reading-Web-Local-Wiki-Issues, MinervaNeue (Tracking), Maps (Kartographer), Chinese-Sites
zhuyifei1999 closed T211323: The Chinese Wikivoyage mobile version only shows part of the map; some tiles remain white/blank (due to local incorrect CSS) as Resolved.

That might have just fixed it. Thanks @Jdlrobson for the finding and @Jdforrester-WMF for the fix :)

Dec 11 2018, 6:21 PM · Reading-Web-Local-Wiki-Issues, MinervaNeue (Tracking), Maps (Kartographer), Chinese-Sites
zhuyifei1999 added a comment to T211323: The Chinese Wikivoyage mobile version only shows part of the map; some tiles remain white/blank (due to local incorrect CSS).

I tried disabling all gadgets, still reproduceable.

Dec 11 2018, 4:57 PM · Reading-Web-Local-Wiki-Issues, MinervaNeue (Tracking), Maps (Kartographer), Chinese-Sites

Dec 10 2018

zhuyifei1999 added a comment to T211628: Adoption request for svgtranslate.

I have time to do the check this Wednesday / Thursday. Anyone able to do it sooner?

Dec 10 2018, 10:01 PM · Toolforge-standards-committee, Community-Tech
zhuyifei1999 added a comment to T211523: Request creation of <Videowiki> VPS project.

This seems already hosted elsewhere https://www.videowiki.org/. Are you moving to Wikimedia Cloud, or is this a secondary host, or somthing?

Dec 10 2018, 3:12 AM · Cloud-VPS (Project-requests)

Dec 6 2018

zhuyifei1999 added a comment to T211323: The Chinese Wikivoyage mobile version only shows part of the map; some tiles remain white/blank (due to local incorrect CSS).

This is probably some sort of race condition. https://zh.m.wikivoyage.org/wiki/%E7%AB%B9%E5%8C%97?debug=1 Loads fine for me,

Dec 6 2018, 8:25 PM · Reading-Web-Local-Wiki-Issues, MinervaNeue (Tracking), Maps (Kartographer), Chinese-Sites
zhuyifei1999 added a comment to T211323: The Chinese Wikivoyage mobile version only shows part of the map; some tiles remain white/blank (due to local incorrect CSS).

(The page looks fine with JS disabled.)

Dec 6 2018, 8:06 PM · Reading-Web-Local-Wiki-Issues, MinervaNeue (Tracking), Maps (Kartographer), Chinese-Sites
zhuyifei1999 closed T204499: cloudvps: commonsarchive project trusty deprecation as Resolved.

I deleted the old trusty instances. Will work on backups later. Really lack time rn.

Dec 6 2018, 3:46 AM · Cloud-VPS (Ubuntu Trusty Deprecation)

Dec 5 2018

zhuyifei1999 added a comment to T188564: Quarry should refuse to save results that are way too large.

What I had in mind:

  1. send the work request from web server to a worker.
  2. when the worker has results, send them to a redis server.
  3. get results to the final client from the redis server using webserver
  4. when the storage server (yet another special server) is free, by collecting results back in drive (nfs) from redis server and delete them from there.
Dec 5 2018, 12:19 AM · Patch-For-Review, Quarry

Dec 4 2018

zhuyifei1999 added a comment to T188564: Quarry should refuse to save results that are way too large.

If they were not stored as sqlite files would the problem be partially resolved? I have trouble seeing the interest of sqlite if it's not for registration/access time, since data extraction in the app is done on whole tables without selection.

Dec 4 2018, 12:17 AM · Patch-For-Review, Quarry

Dec 3 2018

zhuyifei1999 updated subscribers of T210978: View 'thwiki_p.page' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them.

@Bstorm Mind looking into this? It's affecting some heavily accessed tables like dewiki.page.

Dec 3 2018, 3:25 PM · Data-Services
zhuyifei1999 merged T211016: View 'dewiki_p.page' not working into T210978: View 'thwiki_p.page' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them.
Dec 3 2018, 3:23 PM · Data-Services
zhuyifei1999 merged task T211016: View 'dewiki_p.page' not working into T210978: View 'thwiki_p.page' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them.
Dec 3 2018, 3:23 PM · Data-Services
zhuyifei1999 edited projects for T210978: View 'thwiki_p.page' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them, added: Data-Services; removed Dumps-Generation, Quarry.
Dec 3 2018, 9:27 AM · Data-Services

Dec 2 2018

zhuyifei1999 placed T210959: Make tools-static fontcdn/ and cdnjs/ redact UA up for grabs.
Dec 2 2018, 7:29 PM · cloud-services-team, Toolforge, Privacy
zhuyifei1999 created T210959: Make tools-static fontcdn/ and cdnjs/ redact UA.
Dec 2 2018, 7:29 PM · cloud-services-team, Toolforge, Privacy
zhuyifei1999 added a comment to T209998: Possible privacy break when loading font from toolserver.

@zhuyifei1999 remains the sole maintainer (or only NDA maintainers are added) it might be permissible

Dec 2 2018, 7:09 PM · Wikimedia-General-or-Unknown, Privacy
zhuyifei1999 added a comment to T209998: Possible privacy break when loading font from toolserver.

Honestly, since when UA by itself is private information?

Dec 2 2018, 6:34 PM · Wikimedia-General-or-Unknown, Privacy
zhuyifei1999 added a comment to T209998: Possible privacy break when loading font from toolserver.

Honestly, since when UA by itself is private information? If that were the case, the vast majority of toolforge tools would violate cloud ToU in this clause:

You should not collect or store private data or personally identifiable information [...] (“Private Information”) from the individuals using your Cloud Services Project (“End Users”), except when complying with the conditions listed below.

  1. Clearly communicate to End Users a) that Private Information is being collected, b) how you will use it, and c) when you will delete it;
  2. Inform the End Users that their information may be available to the Wikimedia Foundation, its volunteers, other Wikimedia Cloud Services users, or to the public;
  3. Get express authorization from the End Users for the collection;
  4. Hash, encrypt, or otherwise properly secure any Private Information you store;
  5. Purge, anonymize, or aggregate any Private Information you store no more than 30 days after storing it;
Dec 2 2018, 6:23 PM · Wikimedia-General-or-Unknown, Privacy
zhuyifei1999 added a comment to T170716: Update Toolforge k8s nodejs images to 6.11.
tools.zhuyifei1999-test@tools-bastion-02:~$ webservice --backend kubernetes nodejs shell
If you don't see a command prompt, try pressing enter.
tools.zhuyifei1999-test@interactive:~$ 
tools.zhuyifei1999-test@interactive:~$ node --version
v6.11.0
Dec 2 2018, 4:58 AM · Kubernetes, Tools-Kubernetes, Toolforge

Nov 30 2018

zhuyifei1999 awarded T210818: Move admin cron jobs to systemd timers a Love token.
Nov 30 2018, 3:50 PM · Epic, cloud-services-team (Kanban)

Nov 27 2018

zhuyifei1999 lowered the priority of T188564: Quarry should refuse to save results that are way too large from Unbreak Now! to High.

(Lowered because the offending processes have been killed)

Nov 27 2018, 9:54 PM · Patch-For-Review, Quarry
zhuyifei1999 added a comment to T188564: Quarry should refuse to save results that are way too large.

It currently only kills queries that mariadb knows that has been executing
on the database for longer than 30 mins, how long it takes to store the
query results is completely disregarded, until OOM killer kicks in.

Nov 27 2018, 9:24 PM · Patch-For-Review, Quarry
zhuyifei1999 added a comment to T188564: Quarry should refuse to save results that are way too large.

quarry-worker-02 was practically dead.

Nov 27 2018, 6:55 PM · Patch-For-Review, Quarry
zhuyifei1999 raised the priority of T188564: Quarry should refuse to save results that are way too large from High to Unbreak Now!.

This is getting ridiculously bad with queries like

Nov 27 2018, 6:47 PM · Patch-For-Review, Quarry

Nov 26 2018

zhuyifei1999 added a comment to T209780: Toolforge module issue.

The exact values and method cloud-wide query killer works is undocumented AFAIK, but I imagine it should apply to each individual queries.

Nov 26 2018, 10:47 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.
MariaDB [enwiki_p]> select count(*) from linter inner join page on page.page_id=linter.linter_page where linter_cat=13 and page.page_namespace=5;
+----------+
| count(*) |
+----------+
|    89651 |
+----------+
1 row in set (2.79 sec)

Quarry should a;so be able to tell you how long a query runs.

Nov 26 2018, 10:36 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

If it runs within a few minutes, there should be no issue. The query killer
kills queries that run for a really long time.

Nov 26 2018, 10:32 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

Therefore I ask you to print it before it executes.

Nov 26 2018, 10:18 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

And which of the values produce a failing query?

Nov 26 2018, 10:14 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

And what is the exact value of lint and ns that produce a failing query?

Nov 26 2018, 9:53 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

I'm asking for the exact query that is failing, not a sample query, so the issue can be tested and hopefully reproduced.

Nov 26 2018, 9:48 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

Therefore I ask you to print it before it executes.

Nov 26 2018, 9:40 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

With {0} and {1} substituted with the actual values

Nov 26 2018, 9:35 AM · Toolforge
zhuyifei1999 added a comment to T209780: Toolforge module issue.

pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')

Nov 26 2018, 9:10 AM · Toolforge

Nov 25 2018

zhuyifei1999 closed T210355: Add logged username in the interface as Invalid.

Filed https://github.com/toolforge/video2commons/issues/100

Nov 25 2018, 11:10 PM · video2commons