zhuyifei1999
*Not* Serious business title.

Projects (13)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 13 2014, 10:19 AM (128 w, 3 d)
Availability
Available
IRC Nick
zhuyifei1999
LDAP User
Zhuyifei1999
MediaWiki User
Zhuyifei1999

There is currently no text in this page. You can search for this page title in other pages, or search the related logs.

Recent Activity

Today

zhuyifei1999 added a comment to T106924: Consider using the Badges application for a few special roles to highlight those users' comments.

Honestly I think it would be cool if badges only showed on a user's profile and not on their comments.

Agreed.

Thu, Mar 30, 4:51 PM · Phabricator
zhuyifei1999 updated subscribers of T161816: Cannot grant a user ability to view log entries of private filters.
Thu, Mar 30, 4:47 PM · MediaWiki-Authentication-and-authorization, AbuseFilter
zhuyifei1999 created T161816: Cannot grant a user ability to view log entries of private filters.
Thu, Mar 30, 4:47 PM · MediaWiki-Authentication-and-authorization, AbuseFilter
zhuyifei1999 added a comment to T161599: [GSoC Proposal 2017] Single Image Batch Upload.

Proposed Implementation Approach

LGTM

Thu, Mar 30, 3:38 AM · Single-Image-Batch-Upload, Outreachy (Round-14), Google-Summer-of-Code (2017)
zhuyifei1999 added a comment to T161670: Proposal : Single Image Batch Upload (GSoC 2017).

August 21 to August 28 ... Host the tool on https://tools.wmflabs.org/.

I'm not sure why this should be so late (1 week before final evaluation). Besides, it is much more easier to test if the tool is on labs already, IMO. Perhaps hosting could be done earlier and change this to "announce the tool"?

Thu, Mar 30, 3:14 AM · Single-Image-Batch-Upload, Google-Summer-of-Code (2017), Commons, Possible-Tech-Projects

Yesterday

zhuyifei1999 renamed T129845: Commons and to a lesser extent other projects used as video hoster / file sharing site by Wikipedia Zero from "Commons and testwiki used as video hoster by Wikipedia Zero" to "Commons and to a lesser extent other projects used as video hoster / file sharing site by Wikipedia Zero".
Wed, Mar 29, 6:13 AM · Wikimedia-General-or-Unknown, Support-and-Safety, Multimedia, Commons, Zero
zhuyifei1999 removed projects from T161670: Proposal : Single Image Batch Upload (GSoC 2017): Outreachy (Round-14), Outreach-Programs-Projects, Wikimania-Hackathon-2016.
Wed, Mar 29, 4:03 AM · Single-Image-Batch-Upload, Google-Summer-of-Code (2017), Commons, Possible-Tech-Projects
zhuyifei1999 added a comment to T161332: Flask Backend for Single Image Batch Upload.

@Infobliss I think you left IRC. Anyways:

Wed, Mar 29, 2:52 AM · Single-Image-Batch-Upload
zhuyifei1999 added a comment to T161337: Generic file title generator for Single Image Batch Upload.

hello @tom29739 , I want to also look at Wikimedia's OAuth. Will be greatful if I could have some guide on this. Thanks

Wed, Mar 29, 12:04 AM · Single-Image-Batch-Upload

Mon, Mar 27

zhuyifei1999 added a comment to T129845: Commons and to a lesser extent other projects used as video hoster / file sharing site by Wikipedia Zero.

Are there bug reports already against MediaWiki-Uploading to detect those?

Mon, Mar 27, 7:28 AM · Wikimedia-General-or-Unknown, Support-and-Safety, Multimedia, Commons, Zero
zhuyifei1999 added a comment to T161332: Flask Backend for Single Image Batch Upload.

So I installed pywikibot==2.0rc5 inside the venv where flask app is running.

Is it installed via pip?

Now I replaced the latest files from the piwikibot repo.

Try not to do a manual direct replacement, but something like pip install -U https://github.com/wikimedia/pywikibot-core/zipball/master#egg=pywikibot

The specialbots.py file for uploading images is located at {myapp}/venv/lib/python2.7/site-packages/pywikibot. I don't know how to import that into my upload script.

Have you tried import pywikibot and/or import pywikibot.specialbots? If so, does it work? If it doesn't work, any error message?

Is there any other approach of using pywikibot from the venv where the Flask app resides? Need help.

I don't think I get what you mean. In any case, I'll be available in IRC same time as yesterday.

Mon, Mar 27, 4:06 AM · Single-Image-Batch-Upload

Sun, Mar 26

zhuyifei1999 added a parent task for T161457: pywikibot specialbots.py UploadRobot not working in python3: T60053: Pywikibot Python 3 compatibility (tracking).
Sun, Mar 26, 3:39 PM · Patch-For-Review, Pywikibot-core
zhuyifei1999 added a subtask for T60053: Pywikibot Python 3 compatibility (tracking): T161457: pywikibot specialbots.py UploadRobot not working in python3.
Sun, Mar 26, 3:39 PM · Tracking, Pywikibot-core
zhuyifei1999 added a comment to T161332: Flask Backend for Single Image Batch Upload.

FWIW, there is a tutorial.

Sun, Mar 26, 7:11 AM · Single-Image-Batch-Upload

Fri, Mar 24

zhuyifei1999 added a watcher for Single-Image-Batch-Upload: zhuyifei1999.
Fri, Mar 24, 11:05 AM
zhuyifei1999 added a parent task for T161266: Add dependencies for Postgresql to Kubernetes container: T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking).
Fri, Mar 24, 1:31 AM · Labs, Tool-Labs
zhuyifei1999 added a subtask for T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking): T161266: Add dependencies for Postgresql to Kubernetes container.
Fri, Mar 24, 1:31 AM · Tracking, Tool-Labs, Labs, Tools-Kubernetes
zhuyifei1999 added a comment to T106924: Consider using the Badges application for a few special roles to highlight those users' comments.

Userboxes are pretty different IMO. They're only on your profile page, not every time you make a comment.

Fri, Mar 24, 1:09 AM · Phabricator

Wed, Mar 22

zhuyifei1999 edited the description of T138464: Single Image Batch Upload.
Wed, Mar 22, 10:50 AM · Single-Image-Batch-Upload, Outreachy (Round-14), Google-Summer-of-Code (2017), Outreach-Programs-Projects, Commons, Possible-Tech-Projects, Wikimania-Hackathon-2016
zhuyifei1999 added a comment to T161089: `jsub` is not available to Tool labs webservice running on Kubernete.

Is it possible to make jsub available to Kubernate containers?

That is very unlikely to happen. K8s don't know grid and grid doesn't know k8s. If you must submit jobs you can either make the webservice run on grid, or submit the job to k8s.

Wed, Mar 22, 10:11 AM · Tools-Kubernetes, Tool-Labs, Labs
zhuyifei1999 added a comment to T138464: Single Image Batch Upload.

I've emailed Basvb privately some of my concerns on this project. If they are addressed I think I'm available for mentoring as well.

Wed, Mar 22, 5:17 AM · Single-Image-Batch-Upload, Outreachy (Round-14), Google-Summer-of-Code (2017), Outreach-Programs-Projects, Commons, Possible-Tech-Projects, Wikimania-Hackathon-2016

Tue, Mar 21

zhuyifei1999 merged T160997: Migrate pywikibot from RCStream to EventStreams into T158943: Implement EventStreams client for pywikibot.
Tue, Mar 21, 2:32 PM · Patch-For-Review, Pywikibot-core
zhuyifei1999 merged task T160997: Migrate pywikibot from RCStream to EventStreams into T158943: Implement EventStreams client for pywikibot.
Tue, Mar 21, 2:32 PM · Wikimedia-Stream, Pywikibot-core

Mon, Mar 20

zhuyifei1999 added a comment to T159889: Per-consumer XFF trust settings.

Tool Labs proxy hides the IP addresses from users. If a tool on tool labs were to send an XFF, what you get would be the IP address of the web proxies, instead of the actual user, from the viewpoint of the gridengine or k8s workers, and I don't think this information is useful at all...

Mon, Mar 20, 4:07 PM · Security-Extensions, MediaWiki-extensions-OAuth
zhuyifei1999 added a comment to T160884: Request creation of getstarted labs project.

Just wondering, what makes this not-doable on tool labs?

Mon, Mar 20, 3:42 PM · User-bd808, Labs
zhuyifei1999 updated subscribers of T160907: Unknown "cewbot" user lurking in channels.

This name reminds me of https://meta.wikimedia.org/wiki/User:Cewbot so ping @Kanashimi

Mon, Mar 20, 2:36 PM · Tool-Labs-tools-Other
zhuyifei1999 added a comment to T87224: Weird state of /data/project for dumps (semi-missing files).

@Nemo_bis have you stat wikistats/? This is similar to the issue where you don't have the +x permission on the directory:

Mon, Mar 20, 2:33 PM · Labs, Labs-Infrastructure
zhuyifei1999 awarded T152907: Release a new version of pywikibot a Love token.
Mon, Mar 20, 4:03 AM · Pywikibot-core

Fri, Mar 17

zhuyifei1999 awarded T106924: Consider using the Badges application for a few special roles to highlight those users' comments a Dislike token.
Fri, Mar 17, 3:17 AM · Phabricator

Thu, Mar 16

zhuyifei1999 renamed T160672: Assign new listadmin for commons-poty from "Assign new listadmisn for " to "Assign new listadmin for commons-poty".
Thu, Mar 16, 5:58 PM · Wikimedia-Mailing-lists
zhuyifei1999 edited the description of T153565: MediaWiki file operations are fragile, causing occasional data loss.
Thu, Mar 16, 5:49 PM · Commons, Multimedia, MediaWiki-File-management
zhuyifei1999 added a project to T160654: exim breaks if current directory doesn't exist: Upstream.

You might want to report this to upstream at https://bugs.exim.org/. I don't think labs can do anything about this, unless upstream fix this, or someone here fix and repackage exim (which is very unlikely).

Thu, Mar 16, 4:47 PM · Upstream, Labs, Tool-Labs

Wed, Mar 15

zhuyifei1999 added a comment to T86446: Support @weekly et al in crontab.

For reference, the regex may not be good enough and this could be still an issue. See https://gerrit.wikimedia.org/r/#/c/336998/9/misctools/oge-crontab

Wed, Mar 15, 10:15 AM · Labs, Tool-Labs

Sat, Mar 11

zhuyifei1999 reassigned T160241: wmflabs tool autodesc seems to have "disappeared", calls only return "Not Found" from Cyberpower678 to Magnus.
Sat, Mar 11, 8:39 AM · Tool-Labs-tools-Other

Mon, Mar 6

Ricordisamoa awarded T159595: Make sure abandoned useful tools are properly advertised so potentially interested new maintainers could find them a Like token.
Mon, Mar 6, 1:29 AM · Tool-Labs, Developer-Relations, Labs

Sun, Mar 5

zhuyifei1999 added a comment to T156626: k8s webservice restart failure with `ValueError: get() more than one object; use filter`.

Actually, no. This traceback is the original traceback.

Sun, Mar 5, 4:43 AM · Patch-For-Review, Tools-Kubernetes, Labs, Tool-Labs
zhuyifei1999 added a comment to T156626: k8s webservice restart failure with `ValueError: get() more than one object; use filter`.

Reproduced:

1​(venv)tools.video2commons-test@tools-bastion-02:~$ for i in {1..5}; do kubectl get pods; kubectl get services; kubectl get deployments; webservice --backend=kubernetes python2 stop; kubectl get pods; kubectl get services; kubectl get deployments; webservice --backend=kubernetes python2 start; kubectl get pods; kubectl get services; kubectl get deployments; done
2​NAME READY STATUS RESTARTS AGE
3​interactive 1/1 Running 0 19d
4​Your webservice is not running
5​NAME READY STATUS RESTARTS AGE
6​interactive 1/1 Running 0 19d
7​Starting webservice...
8​NAME READY STATUS RESTARTS AGE
9​interactive 1/1 Running 0 19d
10​video2commons-test-3674141639-6dlc6 1/1 Running 0 3s
11​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
12​video2commons-test 192.168.0.243 <none> 8000/TCP 4s
13​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
14​video2commons-test 1 1 1 1 4s
15​NAME READY STATUS RESTARTS AGE
16​interactive 1/1 Running 0 19d
17​video2commons-test-3674141639-6dlc6 1/1 Running 0 4s
18​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
19​video2commons-test 192.168.0.243 <none> 8000/TCP 4s
20​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
21​video2commons-test 1 1 1 1 4s
22​Stopping webservice...............
23​NAME READY STATUS RESTARTS AGE
24​interactive 1/1 Running 0 19d
25​video2commons-test-3674141639-6dlc6 1/1 Terminating 0 21s
26​Your job is already running
27​NAME READY STATUS RESTARTS AGE
28​interactive 1/1 Running 0 19d
29​video2commons-test-3674141639-6dlc6 1/1 Terminating 0 22s
30​NAME READY STATUS RESTARTS AGE
31​interactive 1/1 Running 0 19d
32​video2commons-test-3674141639-6dlc6 1/1 Terminating 0 23s
33​Stopping webservice............
34​NAME READY STATUS RESTARTS AGE
35​interactive 1/1 Running 0 19d
36​Starting webservice...............
37​NAME READY STATUS RESTARTS AGE
38​interactive 1/1 Running 0 19d
39​video2commons-test-3674141639-tfcq8 0/1 ContainerCreating 0 16s
40​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
41​video2commons-test 192.168.0.233 <none> 8000/TCP 16s
42​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
43​video2commons-test 1 1 1 0 16s
44​NAME READY STATUS RESTARTS AGE
45​interactive 1/1 Running 0 19d
46​video2commons-test-3674141639-tfcq8 0/1 ContainerCreating 0 16s
47​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
48​video2commons-test 192.168.0.233 <none> 8000/TCP 16s
49​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
50​video2commons-test 1 1 1 0 17s
51​Stopping webservice...............
52​NAME READY STATUS RESTARTS AGE
53​interactive 1/1 Running 0 19d
54​video2commons-test-3674141639-tfcq8 1/1 Terminating 0 33s
55​Your job is already running
56​NAME READY STATUS RESTARTS AGE
57​interactive 1/1 Running 0 19d
58​video2commons-test-3674141639-tfcq8 1/1 Terminating 0 33s
59​NAME READY STATUS RESTARTS AGE
60​interactive 1/1 Running 0 19d
61​video2commons-test-3674141639-tfcq8 1/1 Terminating 0 34s
62​Stopping webservice...............
63​NAME READY STATUS RESTARTS AGE
64​interactive 1/1 Running 0 19d
65​video2commons-test-3674141639-tfcq8 1/1 Terminating 0 50s
66​Your job is already running
67​NAME READY STATUS RESTARTS AGE
68​interactive 1/1 Running 0 19d
69​video2commons-test-3674141639-tfcq8 1/1 Terminating 0 51s
70​(venv)tools.video2commons-test@tools-bastion-02:~$ for i in {1..5}; do kubectl get pods; kubectl get services; kubectl get deployments; webservice --backend=kubernetes python2 restart; kubectl get pods; kubectl get services; kubectl get deployments; doneNAME READY STATUS RESTARTS AGE
71​interactive 1/1 Running 0 19d
72​Your job is not running, starting.........
73​NAME READY STATUS RESTARTS AGE
74​interactive 1/1 Running 0 19d
75​video2commons-test-3674141639-0u1mo 1/1 Running 0 10s
76​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
77​video2commons-test 192.168.0.230 <none> 8000/TCP 10s
78​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
79​video2commons-test 1 1 1 1 10s
80​NAME READY STATUS RESTARTS AGE
81​interactive 1/1 Running 0 19d
82​video2commons-test-3674141639-0u1mo 1/1 Running 0 10s
83​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
84​video2commons-test 192.168.0.230 <none> 8000/TCP 10s
85​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
86​video2commons-test 1 1 1 1 10s
87​Restarting webservice...............Traceback (most recent call last):
88​ File "/usr/local/bin/webservice", line 152, in <module>
89​ start(job, '')
90​ File "/usr/local/bin/webservice", line 34, in start
91​ wait_for(lambda: job.get_state() == Backend.STATE_RUNNING, message)
92​ File "/usr/lib/python2.7/dist-packages/toollabs/common/utils.py", line 20, in wait_for
93​ if predicate():
94​ File "/usr/local/bin/webservice", line 34, in <lambda>
95​ wait_for(lambda: job.get_state() == Backend.STATE_RUNNING, message)
96​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
97​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
98​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
99​ selector=selector
100​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
101​ raise ValueError("get() more than one object; use filter")
102​ValueError: get() more than one object; use filter
103​Error in sys.excepthook:
104​Traceback (most recent call last):
105​ File "/usr/lib/python2.7/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
106​ os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
107​OSError: [Errno 2] No such file or directory: '/var/crash/_usr_bin_webservice.52996.crash'
108
109​Original exception was:
110​Traceback (most recent call last):
111​ File "/usr/local/bin/webservice", line 152, in <module>
112​ start(job, '')
113​ File "/usr/local/bin/webservice", line 34, in start
114​ wait_for(lambda: job.get_state() == Backend.STATE_RUNNING, message)
115​ File "/usr/lib/python2.7/dist-packages/toollabs/common/utils.py", line 20, in wait_for
116​ if predicate():
117​ File "/usr/local/bin/webservice", line 34, in <lambda>
118​ wait_for(lambda: job.get_state() == Backend.STATE_RUNNING, message)
119​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
120​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
121​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
122​ selector=selector
123​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
124​ raise ValueError("get() more than one object; use filter")
125​ValueError: get() more than one object; use filter
126​NAME READY STATUS RESTARTS AGE
127​interactive 1/1 Running 0 19d
128​video2commons-test-3674141639-0u1mo 1/1 Terminating 0 27s
129​video2commons-test-3674141639-9gck6 0/1 ContainerCreating 0 0s
130​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
131​video2commons-test 192.168.0.194 <none> 8000/TCP 0s
132​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
133​video2commons-test 1 1 1 0 2s
134​NAME READY STATUS RESTARTS AGE
135​interactive 1/1 Running 0 19d
136​video2commons-test-3674141639-0u1mo 1/1 Terminating 0 28s
137​video2commons-test-3674141639-9gck6 0/1 ContainerCreating 0 1s
138​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
139​video2commons-test 192.168.0.194 <none> 8000/TCP 1s
140​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
141​video2commons-test 1 1 1 0 2s
142​Traceback (most recent call last):
143​ File "/usr/local/bin/webservice", line 148, in <module>
144​ if job.get_state() != Backend.STATE_RUNNING:
145​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
146​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
147​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
148​ selector=selector
149​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
150​ raise ValueError("get() more than one object; use filter")
151​ValueError: get() more than one object; use filter
152​Error in sys.excepthook:
153​Traceback (most recent call last):
154​ File "/usr/lib/python2.7/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
155​ os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
156​OSError: [Errno 2] No such file or directory: '/var/crash/_usr_bin_webservice.52996.crash'
157
158​Original exception was:
159​Traceback (most recent call last):
160​ File "/usr/local/bin/webservice", line 148, in <module>
161​ if job.get_state() != Backend.STATE_RUNNING:
162​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
163​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
164​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
165​ selector=selector
166​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
167​ raise ValueError("get() more than one object; use filter")
168​ValueError: get() more than one object; use filter
169​NAME READY STATUS RESTARTS AGE
170​interactive 1/1 Running 0 19d
171​video2commons-test-3674141639-0u1mo 1/1 Terminating 0 29s
172​video2commons-test-3674141639-9gck6 0/1 ContainerCreating 0 2s
173​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
174​video2commons-test 192.168.0.194 <none> 8000/TCP 2s
175​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
176​video2commons-test 1 1 1 0 3s
177​NAME READY STATUS RESTARTS AGE
178​interactive 1/1 Running 0 19d
179​video2commons-test-3674141639-0u1mo 1/1 Terminating 0 30s
180​video2commons-test-3674141639-9gck6 0/1 ContainerCreating 0 3s
181​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
182​video2commons-test 192.168.0.194 <none> 8000/TCP 3s
183​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
184​video2commons-test 1 1 1 0 4s
185​Traceback (most recent call last):
186​ File "/usr/local/bin/webservice", line 148, in <module>
187​ if job.get_state() != Backend.STATE_RUNNING:
188​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
189​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
190​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
191​ selector=selector
192​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
193​ raise ValueError("get() more than one object; use filter")
194​ValueError: get() more than one object; use filter
195​Error in sys.excepthook:
196​Traceback (most recent call last):
197​ File "/usr/lib/python2.7/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
198​ os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
199​OSError: [Errno 2] No such file or directory: '/var/crash/_usr_bin_webservice.52996.crash'
200
201​Original exception was:
202​Traceback (most recent call last):
203​ File "/usr/local/bin/webservice", line 148, in <module>
204​ if job.get_state() != Backend.STATE_RUNNING:
205​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
206​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
207​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
208​ selector=selector
209​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
210​ raise ValueError("get() more than one object; use filter")
211​ValueError: get() more than one object; use filter
212​NAME READY STATUS RESTARTS AGE
213​interactive 1/1 Running 0 19d
214​video2commons-test-3674141639-0u1mo 1/1 Terminating 0 31s
215​video2commons-test-3674141639-9gck6 0/1 ContainerCreating 0 4s
216​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
217​video2commons-test 192.168.0.194 <none> 8000/TCP 4s
218​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
219​video2commons-test 1 1 1 0 5s
220​NAME READY STATUS RESTARTS AGE
221​interactive 1/1 Running 0 19d
222​video2commons-test-3674141639-0u1mo 1/1 Terminating 0 32s
223​video2commons-test-3674141639-9gck6 0/1 ContainerCreating 0 5s
224​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
225​video2commons-test 192.168.0.194 <none> 8000/TCP 5s
226​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
227​video2commons-test 1 1 1 0 6s
228​Traceback (most recent call last):
229​ File "/usr/local/bin/webservice", line 148, in <module>
230​ if job.get_state() != Backend.STATE_RUNNING:
231​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
232​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
233​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
234​ selector=selector
235​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
236​ raise ValueError("get() more than one object; use filter")
237​ValueError: get() more than one object; use filter
238​Error in sys.excepthook:
239​Traceback (most recent call last):
240​ File "/usr/lib/python2.7/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
241​ os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
242​OSError: [Errno 2] No such file or directory: '/var/crash/_usr_bin_webservice.52996.crash'
243
244​Original exception was:
245​Traceback (most recent call last):
246​ File "/usr/local/bin/webservice", line 148, in <module>
247​ if job.get_state() != Backend.STATE_RUNNING:
248​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 372, in get_state
249​ pod = self._find_obj(pykube.Pod, self.webservice_label_selector)
250​ File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 191, in _find_obj
251​ selector=selector
252​ File "/usr/lib/python2.7/dist-packages/pykube/query.py", line 75, in get
253​ raise ValueError("get() more than one object; use filter")
254​ValueError: get() more than one object; use filter
255​NAME READY STATUS RESTARTS AGE
256​interactive 1/1 Running 0 19d
257​video2commons-test-3674141639-0u1mo 1/1 Terminating 0 33s
258​video2commons-test-3674141639-9gck6 0/1 ContainerCreating 0 6s
259​NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
260​video2commons-test 192.168.0.194 <none> 8000/TCP 6s
261​NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
262​video2commons-test 1 1 1 0 7s

Sun, Mar 5, 4:37 AM · Patch-For-Review, Tools-Kubernetes, Labs, Tool-Labs
zhuyifei1999 created P5016 k8s for i in {1..5} webservice stop; webservice start and webservice restart with kubectl get {pods,services,deployments} for debugging T156626.
Sun, Mar 5, 4:36 AM
zhuyifei1999 added a comment to T156626: k8s webservice restart failure with `ValueError: get() more than one object; use filter`.

@Legoktm What's the output of kubectl get pods, kubectl get services, kubectl get deployments? I'll note that unlike the original exception what happened during starting the service, this one happened during stopping it.

Sun, Mar 5, 4:12 AM · Patch-For-Review, Tools-Kubernetes, Labs, Tool-Labs

Sat, Mar 4

zhuyifei1999 renamed T159603: Decides whether to allow admins to be able to lock tasks from "Decides weather to allow admins to be able to lock tasks" to "Decides whether to allow admins to be able to lock tasks".
Sat, Mar 4, 3:57 PM · Release-Engineering-Team, Phabricator
zhuyifei1999 closed T156845: For Tool Labs admins: Notice of heavy use of tool in the next month as "Resolved".
Sat, Mar 4, 3:52 PM · Stewards-and-global-tools, Labs, Tool-Labs
zhuyifei1999 edited the description of T159595: Make sure abandoned useful tools are properly advertised so potentially interested new maintainers could find them.
Sat, Mar 4, 3:50 PM · Tool-Labs, Developer-Relations, Labs
zhuyifei1999 raised the priority of T159595: Make sure abandoned useful tools are properly advertised so potentially interested new maintainers could find them from "Normal" to "Needs Triage".
Sat, Mar 4, 7:40 AM · Tool-Labs, Developer-Relations, Labs
zhuyifei1999 created T159595: Make sure abandoned useful tools are properly advertised so potentially interested new maintainers could find them.
Sat, Mar 4, 7:40 AM · Tool-Labs, Developer-Relations, Labs

Wed, Mar 1

zhuyifei1999 lowered the priority of T156626: k8s webservice restart failure with `ValueError: get() more than one object; use filter` from "High" to "Normal".

@JustBerry Do you have the steps in which you produced the issue? i.e. what did you execute (and from which host) prior to running webservice stop on tools-bastion-03.

Wed, Mar 1, 9:51 AM · Patch-For-Review, Tools-Kubernetes, Labs, Tool-Labs

Feb 24 2017

zhuyifei1999 added a comment to T115650: Create an authoritative and well promoted catalog of Wikimedia tools.

For reference, T122865: Create a wiki documentation page for each tool is the ticket regarding wikitech pages for tools.

Feb 24 2017, 8:38 AM · Documentation, MediaWiki-Stakeholders-Group, Developer-Wishlist (2017), Community-Tech-Tool-Labs, Labs, Developer-Relations, Tool-Labs-tools-Other

Feb 23 2017

zhuyifei1999 assigned T158405: Consider setting a Diffusion mirror of GitHub's Quentinv57's-tools to Cyberpower678.

(Assigning to tool maintainer)

Feb 23 2017, 3:03 PM · Tool-Labs-tools-Quentinv57's-tools, Tool-Labs, Labs, Tool-Labs-standards-committee
zhuyifei1999 closed T152899: Disk space went not cool again on the video encoding instances as "Resolved".

Re closing as resolved: if /data/scratch malfunctions it shall be a separate ticket; /data/project usage is unrelated to the tool and is tracked in T158786.

Feb 23 2017, 2:14 PM · video2commons
zhuyifei1999 merged T158831: Cleanup /data/project on Labs project video into T158786: Can we delete these old files on video project?.
Feb 23 2017, 2:09 PM · video2commons, Labs
zhuyifei1999 merged task T158831: Cleanup /data/project on Labs project video into T158786: Can we delete these old files on video project?.
Feb 23 2017, 2:09 PM · Labs, video2commons
zhuyifei1999 renamed T158796: Shutting down an instance via Horizon does not work from "Shutting down an instance does not work" to "Shutting down an instance via Horizon does not work".
Feb 23 2017, 5:53 AM · Horizon, Labs

Feb 22 2017

zhuyifei1999 added a comment to T158786: Can we delete these old files on video project?.

The directories videocommons and video2commons-test are nearly empty and created when sudo-ing (by PAM?). They are unused, and I don't mind their deletion, but it'll probably be recreated again.

Feb 22 2017, 5:27 PM · video2commons, Labs
zhuyifei1999 renamed T158786: Can we delete these old files on video project? from "Can we delete these old video2commons files?" to "Can we delete these old files on video project?".
Feb 22 2017, 5:22 PM · video2commons, Labs
zhuyifei1999 added a comment to T152899: Disk space went not cool again on the video encoding instances.
  1. Are you sure you want to be doing this on NFS? I feel like up until recently you were able to accomplish the rendering within instance storage -- is that wrong? Did something change? (NFS is slower, and also since it's a shared resource we try to discourage heavy usage).
Feb 22 2017, 5:04 PM · video2commons

Feb 20 2017

zhuyifei1999 updated subscribers of T158581: replica.my.cnf and .kube/config is not readable by the group members.

only readable by the tool account itself

... but why should it be readable by the group? The credentials are supposed to be used by only the tool account. I remember @yuvipanda resetting replica.my.cnf for the personal accounts that use credentials from tool accounts. Besides, if it's needed by other tool accounts, these other tool accounts have their own credentials anyways; there is no need to share. (And we don't encourage too much use from personal accounts.)

Feb 20 2017, 4:24 PM · Labs, Tool-Labs

Feb 19 2017

zhuyifei1999 removed projects from T158405: Consider setting a Diffusion mirror of GitHub's Quentinv57's-tools: Repository-Admins, Diffusion.

Mirroring a GitHub repo is easy, rTVTC is one. See Striker FAQ for instructions. (Removing the projects as I don't find it relevant with self-served repo creation; revert if I'm wrong)

Feb 19 2017, 6:46 AM · Tool-Labs-tools-Quentinv57's-tools, Tool-Labs, Labs, Tool-Labs-standards-committee

Feb 18 2017

zhuyifei1999 updated subscribers of T158405: Consider setting a Diffusion mirror of GitHub's Quentinv57's-tools.

Uh, googling for Quentinv57 tools I see https://github.com/quentinv57-tools/tools, listing files from public_html/tools/ (but not anywhere else in public_html/). The repo unfortunately has 1 commit only, from @Cyberpower678 in 2014.

Feb 18 2017, 12:20 PM · Tool-Labs-tools-Quentinv57's-tools, Tool-Labs, Labs, Tool-Labs-standards-committee
zhuyifei1999 added a comment to T158405: Consider setting a Diffusion mirror of GitHub's Quentinv57's-tools.

Just checking a more widely-used page, public_html/tools/sulinfo.php contains:

/*   ---------------------------------------------
Feb 18 2017, 12:15 PM · Tool-Labs-tools-Quentinv57's-tools, Tool-Labs, Labs, Tool-Labs-standards-committee

Feb 17 2017

zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

That is the magic.

That is, assuming everything works as expected :)

Feb 17 2017, 5:01 PM · SpamBlacklist, Commons
zhuyifei1999 added a comment to T158405: Consider setting a Diffusion mirror of GitHub's Quentinv57's-tools.

Side note: surprisingly, /data/project/quentinv57-tools has a .git directory, yet its .git/config has no upstream, and $ git log shows fatal: bad default revision 'HEAD' (meaning empty git repo?)

Feb 17 2017, 11:16 AM · Tool-Labs-tools-Quentinv57's-tools, Tool-Labs, Labs, Tool-Labs-standards-committee
zhuyifei1999 moved T158405: Consider setting a Diffusion mirror of GitHub's Quentinv57's-tools from Incoming to Right to fork policy (publish source code) on the Tool-Labs-standards-committee board.
Feb 17 2017, 11:08 AM · Tool-Labs-tools-Quentinv57's-tools, Tool-Labs, Labs, Tool-Labs-standards-committee
zhuyifei1999 committed rTVTC6f329f30c0eb: Frontend: Prefill and show addtask model when location.hash is hashbang (authored by zhuyifei1999).
Frontend: Prefill and show addtask model when location.hash is hashbang
Feb 17 2017, 11:03 AM

Feb 16 2017

zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.
Feb 16 2017, 9:42 PM · SpamBlacklist, Commons
zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

Seems to be T3505

Feb 16 2017, 8:10 PM · SpamBlacklist, Commons
zhuyifei1999 removed a project from T158303: Please delete tool 'ut-iw-bot': Tracking.
Feb 16 2017, 12:56 PM · Labs, Tool-Labs

Feb 15 2017

zhuyifei1999 added a comment to T153864: Disable possibility to create extensionless File namespace pages.

FWIW, there are a lot of overlay.kml subpages of existing file pages. They aren't exactly extensionless, but I imagine they would fall under "invalid filenames" criteria.

Feb 15 2017, 3:54 PM · Patch-For-Review, Multimedia, MediaWiki-General-or-Unknown, Commons, MediaWiki-File-management
zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

FYI: video2commons had two related issues, #72 and #65, although the solution is entirely different.

Feb 15 2017, 11:43 AM · SpamBlacklist, Commons

Feb 14 2017

zhuyifei1999 committed rODITc0417ad4a48b: Install libicu52 on python & python2 base images (authored by zhuyifei1999).
Install libicu52 on python & python2 base images
Feb 14 2017, 4:39 PM
zhuyifei1999 added a subtask for T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking): T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes .
Feb 14 2017, 3:19 PM · Tracking, Tool-Labs, Labs, Tools-Kubernetes
zhuyifei1999 added a parent task for T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes : T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking).
Feb 14 2017, 3:19 PM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
zhuyifei1999 removed a project from T158028: Restore yurik's access to wmflabs: Tool-Labs.
Feb 14 2017, 4:16 AM · Labs
zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

You're free to submit a patch to this extension. Otherwise, unless SpamBlacklist ignores the links already present, I'm inclined to close this ticket as declined with the same reason as T36928.

Feb 14 2017, 3:23 AM · SpamBlacklist, Commons

Feb 13 2017

zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

This is not a bug, spam blacklist looks for added (clickable) urls and check these url to the spamblacklist to avoid making pages uneditable when new url get added to the spamblacklist.

Feb 13 2017, 6:42 PM · SpamBlacklist, Commons
zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

As a design and operating principle, it is common sense to put the workload on the system, rather than on each volunteer on every content-generating project which helps our mission by running approved and well managed batch uploads.

Feb 13 2017, 4:35 PM · SpamBlacklist, Commons
zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

To repeat, the risk here is zero. The blacklist in this situation is an obstacle, not an aide.

Feb 13 2017, 4:31 PM · SpamBlacklist, Commons

Feb 12 2017

zhuyifei1999 awarded T157897: Spam blacklist by-pass right for agreed batch upload projects a Y So Serious token.
Feb 12 2017, 8:00 PM · SpamBlacklist, Commons
zhuyifei1999 added a comment to T157897: Spam blacklist by-pass right for agreed batch upload projects.

With respect, nothing is impossible, it's just a matter of how much effort it would require.

Feb 12 2017, 7:58 PM · SpamBlacklist, Commons
zhuyifei1999 edited the description of T115650: Create an authoritative and well promoted catalog of Wikimedia tools.
Feb 12 2017, 7:35 PM · Documentation, MediaWiki-Stakeholders-Group, Developer-Wishlist (2017), Community-Tech-Tool-Labs, Labs, Developer-Relations, Tool-Labs-tools-Other
zhuyifei1999 added a comment to T157889: checkimages.py gives string formatting error.

I meant you missed that line from my original test. The original test was:

$ python pwb.py shell
Welcome to the Pywikibot interactive shell!
>>> import checkimages
>>> site = pywikibot.Site('id', 'wikipedia')
>>> from pywikibot import i18n
>>> i18n.translate(site, checkimages.nothing_notification)
>>> 
Feb 12 2017, 12:05 PM · Pywikibot-Other-scripts, Pywikibot-core
zhuyifei1999 added a comment to T157889: checkimages.py gives string formatting error.

from pywikibot import i18n ?

Feb 12 2017, 11:44 AM · Pywikibot-Other-scripts, Pywikibot-core
zhuyifei1999 added a comment to T157889: checkimages.py gives string formatting error.

On master, nn is: nn = i18n.translate(self.site, nothing_notification). Testing this:

$ python pwb.py shell
Welcome to the Pywikibot interactive shell!
>>> import checkimages
>>> site = pywikibot.Site('id', 'wikipedia')
>>> from pywikibot import i18n
>>> i18n.translate(site, checkimages.nothing_notification)
>>> 

Expected output of i18n on master: None, and the exception-raising line will not be run. I believe something is wrong with your localization of nothing_notification. If that's the case, I'm inclined to close this as INVALID as this is an error from the user's own modification.

Feb 12 2017, 11:33 AM · Pywikibot-Other-scripts, Pywikibot-core
zhuyifei1999 added a comment to T157889: checkimages.py gives string formatting error.

Line 1593 of latest version isn't notification = nn % self.imageName. In any case, the full traceback and the command that ran the script would help too.

Feb 12 2017, 10:26 AM · Pywikibot-Other-scripts, Pywikibot-core
zhuyifei1999 raised the priority of T157889: checkimages.py gives string formatting error from "High" to "Needs Triage".
Feb 12 2017, 10:17 AM · Pywikibot-Other-scripts, Pywikibot-core
zhuyifei1999 added a comment to T157889: checkimages.py gives string formatting error.

What is your output of python pwb.py version?

Feb 12 2017, 9:27 AM · Pywikibot-Other-scripts, Pywikibot-core

Feb 11 2017

zhuyifei1999 closed T157855: Massive NFS IO on tools-bastion-03 (tools-login) as "Resolved".

Idk what @scfc was doing, but the script terminated and it seems resolved now. The IRC logs are unrelated.

Feb 11 2017, 5:43 AM · Tool-Labs, Labs
zhuyifei1999 added a comment to T157855: Massive NFS IO on tools-bastion-03 (tools-login).

FWIW:

03:25:47 0 ✓ zhuyifei1999@tools-bastion-03: /$ time  stat /data/project
  File: ‘/data/project’ -> ‘/mnt/nfs/labstore-secondary-tools-project’
  Size: 41        	Blocks: 0          IO Block: 4096   symbolic link
Device: fd01h/64769d	Inode: 18          Links: 1
Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2017-02-10 04:10:56.010782700 +0000
Modify: 2016-11-15 04:05:10.250390233 +0000
Change: 2016-11-15 04:05:10.250390233 +0000
 Birth: -
Feb 11 2017, 3:34 AM · Tool-Labs, Labs
zhuyifei1999 assigned T157855: Massive NFS IO on tools-bastion-03 (tools-login) to scfc.
root     27936  0.0  0.0 120924  4692 ?        SNs  Feb10   0:00  \_ sshd: scfc [priv]   
scfc     27986  0.0  0.0 121056  2184 ?        SN   Feb10   0:02  |   \_ sshd: scfc@pts/38   
scfc     27997  0.0  0.0  44892  6284 pts/38   SNs  Feb10   0:00  |       \_ -bash
root      6653  0.0  0.0 156440  8584 pts/38   SN   Feb10   0:00  |           \_ sudo become icelab
root      6654  0.0  0.0 157232  8564 pts/38   SN   Feb10   0:00  |               \_ /usr/bin/sudo -niu tools.icelab
tools.i+  6657  0.0  0.0  45024  6212 pts/38   SN   Feb10   0:00  |                   \_ -bash
tools.i+ 32006  0.0  0.0  36392  1620 pts/38   SN+  02:11   0:00  |                       \_ find -type f -name *.txt.bz2 -print -exec bunzip2 {} ;
tools.i+ 18801 51.9  0.0  12024  6172 pts/38   RN+  03:15   5:15  |                           \_ bunzip2 ./EPJ_resub_revamp/data1/final_id.txt.bz2
Feb 11 2017, 3:31 AM · Tool-Labs, Labs
zhuyifei1999 renamed T157855: Massive NFS IO on tools-bastion-03 (tools-login) from "elastic2001 disk space: Possibly related to immense lag on Tool Labs? 11-02-2017 (~2:22-2:30)" to "Massive NFS IO on tools-bastion-03 (tools-login)".
Feb 11 2017, 3:23 AM · Tool-Labs, Labs

Feb 10 2017

zhuyifei1999 added a comment to T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes .

@scfc It looks like the packages are currently installed for bastion and not for kubernetes or the grid engine. Is this correct? Also, it appears that the packages will not be installed on kubernetes (non-ubuntu) per policy? Is this also correct?

Feb 10 2017, 4:13 PM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
zhuyifei1999 added a comment to T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes .

If you build virtualenv on bastion, it's not gonna work on k8s.
If you build virtualenv on k8s interactive, it's not gonna work on grid.

Feb 10 2017, 2:06 PM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
zhuyifei1999 created T157792: /usr/local/bin/killgridjobs.sh is outdated.
Feb 10 2017, 11:40 AM · Labs, Tool-Labs
zhuyifei1999 added a comment to T135279: OAuth time out is too short.

Not before {T157781} and {T157784} please.

Feb 10 2017, 9:42 AM · Wikisource, Tool-Labs-tools-Other

Feb 9 2017

zhuyifei1999 claimed T157728: checkimages.py: Should be able to limit how many notifications are sent to a single user in a single bot run.
Feb 9 2017, 8:43 PM · Patch-For-Review, Pywikibot-core, Pywikibot-Commons
zhuyifei1999 created T157728: checkimages.py: Should be able to limit how many notifications are sent to a single user in a single bot run.
Feb 9 2017, 8:43 PM · Patch-For-Review, Pywikibot-core, Pywikibot-Commons
zhuyifei1999 added a comment to T156174: Rewrite /usr/local/bin/crontab in python; fix bugs.

Yeah sure. Part of this task anyways. :)

Feb 9 2017, 8:07 PM · Patch-For-Review, Labs, Tool-Labs
zhuyifei1999 edited the description of T157698: #tool-labs workboard is crazy.
Feb 9 2017, 4:46 PM · Labs, Tool-Labs
zhuyifei1999 created T157698: #tool-labs workboard is crazy.
Feb 9 2017, 4:42 PM · Labs, Tool-Labs
zhuyifei1999 added a comment to T157662: Error pages link to obsolete wiki page.

There are no common causes of errors in that page, nor anywhere that I can remember. If that were actually the intended target, I'd suggest to change it to

You may wish to <a href="https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Web#Web_logs">check your logs</a>.</p>
Feb 9 2017, 3:16 PM · Labs, Tool-Labs
zhuyifei1999 added a comment to T156174: Rewrite /usr/local/bin/crontab in python; fix bugs.

How about something similar to this:

Feb 9 2017, 2:46 PM · Patch-For-Review, Labs, Tool-Labs
zhuyifei1999 created P4916 Python version of toollabs remote crontab.
Feb 9 2017, 2:41 PM