yuvipanda (yuvipanda)
Serious business title

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Oct 30 2014, 8:28 PM (155 w, 1 d)
Availability
Available
IRC Nick
yuvipanda
LDAP User
Yuvipanda
MediaWiki User
Yuvipanda

Recent Activity

Wed, Oct 4

yuvipanda updated subscribers of T177363: PAWS Kubernetes cluster forgot how to forward packets between nodes.
Wed, Oct 4, 12:50 AM · Toolforge, PAWS
yuvipanda renamed T177363: PAWS Kubernetes cluster forgot how to forward packets between nodes from Mysterious iptables rule suddenly required to keep networking inside pods working to PAWS outage of unknown cause.
Wed, Oct 4, 12:49 AM · Toolforge, PAWS
yuvipanda added a comment to T177363: PAWS Kubernetes cluster forgot how to forward packets between nodes.

on a personal note, at some point in the debugging I was ready to give up and let PAWS die - thankfully with some encouragement from @bd808 and @chasemp it did not happen. However, without stronger institutional support, I'm unsure how much longer PAWS can survive. @bd808, @chasemp and @madhuvishy need more help & resources if PAWS is to continue to thrive.

Wed, Oct 4, 12:49 AM · Toolforge, PAWS
yuvipanda updated subscribers of T177363: PAWS Kubernetes cluster forgot how to forward packets between nodes.
Wed, Oct 4, 12:33 AM · Toolforge, PAWS
yuvipanda created T177363: PAWS Kubernetes cluster forgot how to forward packets between nodes.
Wed, Oct 4, 12:32 AM · Toolforge, PAWS

Sep 12 2017

yuvipanda added a comment to T175623: Uptimerobot monitoring for the Articlerequest tool flaps.

From my experience with uptimerobot, it's quite flaky - we got one or two false positive alerts each day from it. I've switched to using Pingdom for that reason.

Sep 12 2017, 11:45 PM · Tool-Article-request, User-Matthewrbowker, Toolforge

Sep 6 2017

yuvipanda added a comment to T173983: 504 Gateway Time-Out when loading PAWS.

is this still the case?

Sep 6 2017, 7:19 PM · PAWS
yuvipanda added a comment to T174867: Wikivoyage is missing from PAWS system user-config.py.

It would be great if someone could make a PR on https://github.com/yuvipanda/paws fixing it :) If not I'll try to fix this next week.

Sep 6 2017, 7:18 PM · PAWS
yuvipanda created T175202: Cull Idle does not work on pAWS.
Sep 6 2017, 7:16 PM · PAWS

Aug 29 2017

yuvipanda added a comment to T140525: HTTP 404 error (or sometimes 502 error) when trying to access the Control Panel of PAWS.

Is this still the case with paws.wmflabs.org now? It's running on a completely different backend!

Aug 29 2017, 8:07 PM · PAWS

Aug 20 2017

yuvipanda added a comment to T173416: Debugging notebook cell action/state.

It's possible that you just ran out of RAM and the kernel died? I think we have a 1G memory limit...

Aug 20 2017, 4:51 PM · PAWS

Aug 19 2017

yuvipanda closed T159072: PAWS loop redirect as Resolved.
Aug 19 2017, 6:45 PM · PAWS
yuvipanda closed T133486: PAWS 500 : Internal Server Error as Resolved.

I've switched the backend of paws completely as of today, and that should help fix most of these!

Aug 19 2017, 6:42 PM · PAWS
yuvipanda closed T150180: paws.wmflabs.org should be the public view as Declined.

I'm going to say 'too late' and close this, unfortunately.

Aug 19 2017, 6:41 PM · PAWS
yuvipanda added a comment to T159072: PAWS loop redirect.

Heya! This should be fixed now, since I deployed a new backend for paws.wmflabs.org. Let me know if it isn't!

Aug 19 2017, 6:40 PM · PAWS
yuvipanda closed T159617: Enable downloading notebooks as PDF as Resolved.

I deployed new backend for paws.wmflabs.org now, and it should allow you to download PDFs. Please re-open if it doesn't!

Aug 19 2017, 6:40 PM · Patch-For-Review, PAWS
yuvipanda added a comment to T171820: PAWS doesn't display space character.

What browser are you on?

Aug 19 2017, 6:36 PM · PAWS
yuvipanda closed T173278: Installing R packages fails. Directory not write-able as Resolved.
Aug 19 2017, 6:36 PM · PAWS
yuvipanda added a comment to T173278: Installing R packages fails. Directory not write-able.

Fixed and deployed. paws.wmflabs.org should have it in about 20 minutes or so.

Aug 19 2017, 6:36 PM · PAWS
yuvipanda added a comment to T172257: Point paws.wmflabs.org to new PAWS setup.

Done now! \o/

Aug 19 2017, 6:33 PM · PAWS
yuvipanda closed T172660: Tool "masscamps" loads jquery and angularjs from ajax.googleapis.com as Resolved.

I've shut it down.

Aug 19 2017, 6:33 PM · Tools
yuvipanda closed T172660: Tool "masscamps" loads jquery and angularjs from ajax.googleapis.com, a subtask of T172065: Hunt for Toolforge tools that load resources from third party sites, as Resolved.
Aug 19 2017, 6:33 PM · Toolforge-standards-committee, Tools, Privacy
yuvipanda added a comment to T173616: React's license is considered harmful.

Feel free to junk the mattermost repo.

Aug 19 2017, 6:31 PM · Software-Licensing, WMF-Legal

Aug 9 2017

yuvipanda added a comment to T172660: Tool "masscamps" loads jquery and angularjs from ajax.googleapis.com.

I don't think anyone is using this project, and I've no time, so am happy to just shut the tool :)

Aug 9 2017, 4:59 PM · Tools

Aug 3 2017

yuvipanda assigned T172344: Can't create or manage domains in the PAWS project to Andrew.
Aug 3 2017, 12:13 AM · Cloud-Services
yuvipanda added a comment to T172344: Can't create or manage domains in the PAWS project.

Here's what I want to do:

Aug 3 2017, 12:13 AM · Cloud-Services
yuvipanda created T172344: Can't create or manage domains in the PAWS project.
Aug 3 2017, 12:05 AM · Cloud-Services
yuvipanda closed T164198: R kernel not available for PAWS as Resolved.

@Halfak should be all sorted out now!

Aug 3 2017, 12:04 AM · PAWS

Aug 2 2017

yuvipanda added a comment to T172257: Point paws.wmflabs.org to new PAWS setup.

I'm trying to set up auto deploys to PAWS, so I'll wait till I'm done with that.

Aug 2 2017, 10:58 PM · PAWS
yuvipanda added a comment to T164198: R kernel not available for PAWS.

@Halfak that's strange. I totally do see an 'R' in the new dropdown menu....

Aug 2 2017, 6:54 PM · PAWS
yuvipanda added a comment to T136114: PAWS can not login, OAuth error: API error mwoauth-invalid-authorization.

@MarcoAurelio - is that showing up at paws.tools.wmflabs.org and not at paws.wmflabs.org? Or is it showing up at both?

Aug 2 2017, 1:44 PM · MediaWiki-extensions-OAuth, Pywikibot-OAuth, PAWS
yuvipanda created T172257: Point paws.wmflabs.org to new PAWS setup.
Aug 2 2017, 9:10 AM · PAWS
yuvipanda closed T143493: Paws display 504 - Bad gateway time-out as Resolved.
Aug 2 2017, 9:06 AM · PAWS
yuvipanda added a comment to T161696: Oauth for PAWS fails - presumably because of username change.

can you try https://paws.tools.wmflabs.org? It's a new installation of PAWS (you get to keep all your old files!). I'll switch out the URL in a couple days if it goes well :)

Aug 2 2017, 9:05 AM · MediaWiki-extensions-OAuth, PAWS
yuvipanda added a comment to T164198: R kernel not available for PAWS.

Heya! https://paws.tools.wmflabs.org is the newer version of PAWS (URLs will switch shortly!). It does have an R kernel! Can you check it out and confirm?

Aug 2 2017, 9:04 AM · PAWS
yuvipanda added a comment to T136114: PAWS can not login, OAuth error: API error mwoauth-invalid-authorization.

@MisterSynergy can you (and others!) try out a new install at https://paws.tools.wmflabs.org? All your old files will still be here, but the authentication (and other code) is vastly improved and stable. I'll point paws.wmflabs.org to this in the next few days. Try it out and see if that solves your problem?

Aug 2 2017, 9:00 AM · MediaWiki-extensions-OAuth, Pywikibot-OAuth, PAWS
yuvipanda added a comment to T172080: Paws display "502 - Bad gateway error" for specific user.

@Ebraminio cool! I'm going to upgrade Python to 3.6 as well (it's currently 3.5 I think) :) npm will also be available by default.

Aug 2 2017, 7:45 AM · PAWS
yuvipanda added a comment to T172080: Paws display "502 - Bad gateway error" for specific user.

@Ebramino can you try https://paws.tools.wmflabs.org? It's going to replace paws.wmflabs.org shortly. Same everything, just a different underlying base.

Aug 2 2017, 3:20 AM · PAWS
yuvipanda closed T172209: Expand PAWS cluster to be about 10 nodes as Resolved.

Since labs in general hates it when I try to create new instances, it took me almost 20 tries with lots of instances failing, but I now have ten nodes! Hopefully I'll not have to touch instance creation again for a long time. It's quite frustrating... :(

Aug 2 2017, 1:35 AM · Kubernetes, Toolforge, PAWS
yuvipanda updated subscribers of T172209: Expand PAWS cluster to be about 10 nodes.

It's at 5 nodes now, and I've run out of quota in tools now.

Aug 2 2017, 12:43 AM · Kubernetes, Toolforge, PAWS
yuvipanda closed T132025: Setup a devpi server to help speedup pip installs as Declined.

Not worth it.

Aug 2 2017, 12:22 AM · PAWS, Cloud-Services, Toolforge

Aug 1 2017

yuvipanda closed T120558: PAWS with bot accounts as Resolved.

Going to close this for now!

Aug 1 2017, 11:32 PM · PAWS
yuvipanda closed T155763: Pandas to_clipboard function does not work in remote environments like PAWS as Declined.

Closing, since the modle of pasting won't really ever work with remote kernels like PAWS :)

Aug 1 2017, 11:02 PM · PAWS
yuvipanda closed T167926: Install Python 2.7 in PAWS as Declined.

Heya! Thanks for filing this!

Aug 1 2017, 11:01 PM · PAWS
awight awarded T169452: Consider moving Quarry to be an installation of Redash a Baby Tequila token.
Aug 1 2017, 9:52 PM · Cloud-Services, Quarry
yuvipanda updated subscribers of T172209: Expand PAWS cluster to be about 10 nodes.

To be clear, I don't actually care too much about the size of Tools' k8s cluster :) I only want about 8-10 nodes for the PAWS cluster :) Am happy to let toolforge admins decide if they wanna down size tools' cluster

Aug 1 2017, 6:29 PM · Kubernetes, Toolforge, PAWS
yuvipanda created T172209: Expand PAWS cluster to be about 10 nodes.
Aug 1 2017, 6:13 PM · Kubernetes, Toolforge, PAWS
yuvipanda added a comment to T104686: Unbreak/finish global merge of Yuvipanda into YuviPanda.

Things seem to be working now! Thank you very much, everyone involved! I'll leave it to someone else to close this ticket :)

Aug 1 2017, 6:03 PM · Wikimedia-maintenance-script-run, Wikimedia-Site-requests
yuvipanda closed T168686: Use wmcloud.org domain for PAWS as Declined.

Nah, don't care for now. Can move whenever other stuff moves :)

Aug 1 2017, 7:05 AM · Cloud-Services
yuvipanda closed T168686: Use wmcloud.org domain for PAWS, a subtask of T166404: Program 10 Outcome 2: Rebranding, as Declined.
Aug 1 2017, 7:05 AM · Patch-For-Review, cloud-services-team (FY2017-18), Goal
yuvipanda closed T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster as Resolved.

Yup, new cluster!

Aug 1 2017, 7:04 AM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda added a comment to T104686: Unbreak/finish global merge of Yuvipanda into YuviPanda.

Note that I'm now running into errors like:

Aug 1 2017, 6:58 AM · Wikimedia-maintenance-script-run, Wikimedia-Site-requests

Jul 30 2017

yuvipanda updated subscribers of T169452: Consider moving Quarry to be an installation of Redash.

As a note, @zhuyifei1999 has graciously offered to look at some of the outstanding Quarry issues. I've given them merge rights + labs admin.

Jul 30 2017, 8:03 PM · Cloud-Services, Quarry

Jul 18 2017

yuvipanda added a comment to T169452: Consider moving Quarry to be an installation of Redash.

Yup, we can keep a static version running forever.

Jul 18 2017, 1:07 AM · Cloud-Services, Quarry
yuvipanda added a comment to T170878: Audit users and account expiry dates for stat boxes.

I still want it, but I'm part of the ops group anyway. So in the interest of keeping this list clean you might remove me (I was added to this group before I became ops)

Jul 18 2017, 1:00 AM · User-Elukey, Patch-For-Review, Analytics-Kanban, Analytics-Cluster

Jul 12 2017

yuvipanda added a comment to T102081: Provide an easy way for Tool Labs tools to expose their source code.

All of the things I was thinking of and can think of now seem terrible and seem to enable our current set of terrible practices. I'll leave it to the current stewards of tools to figure out what to do :) I do agree that enforcing a vcs seems best possible option.

Jul 12 2017, 12:08 AM · Toolforge, Developer-Relations

Jul 10 2017

yuvipanda added a comment to T170119: Upgrade to kubernetes >=1.5.

Note that 1.7 landed https://kubernetes.io/docs/admin/extensible-admission-controllers/ which will allow us to remove all of our custom patches used in tools.

Jul 10 2017, 7:35 PM · Patch-For-Review, Services (watching), Kubernetes, Operations, Goal

Jul 6 2017

yuvipanda added a comment to T169210: Restarting tools after NFS issues.

You can get a list of all pods with kubectl get --all-namespaces pods and then do bash magic from there.

Jul 6 2017, 12:51 AM · Toolforge, Tools
yuvipanda added a comment to T169210: Restarting tools after NFS issues.

When I was doing it, I'd just do some shell scripting to delete all the pods in all namespaces that aren't paws. k8s will start them back up.

Jul 6 2017, 12:50 AM · Toolforge, Tools

Jul 4 2017

Bawolff awarded T86218: Make labsdb views fully column-whitelist based a Like token.
Jul 4 2017, 5:41 PM · Cloud-Services, Toolforge, LabsDB-Auditor

Jul 1 2017

yuvipanda added a comment to T169452: Consider moving Quarry to be an installation of Redash.

You'd have to do some amount of proxy magic to get it to work with mediawiki auth. We should have an authenticator running as a separate app. The proxy should check for a cookie, and try to validate it (with a HMAC, shouldn't be too hard). If it fails, or there's no cookie, we'll redirect to our authenticator, which will do the MW OAuth flow and set a cookie. On second attempt, we'll see the valid cookie in the proxy, and set a trusted header for Redash to consume.

Jul 1 2017, 11:30 PM · Cloud-Services, Quarry
yuvipanda created T169452: Consider moving Quarry to be an installation of Redash.
Jul 1 2017, 11:27 PM · Cloud-Services, Quarry
yuvipanda added a comment to T136385: Research: Investigate Cassandra Kubernetification using upcoming PetSet abstraction in K8s 1.3.

k8s 1.7 was released yesterday with support for node-local persistent storage: https://kubernetes.io/docs/concepts/storage/volumes/#local

Jul 1 2017, 8:33 PM · Services (later), Cassandra

Jun 30 2017

yuvipanda added a comment to T104686: Unbreak/finish global merge of Yuvipanda into YuviPanda.

bump? :D

Jun 30 2017, 12:51 AM · Wikimedia-maintenance-script-run, Wikimedia-Site-requests
yuvipanda awarded T168683: Upgrade pandoc package to at least 1.12.3 a Evil Spooky Haunted Tree token.
Jun 30 2017, 12:50 AM · Discovery-Analysis, Operations

Jun 22 2017

yuvipanda updated subscribers of T168686: Use wmcloud.org domain for PAWS.
Jun 22 2017, 9:21 PM · Cloud-Services
yuvipanda created T168686: Use wmcloud.org domain for PAWS.
Jun 22 2017, 9:13 PM · Cloud-Services

Jun 20 2017

yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

Going to keep it inside tools!

Jun 20 2017, 5:45 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda closed T167324: Fix or delete tools-worker-1028 and 29 as Resolved.

I just deleted these :)

Jun 20 2017, 5:41 PM · Toolforge, Tools-Kubernetes, Cloud-Services

Jun 19 2017

yuvipanda removed a member for acl*operations-team: yuvipanda.
Jun 19 2017, 6:15 PM
yuvipanda removed a member for Security: yuvipanda.
Jun 19 2017, 6:15 PM

Jun 16 2017

yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

I've a working cluster on the PAWS project now! https://paws.deis.youarenotevena.wiki/hub/login :D

Jun 16 2017, 10:15 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

https://phabricator.wikimedia.org/T168039 for an IP quota increase :)

Jun 16 2017, 7:09 AM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda created T168039: Request increased quota for paws labs project.
Jun 16 2017, 7:06 AM · Cloud-Services
yuvipanda reopened T168039: Request increased quota for paws labs project, a subtask of T140904: Existing Labs project quota increase requests (Tracking), as Open.
Jun 16 2017, 7:06 AM · User-bd808, Tracking, Cloud-Services

Jun 13 2017

yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

On chatting more, if I have to use puppet then using the tools puppetmaster will make my life easier. So I'm going to prototype this on the paws project and move it to tools if using the puppetmaster will make my life easier in any way.

Jun 13 2017, 8:15 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

One of the things I'd like to do is to use an nginx ingress directly for getting traffic into the cluster, instead of using the tools-proxy machinery. My plan is to totally not use puppet at all and try a coreos type setup - you set up an image once with cloud-init type thing, and then there are no changes to it ever (except base puppet in our case, which won't have any roles related to k8s). You just make new instances for upgrades, and run everything in containers.

Jun 13 2017, 8:00 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS

Jun 12 2017

yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

It looks like everyone's onboard with this plan, so I'll start poking at it in a week or so.

Jun 12 2017, 5:04 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS

Jun 8 2017

debt awarded T69161: Implement API for intitle:<query>ies that do only title highlighting a Like token.
Jun 8 2017, 6:58 PM · Discovery-Search, Discovery, MediaWiki-Search

Jun 7 2017

yuvipanda added a subtask for T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster: T160113: Move PAWS nfs onto its own share.
Jun 7 2017, 8:03 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda added a parent task for T160113: Move PAWS nfs onto its own share: T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.
Jun 7 2017, 8:03 PM · Cloud-Services, PAWS
yuvipanda removed a member for Teahouse: yuvipanda.
Jun 7 2017, 8:01 PM
yuvipanda removed a member for Operations: yuvipanda.
Jun 7 2017, 8:01 PM
yuvipanda removed a member for Montage: yuvipanda.
Jun 7 2017, 8:01 PM
yuvipanda removed a member for LabsDB-Auditor: yuvipanda.
Jun 7 2017, 8:00 PM
yuvipanda removed a member for Labs-Team-Backlog: yuvipanda.
Jun 7 2017, 8:00 PM
yuvipanda removed a member for Cloud-Services: yuvipanda.
Jun 7 2017, 8:00 PM
yuvipanda removed a member for acl*annual_report_policy_admins: yuvipanda.
Jun 7 2017, 8:00 PM
yuvipanda removed a member for Jupyter-Hub: yuvipanda.
Jun 7 2017, 7:59 PM
yuvipanda removed a member for crosswatch: yuvipanda.
Jun 7 2017, 7:59 PM
yuvipanda removed a member for Beta-Cluster-Infrastructure: yuvipanda.
Jun 7 2017, 7:59 PM
yuvipanda removed a member for Ops-Access-Requests: yuvipanda.
Jun 7 2017, 7:59 PM
yuvipanda removed a member for Shinken: yuvipanda.
Jun 7 2017, 7:59 PM
yuvipanda removed a member for Triagers: yuvipanda.
Jun 7 2017, 7:58 PM
yuvipanda removed a watcher for Toolforge: yuvipanda.
Jun 7 2017, 7:58 PM
yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

@madhuvishy +1, I'd love it to be a separate share!

Jun 7 2017, 6:02 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda updated subscribers of T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

@madhuvishy if this happens, I'll also need to transfer the entire contents of the paws tool dir on tools NFS to this new project's NFS. And you (I think?) need to be ok with the paws project getting NFS enabled :)

Jun 7 2017, 5:23 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, Cloud-Services, PAWS
yuvipanda created T167324: Fix or delete tools-worker-1028 and 29.
Jun 7 2017, 5:10 PM · Toolforge, Tools-Kubernetes, Cloud-Services
yuvipanda added a comment to T167086: Consider moving PAWS to its own k8s cluster, rather than using Tools' k8s cluster.

@Andrew right. However, it's already the case tho - PAWS right now is still mostly reliant on me, for mostly resourcing reasons. The way I'd do this is to make it quite easy for people to just follow kubeadm upstream tutorials on setting up on labs (maybe even make it into a wikitech page) so other people who might want to use it can. I also believe that kubeadm is the correct long term solution for both tools and prod, so more people playing with that doesn't sound bad...

Jun 7 2017, 5:06 PM · Kubernetes, Patch-For-Review, Tools-Kubernetes, PAWS, Cloud-Services
yuvipanda placed T147832: How to change the default uploading time in PAWS up for grabs.
Jun 7 2017, 4:56 PM · Pywikibot-core, PAWS