Page MenuHomePhabricator
Feed Advanced Search

Aug 29 2017

Jprorama added a comment to T173416: Debugging notebook cell action/state.

I have a test environment with a 1G memory limit and can reliably make the jupyter kernel fail in this environment at the gridsearch call as a result of limited memory (VM with 1G and running Jupyter inside a Docker container, mainly for simplified Jupyter setup). For reference, here's the startup line for docker (the notebook is loaded manually on the jupyter ui):

Aug 29 2017, 2:24 PM · PAWS

Aug 22 2017

Jprorama added a comment to T173416: Debugging notebook cell action/state.

Thanks for the suggestion. I'll run a test with more limited RAM. BTW, is there any status/monitoring to observe jupyter kernel status from a notebook user end? I haven't found anything yet.

Aug 22 2017, 5:58 PM · PAWS

Aug 17 2017

Jprorama added a comment to T173416: Debugging notebook cell action/state.

The tools project contains a list of all the instances. This includes the k8s nodes, grid workers, and PAWS fabric. This doesn't appear to include the nodes referenced above or their monitoring. Likely the separate PAWS project is the new platform being set up to isolate contention in T167086.

Aug 17 2017, 5:24 PM · PAWS
Jprorama added a comment to T173416: Debugging notebook cell action/state.

The PAWS instances do have monitoring but the load doesn't seem to tick up in response to the grid search.

Aug 17 2017, 12:50 AM · PAWS

Aug 16 2017

Jprorama updated the task description for T173416: Debugging notebook cell action/state.
Aug 16 2017, 1:39 PM · PAWS
Jprorama created T173416: Debugging notebook cell action/state.
Aug 16 2017, 1:26 PM · PAWS

Aug 14 2017

Jprorama added a project to T173312: Resource based (CPU/IO/Disk) quota imposed on a per-namespace basis in k8s cluster: Toolforge.
Aug 14 2017, 3:24 PM · Toolforge, Kubernetes
Jprorama added a comment to T173312: Resource based (CPU/IO/Disk) quota imposed on a per-namespace basis in k8s cluster.

K8s quotas are implemented with a per-namespace ResourceQuota object. See k8s quota documentation.

Aug 14 2017, 2:28 PM · Toolforge, Kubernetes
Jprorama updated the task description for T173312: Resource based (CPU/IO/Disk) quota imposed on a per-namespace basis in k8s cluster.
Aug 14 2017, 2:25 PM · Toolforge, Kubernetes
Jprorama created T173312: Resource based (CPU/IO/Disk) quota imposed on a per-namespace basis in k8s cluster.
Aug 14 2017, 2:09 PM · Toolforge, Kubernetes

Aug 12 2017

Jprorama added a comment to T172855: Create visual diagram of documented components of Toolforge Kubernetes cluster.

Plan to use the node naming conventions table and Hiera:Tools data as source for the elements and labels for this diagram.

Aug 12 2017, 2:04 PM · Toolforge, Documentation, Kubernetes

Aug 9 2017

Jprorama added a comment to T172855: Create visual diagram of documented components of Toolforge Kubernetes cluster.

is a quick and dirty draft simply collecting the cluster information from the Component section of the admin page.

Aug 9 2017, 9:18 AM · Toolforge, Documentation, Kubernetes
Jprorama created T172855: Create visual diagram of documented components of Toolforge Kubernetes cluster.
Aug 9 2017, 9:06 AM · Toolforge, Documentation, Kubernetes

Jul 25 2017

Jprorama added a comment to T171618: Create a "state of the cloud" monthly report.

Have often found number of unique log ins to a systems per month to be a useful stat: (Drop the wc to see the distribution of logins per user.)

Jul 25 2017, 5:38 PM · Cloud-VPS, Toolforge