Page MenuHomePhabricator

Eevans (Eric Evans)
Senior Software Engineer

Projects (13)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Feb 27 2015, 10:47 PM (221 w, 10 h)
Availability
Available
IRC Nick
urandom
LDAP User
Eevans
MediaWiki User
Unknown

Recent Activity

Yesterday

Eevans updated the task description for T223976: Decommission restbase10(0[7-9]|1[0-5]).
Fri, May 24, 9:53 PM · Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations
Eevans updated the task description for T223976: Decommission restbase10(0[7-9]|1[0-5]).
Fri, May 24, 12:15 AM · Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations

Thu, May 23

Eevans updated the task description for T223976: Decommission restbase10(0[7-9]|1[0-5]).
Thu, May 23, 1:52 PM · Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations

Wed, May 22

Eevans updated the task description for T223976: Decommission restbase10(0[7-9]|1[0-5]).
Wed, May 22, 1:05 PM · Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations
Eevans added a comment to T222907: Determine if per-request TTLs are needed.

[ ... ]

From the task description:

Put another way, what is at question is NOT whether arbitrary TTLs are possible, but whether the client can override the default with something shorter.

The ability to configure session TTLs is baked in to our current SessionManager/SessionBackend/BagOStuff implementation, and nothing I do in RESTBagOStuff will eliminate that configuration setting. So it will be possible for someone to *think* they are configuring an arbitrary TTL on the client (wiki) side. But we can, of course, ignore that setting. And in fact, we currently are ignoring it - the current RESTBagOStuff implementation never even sends it to Kask.

So if it suffices to provide a consistent TTL across all sessions on all wikis (and it appears it does) then I think that we are, technically speaking, done.

However, it feels sketchy to me that it is possible to configure a TTL that gets silently ignored. Someone might set $wgObjectCaacheSessionExpiry on a wiki that uses RESTBagOStuff and reasonably expect it to do something. But it would not.

Wed, May 22, 2:05 AM · Core Platform Team Kanban (Doing), Core Platform Team (Session Management Service (CDP2))

Tue, May 21

Eevans added a comment to T222990: Audit session storage to determine max age of un-GC'd sessions.

@Eevans is this a task for you or were you looking for input from @EvanProdromou ?

Tue, May 21, 6:49 PM · audits-data-retention, Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T222907: Determine if per-request TTLs are needed.
Tue, May 21, 3:45 PM · Core Platform Team Kanban (Doing), Core Platform Team (Session Management Service (CDP2))
Eevans updated the task description for T222907: Determine if per-request TTLs are needed.
Tue, May 21, 3:38 PM · Core Platform Team Kanban (Doing), Core Platform Team (Session Management Service (CDP2))

Mon, May 20

Eevans added a comment to T223825: Degraded RAID on restbase-dev1006.

Not production; This host can be taken down at any time, without coordination.

Mon, May 20, 2:34 PM · ops-eqiad, Operations

Fri, May 17

Eevans added a comment to T215533: Enable use of session storage service in MediaWiki.

[ ... ]
However, if there's no compelling need to do Basic Auth, I'd vote to support the option that it sounds like both RESTBagOStuff and Kask already support.

Fri, May 17, 1:24 PM · MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans

Tue, May 14

Eevans added a comment to T219879: Create a test runner for end-to-end API tests (Phester).

Additional notes and considerations:
[ ... ]

  • The test runner should not hard code any knowledge about the MediaWiki action API, and should be designed to be usable for testing other APIs, such as RESTbase.
Tue, May 14, 6:18 PM · Epic, Code-Health, Core Platform Team (Code Health (TEC13))

Sat, May 11

Eevans added a comment to T219831: Security Review For Kask.

[ ... ]
Policy Compliance
I am assuming data will live in Cassandra and within relevant logs in accordance with Wikimedia's existing data retention guidelines.

No PII should ever by logged, but session data is persisted in Cassandra. Sessions expire well before the max retention period, but that data is not immediately removed from storage, it's GC'd by compaction (as dictated by the compaction algorithm in use) after a moratorium (defaults to 10 days). I would be really surprised if that process were to drag out past 90 days (or anything even close to 90 days), but it might be worth putting a pin in this, and conduct an audit at some point to verify just how long they do hang around.

Sat, May 11, 12:34 AM · Security-Team-Review-Active, Services (watching), Core Platform Team Backlog (Watching / External), Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, User-Eevans
Eevans triaged T222990: Audit session storage to determine max age of un-GC'd sessions as Normal priority.
Sat, May 11, 12:33 AM · audits-data-retention, Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans created T222990: Audit session storage to determine max age of un-GC'd sessions.
Sat, May 11, 12:32 AM · audits-data-retention, Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans added a comment to T219831: Security Review For Kask.

This is awesome @sbassett; Thanks for looking it over! I left some comments inline:

Sat, May 11, 12:19 AM · Security-Team-Review-Active, Services (watching), Core Platform Team Backlog (Watching / External), Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, User-Eevans

Fri, May 10

Eevans closed T222227: Kask support for operations/software/service-checker as Resolved.
Fri, May 10, 4:27 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans closed T222227: Kask support for operations/software/service-checker, a subtask of T209108: Monitoring and data collection for session storage service, as Resolved.
Fri, May 10, 4:27 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans committed rMSKS7aaf55560c58: Serve OpenAPI specification (authored by Eevans).
Serve OpenAPI specification
Fri, May 10, 4:24 PM

Thu, May 9

Eevans added a comment to T222907: Determine if per-request TTLs are needed.

FYI, I think CentralAuth needs a TTL different to that of regular sessions (IIRC, this was cited as a reason for exposing the TTL). Regardless of whether or not this is true, we should probably consider using a different instance of the service for CentralAuth (it's trivial to do). If we do, we can configure it with a different default TTL as well.

Thu, May 9, 7:19 PM · Core Platform Team Kanban (Doing), Core Platform Team (Session Management Service (CDP2))
Eevans added a comment to T222908: Determine if set-if-not-exists method is necessary for session storage.

This task is to check if this is needed now, or ever.

Thu, May 9, 7:08 PM · Core Platform Team Kanban (Doing), Core Platform Team (Session Management Service (CDP2))
Eevans added a comment to T222908: Determine if set-if-not-exists method is necessary for session storage.

I'll check through our session-handling code to see if we ever use this type of call (I think it's add() in BagOStuff) for sessions, and if it seems like it's necessary at that point.

Off my dome, I could see using this type of write when you're worried about propagation delays between data centres. One scenario:

  1. Client connects to server in DC1 and gets a session ID AAAA
  2. Application server in DC1 unconditionally writes an empty session object with key AAAA to DC1 cluster
  3. User authenticates to application server in DC1
  4. Application server in DC1 unconditionally writes a session object with user ID with key AAAA to DC1 cluster
  5. Client connects to application server in DC2, with session ID AAAA
  6. Application server in DC2 reads session with key AAAA from DC2 cluster, gets no value
  7. Empty session object with key AAAA propagates from DC1 cluster to DC2 cluster
  8. Session object with user ID and key AAAA propagates from DC1 cluster to DC2 cluster
  9. Application server in DC2 unconditionally writes empty session object for key AAAA to cluster in DC2
  10. Empty session object with key AAAA propagates from DC2 cluster to DC1 cluster
Thu, May 9, 6:49 PM · Core Platform Team Kanban (Doing), Core Platform Team (Session Management Service (CDP2))
Eevans added a comment to T215533: Enable use of session storage service in MediaWiki.

One thing I want to make sure of is that KaskBagOStuff is compatible with the TLS setup defined in T209109, as well as supporting username/password HTTP Basic authentication.

Thu, May 9, 6:33 PM · MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans committed rMSKSb95678dedba4: Serve OpenAPI specification (authored by Eevans).
Serve OpenAPI specification
Thu, May 9, 1:42 AM

Tue, May 7

Eevans committed rMSKS51ba6c7211ce: [WIP] Serve OpenAPI specification (authored by Eevans).
[WIP] Serve OpenAPI specification
Tue, May 7, 1:43 PM

Wed, May 1

Eevans added a comment to T222227: Kask support for operations/software/service-checker.

According to the site, the benefits of OpenAPI are...

Wed, May 1, 1:53 AM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans updated the task description for T222227: Kask support for operations/software/service-checker.
Wed, May 1, 1:19 AM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans

Tue, Apr 30

Eevans committed rMSKS87c2e9a45d7d: [WIP] Serve OpenAPI specification (authored by Eevans).
[WIP] Serve OpenAPI specification
Tue, Apr 30, 9:24 PM
Eevans updated the task description for T222227: Kask support for operations/software/service-checker.
Tue, Apr 30, 9:13 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans renamed T222227: Kask support for operations/software/service-checker from Kask: operations/software/service-checker support to Kask support for operations/software/service-checker.
Tue, Apr 30, 9:00 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans triaged T222227: Kask support for operations/software/service-checker as Normal priority.
Tue, Apr 30, 9:00 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans updated the task description for T222227: Kask support for operations/software/service-checker.
Tue, Apr 30, 8:59 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans created T222227: Kask support for operations/software/service-checker.
Tue, Apr 30, 8:48 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans added a comment to T221292: Establish performance of the session storage service.

@Eevans maybe the mystery of the longer requests is just that they're writes instead of reads?

Tue, Apr 30, 8:11 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans added a comment to T221292: Establish performance of the session storage service.

Also, is this task done when we're within the boundaries of T211721 or is the task just to have a tool to do measurements?

Tue, Apr 30, 8:10 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T219883: Draft file format for phester test definitions.
Tue, Apr 30, 7:46 PM · Core Platform Team Kanban (Doing), Core Platform Team (Code Health (TEC13))
Eevans added a comment to T211721: Establish an SLA for session storage.

On a related note, do we want or need an SLA on consistency?

Tue, Apr 30, 7:43 PM · MW-1.33-notes (1.33.0-wmf.24; 2019-04-02), Patch-For-Review, Core Platform Team Backlog (Later), Performance-Team (Radar), TechCom, Services (next), Operations, User-Clarakosi, Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans added a comment to T211721: Establish an SLA for session storage.

[ ... ]

... My understanding is session writes would be visible in all DCs once an HTTP response is sent (at least the old security team wanted that).

Tue, Apr 30, 7:42 PM · MW-1.33-notes (1.33.0-wmf.24; 2019-04-02), Patch-For-Review, Core Platform Team Backlog (Later), Performance-Team (Radar), TechCom, Services (next), Operations, User-Clarakosi, Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans committed rMSKS62a132898024: [WIP] Serve OpenAPI specification (authored by Eevans).
[WIP] Serve OpenAPI specification
Tue, Apr 30, 6:52 PM

Mon, Apr 29

Eevans added a comment to T211721: Establish an SLA for session storage.

@Eevans have we been considering cross-DC writes in the performance testing? Are we comparing apples to apples here?

Cross-DC only occurs for DELETE operations and should be identical to POST, plus whatever inter-DC latency is. I have not included them in performance testing thus far because the focus (thus far) has been on Kask performance (and any fixes/optimizations needed there), and including DELETE would only provide a measurement of Cassandra over the WAN.

Why would there be cross-DC requests to Kask at all? MW should send requests only to Kask in the local DC, and then it's up to Cassandra to propagate the change to the other DCs. Or am I missing something?

Mon, Apr 29, 7:04 PM · MW-1.33-notes (1.33.0-wmf.24; 2019-04-02), Patch-For-Review, Core Platform Team Backlog (Later), Performance-Team (Radar), TechCom, Services (next), Operations, User-Clarakosi, Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans added a comment to T211721: Establish an SLA for session storage.

@Eevans have we been considering cross-DC writes in the performance testing? Are we comparing apples to apples here?

Mon, Apr 29, 6:55 PM · MW-1.33-notes (1.33.0-wmf.24; 2019-04-02), Patch-For-Review, Core Platform Team Backlog (Later), Performance-Team (Radar), TechCom, Services (next), Operations, User-Clarakosi, Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans added a comment to T221292: Establish performance of the session storage service.

@Eevans should we break out a separate task for identifying the cause of the extra 40-50ms delay?

Mon, Apr 29, 6:45 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans

Thu, Apr 25

Eevans moved T209108: Monitoring and data collection for session storage service from Backlog to In-Progress on the User-Eevans board.
Thu, Apr 25, 8:17 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans added a comment to T220246: Session storage service Cassandra schema.

In this scenario, our service "foo" is already accessing table "foo.meta" and we're currently adding a column to the table. The process of altering the schema and upgrading the application need to be able to be performed asynchronously. because neither schema changes nor application deployments are atomic. Let's assume we do what MediaWiki does, that is make the code deployable with or without the new schema, and protecting the use of the new features behind a feature flag. In this scenario:

  1. Code (and the proposed alter) are written, deployed to production
  2. This is just a schema change, so the cql command for the schema change can be issued whenever we want - even as a final step of deployment - directly by the deployer.
  3. The feature flag gets flipped in a subsequent deployment when it's assured the schema change has happened everywhere.
Thu, Apr 25, 4:47 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans added a comment to T220401: Introduce kask session storage service to kubernetes.

@Eevans @Clarakosi chart has been merged and is published. The only thing missing before we can move on to the deployment is the swagger/openapi spec so that service-checker[1] can run and monitor this service.

[1] https://github.com/wikimedia/operations-software-service-checker

Thu, Apr 25, 4:16 PM · Patch-For-Review, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), Services (next), User-Eevans, Release Pipeline, Operations, serviceops, Release-Engineering-Team
Eevans moved T209106: Setup session storage service testing/continuous integration from Backlog to Next on the User-Eevans board.
Thu, Apr 25, 3:50 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans moved T209110: Logging for the session storage service from Backlog to In-Progress on the User-Eevans board.
Thu, Apr 25, 3:50 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans moved T217650: Deployment strategy for the session storage application. from Backlog to In-Progress on the User-Eevans board.
Thu, Apr 25, 3:50 PM · Patch-For-Review, Kubernetes, serviceops, Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans moved T219831: Security Review For Kask from Backlog to In-Progress on the User-Eevans board.
Thu, Apr 25, 3:48 PM · Security-Team-Review-Active, Services (watching), Core Platform Team Backlog (Watching / External), Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, User-Eevans
Eevans moved T220401: Introduce kask session storage service to kubernetes from Backlog to In-Progress on the User-Eevans board.
Thu, Apr 25, 3:48 PM · Patch-For-Review, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), Services (next), User-Eevans, Release Pipeline, Operations, serviceops, Release-Engineering-Team
Eevans moved T220246: Session storage service Cassandra schema from Backlog to In-Progress on the User-Eevans board.
Thu, Apr 25, 3:48 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans moved T211721: Establish an SLA for session storage from In-Progress to Backlog on the User-Eevans board.
Thu, Apr 25, 3:48 PM · MW-1.33-notes (1.33.0-wmf.24; 2019-04-02), Patch-For-Review, Core Platform Team Backlog (Later), Performance-Team (Radar), TechCom, Services (next), Operations, User-Clarakosi, Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans moved T221292: Establish performance of the session storage service from Backlog to In-Progress on the User-Eevans board.
Thu, Apr 25, 3:48 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans closed T215883: Session storage Cassandra cluster configuration as Resolved.

Considering this has since been scoped as being just the Cassandra cluster, I believe we can call it complete.

Thu, Apr 25, 3:48 PM · Core Platform Team Kanban (Doing), Services (doing), User-Eevans, Patch-For-Review, User-jijiki, Operations, serviceops, Core Platform Team (Session Management Service (CDP2))
Eevans closed T215883: Session storage Cassandra cluster configuration, a subtask of T206016: Create a service for session storage, as Resolved.
Thu, Apr 25, 3:48 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans

Apr 24 2019

Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 10:14 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 10:10 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 9:59 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 9:15 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated subscribers of T219831: Security Review For Kask.

@Eevans @Clarakosi This one is a bit out of our wheelhouse and something we can provide only a cursory review of. I'd like to propose the following: The Security team can perform a basic security review of this but I would recommend a secondary review by our 3rd party partners at BishopFox. That said, the 2nd review would incur some cost but I'm not sure how much. Do you have any budget available for something like that??

Apr 24 2019, 9:14 PM · Security-Team-Review-Active, Services (watching), Core Platform Team Backlog (Watching / External), Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, User-Eevans
Eevans updated the title for P8434 multi-request-json.lua from Masterwork From Distant Lands to multi-request-json.lua.
Apr 24 2019, 8:56 PM
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 8:52 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 8:35 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the language for P8434 multi-request-json.lua from autodetect to lua.
Apr 24 2019, 8:29 PM
Eevans edited P8434 multi-request-json.lua.
Apr 24 2019, 8:29 PM
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 8:27 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 4:47 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 3:51 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 24 2019, 3:48 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans closed T221530: Drop old mobile-sections keyspaces as Resolved.

Production environment {{done}}

Apr 24 2019, 1:07 AM · Core Platform Team Kanban (Done with CPT), Services (done), Cassandra, RESTBase-Cassandra, Core Platform Team (RESTBase Split (CDP2)), RESTBase
Eevans closed T221530: Drop old mobile-sections keyspaces, a subtask of T215960: Simplify MCS storage model, as Resolved.
Apr 24 2019, 1:07 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase

Apr 23 2019

Eevans claimed T221530: Drop old mobile-sections keyspaces.

Dev environment {{done}}

Apr 23 2019, 8:14 PM · Core Platform Team Kanban (Done with CPT), Services (done), Cassandra, RESTBase-Cassandra, Core Platform Team (RESTBase Split (CDP2)), RESTBase
Eevans added a comment to T221530: Drop old mobile-sections keyspaces.

I cannot speak to the keyspaces being dropped, but the statements LGTM!

Apr 23 2019, 8:10 PM · Core Platform Team Kanban (Done with CPT), Services (done), Cassandra, RESTBase-Cassandra, Core Platform Team (RESTBase Split (CDP2)), RESTBase
Eevans claimed T221528: Create new Parsoid tables.

Done.

Apr 23 2019, 3:55 PM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase-Cassandra, Cassandra, Core Platform Team (RESTBase Split (CDP2)), RESTBase
Eevans added a comment to T221528: Create new Parsoid tables.

Here are the creation statements for dev and production:

[ ... ]

Please review.

Apr 23 2019, 3:06 PM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase-Cassandra, Cassandra, Core Platform Team (RESTBase Split (CDP2)), RESTBase

Apr 18 2019

Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 18 2019, 7:53 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans added a comment to T221292: Establish performance of the session storage service.

Details on test methodology, and some initial results are forthcoming, but to elaborate on comments made elsewhere:

Apr 18 2019, 4:36 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans

Apr 17 2019

Eevans updated the task description for T221292: Establish performance of the session storage service.
Apr 17 2019, 8:59 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans renamed T209099: Establish baseline performance of Python/WSGI frameworks from Establish baseline performance of the session storage service to Establish baseline performance of Python/WSGI frameworks.
Apr 17 2019, 8:58 PM · User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Eevans closed T209099: Establish baseline performance of Python/WSGI frameworks, a subtask of T206016: Create a service for session storage, as Resolved.
Apr 17 2019, 8:58 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans triaged T221292: Establish performance of the session storage service as Normal priority.
Apr 17 2019, 8:54 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans created T221292: Establish performance of the session storage service.
Apr 17 2019, 8:54 PM · Core Platform Team (Multi-DC (TEC1)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans

Apr 16 2019

Eevans updated subscribers of T220246: Session storage service Cassandra schema.
Apr 16 2019, 4:42 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans triaged T220246: Session storage service Cassandra schema as Normal priority.
Apr 16 2019, 4:39 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T220246: Session storage service Cassandra schema.
Apr 16 2019, 4:39 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T220246: Session storage service Cassandra schema.
Apr 16 2019, 4:36 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T220246: Session storage service Cassandra schema.
Apr 16 2019, 4:25 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans closed T221031: Create new mobile storage tables as Resolved.

Applied to the dev cluster; Done

Apr 16 2019, 12:53 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase
Eevans closed T221031: Create new mobile storage tables, a subtask of T215960: Simplify MCS storage model, as Resolved.
Apr 16 2019, 12:53 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase
Eevans added a comment to T221031: Create new mobile storage tables.

This has been applied to the production cluster

Apr 16 2019, 12:49 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase

Apr 15 2019

Eevans updated the task description for T220246: Session storage service Cassandra schema.
Apr 15 2019, 9:34 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans added a comment to T221031: Create new mobile storage tables.

LGTM!

Let's first execute in deployment-prep and follow into production after we merge/deploy https://github.com/wikimedia/restbase/pull/1117 in beta to verify all good and correct?

Apr 15 2019, 9:10 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase
Eevans added a comment to T221031: Create new mobile storage tables.

Deployment-prep:

Apr 15 2019, 8:39 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase
Eevans updated the language for P8401 Masterwork From Distant Lands from autodetect to yaml.
Apr 15 2019, 8:38 PM
Eevans edited P8401 Masterwork From Distant Lands.
Apr 15 2019, 8:38 PM
Eevans added a comment to T221031: Create new mobile storage tables.

Production/staging DDL here

Apr 15 2019, 8:36 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase
Eevans updated the language for P8400 Masterwork From Distant Lands from autodetect to yaml.
Apr 15 2019, 8:34 PM
Eevans edited P8400 Masterwork From Distant Lands.
Apr 15 2019, 8:34 PM
Eevans updated the task description for T220246: Session storage service Cassandra schema.
Apr 15 2019, 7:34 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans
Eevans updated the task description for T220246: Session storage service Cassandra schema.
Apr 15 2019, 7:14 PM · Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, Core Platform Team Backlog (Next), User-Eevans

Apr 12 2019

Eevans added a comment to T215533: Enable use of session storage service in MediaWiki.

I have, on my local development wiki, a working KaskBagOStuff (naming suggestions welcome) that communicates with the development instance at deployment-sessionstore01.deployment-prep.eqiad.wmflabs (via some tricky port forwarding) and successfully allows basic session management for happy login and logout.

Out of curiosity, what is it that prevents you from using RESTBagOStuff?

RESTBagOStuff is hard-coded to use PUT, while the API uses POST. Also, RESTBagOStuff is hard-coded to use PHP serialization for the value data, which I'm guessing nobody is in favor of. (Well, Joe wanted "json storing base64-encoded serialized php"... <grin>)

I rearranged things a bit so that RESTBagOStuff and KaskBagOStuff share almost all their code, except overrides for the essential differences, so there's not really going to be a lot of new code for this, mostly just some shuffling.

Apr 12 2019, 3:48 PM · MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans