Page MenuHomePhabricator

Gehel (Guillaume Lederrey)
Operations Engineer - Discovery

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Nov 9 2015, 9:18 PM (205 w, 1 d)
Availability
Available
IRC Nick
gehel
LDAP User
Gehel
MediaWiki User
GLederrey (WMF) [ Global Accounts ]

Recent Activity

Yesterday

Gehel added a project to T235406: maps1002: Failed power supply: Discovery-Search (Current work).
Mon, Oct 14, 7:54 AM · Discovery-Search (Current work), Operations, ops-eqiad

Wed, Oct 2

Gehel updated the task description for T234045: decommission elastic1017.
Wed, Oct 2, 10:21 AM · Operations, DC-Ops, decommission
Gehel updated subscribers of T234045: decommission elastic1017.

After discussion with @Volans, I ran the decom script. Host is now properly removed from icinga and puppetdb.

Wed, Oct 2, 10:20 AM · Operations, DC-Ops, decommission
Gehel added a comment to T234045: decommission elastic1017.

Host is shutdown and has networking issues. As such the role(system::spare) was not applied and it is still in puppetdb. Since that cleanup step is part of the "uninterruptible" steps, it has not been performed yet.

Wed, Oct 2, 10:05 AM · Operations, DC-Ops, decommission
Gehel reassigned T234045: decommission elastic1017 from Gehel to RobH.
Wed, Oct 2, 9:54 AM · Operations, DC-Ops, decommission

Tue, Oct 1

Gehel moved T232297: Create puppet configs for SDC query from Backlog to In progress on the Discovery-Wikidata-Query-Service-Sprint board.
Tue, Oct 1, 5:42 PM · Discovery-Wikidata-Query-Service-Sprint, Patch-For-Review, Structured-Data-Backlog, Structured Data Engineering, Operations, Discovery-Search (Current work), SDC General, Wikidata
Gehel moved T225125: Migrate Elasticsearch from deprecated Gelf logstash input to rsyslog Kafka logging pipeline from Blocked to Waiting on the Discovery-Search (Current work) board.
Tue, Oct 1, 5:34 PM · Patch-For-Review, Discovery-Search (Current work), observability, Elasticsearch, Operations, Wikimedia-Logstash
Gehel closed T190130: HighlightBuilder: Introduce a way to control the highlighting behaviors, a subtask of T185108: EPIC: Refactor query parsing logic, as Resolved.
Tue, Oct 1, 5:31 PM · Discovery-Search, Epic, Discovery, CirrusSearch
Gehel closed T190130: HighlightBuilder: Introduce a way to control the highlighting behaviors, a subtask of T187548: [Bug] subpageof should indicate in the search results page that it matched against a redirect, as Resolved.
Tue, Oct 1, 5:31 PM · MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), Discovery-Search (Current work), Discovery, CirrusSearch
Gehel closed T190130: HighlightBuilder: Introduce a way to control the highlighting behaviors as Resolved.
Tue, Oct 1, 5:31 PM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Discovery-Search (Current work), Discovery, CirrusSearch
Gehel added a comment to T230588: Wikidata Query Service is swapping items and properties.

It seems unlikely that T174504 will be resolved soon-ish. Doing a full data reload isn't all that expansive, we can do another one once T174504 is fixed.

Tue, Oct 1, 8:37 AM · Patch-For-Review, Wikidata, Wikidata-Query-Service
Gehel added a comment to T232006: LDF service does not Vary responses by Accept, sending incorrect cached responses to clients.

The MIME types used are:

Tue, Oct 1, 8:05 AM · Patch-For-Review, Operations, Traffic, Wikidata, Wikidata-Query-Service

Mon, Sep 30

Gehel updated subscribers of T230588: Wikidata Query Service is swapping items and properties.

See T232212#5472285 / Wikitech for update instructions (needs to be done by someone with WDQS production access, which I don’t have as far as I’m aware).

Mon, Sep 30, 3:57 PM · Patch-For-Review, Wikidata, Wikidata-Query-Service
Gehel added a comment to T228497: Review sizing of maps cluster.

Hi @Gehel any news on this?

Mon, Sep 30, 3:50 PM · Wikimedia-Incident, Operations, Maps

Mon, Sep 23

Gehel updated subscribers of T230518: elastic1017 lost network after reboot.

Steps for decommission of elastic1017:

Mon, Sep 23, 1:07 PM · decommission, ops-eqiad, DC-Ops, Operations, Discovery-Search (Current work)

Thu, Sep 19

Gehel closed T232612: WikibaseCirrusSearch emits cirrussearch-too-busy-error errors as Resolved.
Thu, Sep 19, 7:44 PM · Discovery-Search, Elasticsearch, Wikidata, Wikimedia-production-error
Gehel added a comment to T232612: WikibaseCirrusSearch emits cirrussearch-too-busy-error errors.

The errors themselves are expected behaviour. Subtasks have been created to track improvements we can do.

Thu, Sep 19, 7:44 PM · Discovery-Search, Elasticsearch, Wikidata, Wikimedia-production-error
Gehel moved T232612: WikibaseCirrusSearch emits cirrussearch-too-busy-error errors from needs triage to elastic / cirrus on the Discovery-Search board.
Thu, Sep 19, 7:44 PM · Discovery-Search, Elasticsearch, Wikidata, Wikimedia-production-error
Gehel moved T233351: Increase poolcounter for wikibase prefix search from needs triage to elastic / cirrus on the Discovery-Search board.
Thu, Sep 19, 7:43 PM · Discovery-Search, Elasticsearch
Gehel moved T233352: Better error handling for pool counter errors on cirrus search from needs triage to elastic / cirrus on the Discovery-Search board.
Thu, Sep 19, 7:43 PM · Discovery-Search, Elasticsearch
Gehel created T233352: Better error handling for pool counter errors on cirrus search.
Thu, Sep 19, 7:43 PM · Discovery-Search, Elasticsearch
Gehel created T233351: Increase poolcounter for wikibase prefix search.
Thu, Sep 19, 7:42 PM · Discovery-Search, Elasticsearch
Gehel moved T232874: The "PrefixSearchBackend" hook is listed in documentation as deprecated but doesn't emit deprecation warnings yet from needs triage to elastic / cirrus on the Discovery-Search board.
Thu, Sep 19, 7:37 PM · Discovery-Search, Documentation, MediaWiki-General, Technical-Debt
Gehel moved T232947: Redirect to item when one item is found in Wikidata search from needs triage to later on... on the Discovery-Search board.
Thu, Sep 19, 7:36 PM · CirrusSearch, Wikidata, Discovery-Search
Gehel moved T233317: Syntax error when searching for ' on a postgres backed in MediaWiki from needs triage to later on... on the Discovery-Search board.
Thu, Sep 19, 7:34 PM · PostgreSQL, MediaWiki-Search, Discovery-Search

Wed, Sep 18

Gehel added a comment to T228606: Degraded RAID on elastic1046.

Tried again, seems that sda has issues (see log below). Is it that the second disk also failed? Or that the wrong disk was replaced? Or something else?

Wed, Sep 18, 12:02 PM · Discovery-Search (Current work), ops-eqiad, Operations

Sep 12 2019

Gehel added a project to T232743: JavaScript parts of query service UI not working on Commons Query Service (Beta): Wikidata-Query-Service.

It's probably good to keep that task, but the current deployment on beta is really a hacked together proof of concept, and we do expect a lot of things to go wrong. We need to do a lot of cleanup (T232297) first.

Sep 12 2019, 1:40 PM · Wikidata-Query-Service, SDC General, Wikidata
Gehel added a project to T232297: Create puppet configs for SDC query: Discovery-Wikidata-Query-Service-Sprint.
Sep 12 2019, 1:40 PM · Discovery-Wikidata-Query-Service-Sprint, Patch-For-Review, Structured-Data-Backlog, Structured Data Engineering, Operations, Discovery-Search (Current work), SDC General, Wikidata
Gehel added a comment to T230856: RDF dump performance for SDC.

Note that T222497 needs to be resolved before we can actually have a working dump.

Sep 12 2019, 1:35 PM · Structured-Data-Backlog (Current Work), Dumps-Generation, WikibaseMediaInfo, Wikidata-Query-Service, SDC General, Commons, Wikidata
Gehel added a parent task for T222497: dumpRDF for MediaInfo entities loads each page individually: T230856: RDF dump performance for SDC.
Sep 12 2019, 1:35 PM · Structured-Data-Backlog (Current Work), Core Platform Team, MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Dumps-Generation, User-Smalyshev, WikibaseMediaInfo, Wikidata-Query-Service, SDC General, Commons, Wikidata
Gehel added a subtask for T230856: RDF dump performance for SDC: T222497: dumpRDF for MediaInfo entities loads each page individually.
Sep 12 2019, 1:35 PM · Structured-Data-Backlog (Current Work), Dumps-Generation, WikibaseMediaInfo, Wikidata-Query-Service, SDC General, Commons, Wikidata
Gehel closed T232739: Requesting access to wmcs beta cluster for igorkim78 as Resolved.

As discussed on IRC, I can vouch for @Igorkim78, he is a contractor with us and already has access to the wikidata-query project on WMCS. I've granted access to deplyoment-prep.

Sep 12 2019, 1:15 PM · Beta-Cluster-Infrastructure, Release-Engineering-Team
Gehel updated the task description for T232739: Requesting access to wmcs beta cluster for igorkim78.
Sep 12 2019, 1:13 PM · Beta-Cluster-Infrastructure, Release-Engineering-Team

Sep 5 2019

Gehel moved T231764: intitle search is incorrect and/or missing redirecttitle. from needs triage to elastic / cirrus on the Discovery-Search board.
Sep 5 2019, 5:16 PM · CirrusSearch, Discovery-Search
Gehel moved T231446: Reindex commonswiki as shards have grown beyond critical threshold from needs triage to Ops / SRE on the Discovery-Search board.
Sep 5 2019, 5:14 PM · Discovery-Search, Patch-For-Review, Operations, Elasticsearch

Sep 4 2019

Gehel added a comment to T231964: Empty Kartotherian maps because of password authentication failure.

password reset completed. The password configuration is duplicated for master / slaves and was not updated for slaves. This should be back to normal. @MSantos : can you confirm and close if all looks good?

Sep 4 2019, 12:50 PM · Maps (Kartotherian)

Sep 3 2019

Gehel edited projects for T231446: Reindex commonswiki as shards have grown beyond critical threshold, added: Discovery-Search; removed Discovery-Search (Current work).
Sep 3 2019, 5:21 PM · Discovery-Search, Patch-For-Review, Operations, Elasticsearch
Gehel added a comment to T231691: Lake Huron missing due to apparent OSM vandalism.

We really need a way to trigger a refresh without creating a new issue. I can do so if that is necessary, but it should not be.

Sep 3 2019, 12:55 PM · Product-Infrastructure-Team-Backlog, Operations, Maps

Sep 1 2019

Gehel added a comment to T231691: Lake Huron missing due to apparent OSM vandalism.

As far as I can tell, the issue is now resolved.

Sep 1 2019, 7:58 AM · Product-Infrastructure-Team-Backlog, Operations, Maps

Aug 30 2019

Gehel added a comment to T231691: Lake Huron missing due to apparent OSM vandalism.

OSM replication was triggered manually and tile generation started for that area (follow the generation on grafana). If that's enough, we'll just need to invalidate cache for that area, or wait 24h for cache invalidation. If that did not fix the issue, we'll need more investigation. Either we have corrupted data in some way (on both eqiad and codfw, seems unlikely) or we have a style issue.

Aug 30 2019, 10:14 PM · Product-Infrastructure-Team-Backlog, Operations, Maps

Aug 29 2019

Gehel moved T230774: Run jstack / jmap / etc... with PrivateTmp=true from in progress to Done on the Discovery-Search (Current work) board.
Aug 29 2019, 8:06 AM · Discovery-Search (Current work), Operations

Aug 27 2019

Gehel assigned T228503: vagrant wikibase cirrus role not working / should set $wgWBCSUseCirrus = true; to enable to dcausse.
Aug 27 2019, 5:29 PM · Patch-For-Review, Discovery-Search (Current work), MediaWiki-Vagrant, Discovery, Wikidata
Gehel moved T230366: Icinga reports read time out error for some checks on cloudelastic cluster from in progress to Done on the Discovery-Search (Current work) board.
Aug 27 2019, 5:26 PM · Operations, Discovery-Search (Current work), Elasticsearch
Gehel reassigned T230774: Run jstack / jmap / etc... with PrivateTmp=true from Gehel to Mathew.onipe.

Needs to be documented on https://phabricator.wikimedia.org/project/view/1227/

Aug 27 2019, 5:26 PM · Discovery-Search (Current work), Operations
Gehel closed T229807: cookbook sre.elasticsearch.rolling-restart failed with cluster relforge as Resolved.
Aug 27 2019, 5:20 PM · Discovery-Search (Current work), Operations, SRE-tools, Elasticsearch
Gehel claimed T229807: cookbook sre.elasticsearch.rolling-restart failed with cluster relforge.
Aug 27 2019, 5:19 PM · Discovery-Search (Current work), Operations, SRE-tools, Elasticsearch
Gehel reassigned T228606: Degraded RAID on elastic1046 from Gehel to Cmjohnson.
Aug 27 2019, 12:56 PM · Discovery-Search (Current work), ops-eqiad, Operations
Gehel added a comment to T228606: Degraded RAID on elastic1046.

@Cmjohnson: it looks like the installer only sees a single disk, and thus can't partition. Could you check? Thanks!

Aug 27 2019, 12:56 PM · Discovery-Search (Current work), ops-eqiad, Operations
Gehel added a project to T228606: Degraded RAID on elastic1046: Discovery-Search (Current work).
Aug 27 2019, 12:19 PM · Discovery-Search (Current work), ops-eqiad, Operations

Aug 23 2019

Gehel claimed T228606: Degraded RAID on elastic1046.

@Cmjohnson thanks! I'll take it over and reimage

Aug 23 2019, 3:38 PM · Discovery-Search (Current work), ops-eqiad, Operations

Aug 22 2019

Gehel moved T230495: Partition CirrusSearch mediawiki jobs by cluster from needs triage to elastic / cirrus on the Discovery-Search board.
Aug 22 2019, 5:11 PM · Core Platform Team Workboards (Clinic Duty Team), Discovery-Search, Cloud-Services, Elasticsearch, Discovery
Gehel removed projects from T200703: Special:RandomInCategory does not return all pages with equal probability: CirrusSearch, Discovery-Search.
Aug 22 2019, 5:10 PM · Core Platform Team Workboards (Clinic Duty Team), Wikimedia-Rdbms, Patch-For-Review, MediaWiki-Categories
Gehel merged T230717: "Sort by creation date" query on English Wiktionary shows "An error has occurred while searching: Query was not understood." into T230990: create_timestamp not present on production index mappings for some wikis.
Aug 22 2019, 5:08 PM · Discovery-Search (Current work), CirrusSearch
Gehel merged task T230717: "Sort by creation date" query on English Wiktionary shows "An error has occurred while searching: Query was not understood." into T230990: create_timestamp not present on production index mappings for some wikis.
Aug 22 2019, 5:08 PM · TCB-Team, Advanced-Search, CirrusSearch, Discovery-Search
Gehel moved T230728: Deferred update AutoCommitUpdate_LinksUpdate::doUpdate failed: Could not enqueue jobs: Unable to serialize events (CirrusSearch LinksUpdate) from needs triage to elastic / cirrus on the Discovery-Search board.
Aug 22 2019, 5:05 PM · MW-1.35-notes (1.35.0-wmf.1; 2019-10-08), Discovery-Search (Current work), CirrusSearch
Gehel moved T230730: Better way to pause writes on elasticsearch from needs triage to elastic / cirrus on the Discovery-Search board.
Aug 22 2019, 5:05 PM · ChangeProp, Core Platform Team Workboards (Clinic Duty Team), Services (designing), Analytics, Event-Platform, WMF-JobQueue, Discovery-Search
Gehel added a comment to T230730: Better way to pause writes on elasticsearch.

There already is a mechanism in change propagation to back off and wait / retry later.

Aug 22 2019, 5:04 PM · ChangeProp, Core Platform Team Workboards (Clinic Duty Team), Services (designing), Analytics, Event-Platform, WMF-JobQueue, Discovery-Search
Gehel moved T230990: create_timestamp not present on production index mappings for some wikis from needs triage to Current work on the Discovery-Search board.
Aug 22 2019, 4:58 PM · Discovery-Search (Current work), CirrusSearch
Gehel moved T231010: Change partitioning scheme for elasticsearch from RAID to JBOD from needs triage to Ops / SRE on the Discovery-Search board.
Aug 22 2019, 4:55 PM · Operations, Discovery-Search, Elasticsearch

Aug 20 2019

Gehel created P8945 (An Untitled Masterwork).
Aug 20 2019, 5:55 PM
Gehel claimed T230774: Run jstack / jmap / etc... with PrivateTmp=true.
Aug 20 2019, 5:27 PM · Discovery-Search (Current work), Operations
dcausse awarded T230774: Run jstack / jmap / etc... with PrivateTmp=true a Love token.
Aug 20 2019, 9:00 AM · Discovery-Search (Current work), Operations
Gehel added a comment to T230774: Run jstack / jmap / etc... with PrivateTmp=true.

Nice! I did not know that one.

Aug 20 2019, 8:59 AM · Discovery-Search (Current work), Operations
Gehel created T230774: Run jstack / jmap / etc... with PrivateTmp=true.
Aug 20 2019, 8:27 AM · Discovery-Search (Current work), Operations

Aug 19 2019

Gehel updated the task description for T227538: b2-eqiad pdu refresh (Tuesday 10/29 @11am UTC).
Aug 19 2019, 4:18 PM · DC-Ops, Operations, ops-eqiad
Gehel updated the task description for T227142: a6-eqiad pdu refresh (Tuesday 10/22 @11am UTC).
Aug 19 2019, 4:17 PM · Patch-For-Review, DC-Ops, Operations, ops-eqiad
Gehel updated the task description for T227536: b1-eqiad pdu refresh (Thursday 10/10 @11am UTC).
Aug 19 2019, 4:15 PM · DC-Ops, Operations, ops-eqiad
Gehel updated the task description for T227138: a2-eqiad pdu refresh (Tuesday 10/8 @11am UTC).
Aug 19 2019, 4:15 PM · DC-Ops, Operations, ops-eqiad
Gehel updated the task description for T227539: b3-eqiad pdu refresh (Tuesday 9/17 @11am UTC).
Aug 19 2019, 4:13 PM · DC-Ops, Operations, ops-eqiad
Gehel updated the task description for T226782: a1-eqiad pdu refresh (Tuesday 10/15 @11am UTC).
Aug 19 2019, 4:12 PM · DC-Ops, Operations, ops-eqiad
Gehel updated the task description for T227541: b6-eqiad pdu refresh (Tuesday 9/10 @11am UTC).
Aug 19 2019, 4:11 PM · DC-Ops, Operations, ops-eqiad
Gehel created T230730: Better way to pause writes on elasticsearch.
Aug 19 2019, 3:42 PM · ChangeProp, Core Platform Team Workboards (Clinic Duty Team), Services (designing), Analytics, Event-Platform, WMF-JobQueue, Discovery-Search

Aug 15 2019

Gehel updated the task description for T225713: CPU scaling governor audit.
Aug 15 2019, 7:30 PM · cloud-services-team (Kanban), Cloud-VPS, User-fgiunchedi, Operations
Gehel closed T230518: elastic1017 lost network after reboot as Resolved.

@Cmjohnson don't spend more time on it, it is scheduled for replacement and the replacement should arrive August 21. We can live without this server for 2 weeks.

Aug 15 2019, 5:46 PM · decommission, ops-eqiad, DC-Ops, Operations, Discovery-Search (Current work)
Gehel closed T230409: Spicerack: extend elasticsearch_cluster module by allowing us to wait for write queue to go empty as Resolved.

done already

Aug 15 2019, 5:12 PM · Discovery-Search, Elasticsearch
Gehel updated the task description for T225713: CPU scaling governor audit.
Aug 15 2019, 2:18 PM · cloud-services-team (Kanban), Cloud-VPS, User-fgiunchedi, Operations

Aug 14 2019

Gehel created T230518: elastic1017 lost network after reboot.
Aug 14 2019, 10:19 PM · decommission, ops-eqiad, DC-Ops, Operations, Discovery-Search (Current work)
Gehel added a comment to T230410: wdqs updater processing events but not finding anything useful.

Another point: while WDQS does fetch data from both clusters (at least is supposed to), it only tracks its timestamp by one topic: reportingTopic, which is currently eqiad.mediawiki.revision-create. Otherwise we get weird jumps in the timestamps, since different topics can get different events in different sequence. So if eqiad does not get any events, the updater seems to lag even though it is processing events from codfw. I am not sure whether "nothing useful" message is related anyhow.

Aug 14 2019, 1:15 PM · Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Wikidata, Wikidata-Query-Service
Gehel created T230472: Search index not updated for nl.wikipedia.org.
Aug 14 2019, 11:11 AM · Discovery-Search (Current work)

Aug 13 2019

Gehel added a comment to T230410: wdqs updater processing events but not finding anything useful.

eventgate eqiad was depooled from 10:30UTC to 12:20 UTC, which matches the time where no updates were applied.

Aug 13 2019, 2:50 PM · Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Wikidata, Wikidata-Query-Service
Gehel created T230410: wdqs updater processing events but not finding anything useful.
Aug 13 2019, 11:40 AM · Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Wikidata, Wikidata-Query-Service

Aug 12 2019

Gehel added a comment to T225713: CPU scaling governor audit.

elastic[1032-1052].eqiad.wmnet,elastic[2025-2036].codfw.wmnet have been configured with set /system1/oemhp_power1 oemhp_powerreg=os. This will take effect after next rolling restart.

Aug 12 2019, 1:15 PM · cloud-services-team (Kanban), Cloud-VPS, User-fgiunchedi, Operations

Aug 8 2019

Gehel added a comment to T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888.

A few more comments after discussion with @elukey :

Aug 8 2019, 10:07 AM · Patch-For-Review, Traffic, Wikidata-Query-Service, Operations, WMDE-Analytics-Engineering, User-Addshore, Wikidata, Discovery

Aug 6 2019

Gehel added a comment to T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888.

At the moment, we have a ferm rule to allow access to port 8888 from $DOMAIN_NETWORKS. I think this should be sufficient, but I'm always somewhat lost in our network.

Aug 6 2019, 11:59 AM · Patch-For-Review, Traffic, Wikidata-Query-Service, Operations, WMDE-Analytics-Engineering, User-Addshore, Wikidata, Discovery

Aug 5 2019

Gehel created T229876: blazegraph journal on wdqs1005 has doubled in space.
Aug 5 2019, 7:50 PM · Operations, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Gehel added a comment to T229453: elastic1031 - PSU status critical.

If it's actually a bad PSU, I think we can leave it, since it's due to be refreshed via T221636.

Aug 5 2019, 3:26 PM · ops-eqiad, Discovery-Search (Current work), Operations
Kozuch awarded T158657: Kartotherian error: GroupId not available a Like token.
Aug 5 2019, 12:14 PM · Patch-For-Review, patch-welcome, Product-Infrastructure-Team-Backlog, Maps (Kartotherian)
Gehel created T229788: postgresql replication issues on maps1001.
Aug 5 2019, 9:17 AM · Maps, Operations

Jul 19 2019

Gehel updated the task description for T228122: DB reload for WDQS.
Jul 19 2019, 4:21 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Gehel added a comment to T221632: Storage capacity upgrade for WDQS.

Rough back of the enveloppe calculation of the cost of staying on RAID1 is on T227755#5349525. Since it contains pricing, I'm keeping this on the procurement task that is private.

Jul 19 2019, 2:35 PM · Wikidata, Wikidata-Query-Service, Discovery-Search
Gehel added a comment to T221632: Storage capacity upgrade for WDQS.

I've just updated the task description to make it clear that even if we move storage to RAID0, we'll keep the OS on RAID1 (same scheme used by elasticsearch servers).

Jul 19 2019, 1:44 PM · Wikidata, Wikidata-Query-Service, Discovery-Search
Gehel updated the task description for T221632: Storage capacity upgrade for WDQS.
Jul 19 2019, 1:44 PM · Wikidata, Wikidata-Query-Service, Discovery-Search
Gehel updated the task description for T228122: DB reload for WDQS.
Jul 19 2019, 12:29 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Gehel added a project to T228497: Review sizing of maps cluster: Wikimedia-Incident.
Jul 19 2019, 8:56 AM · Wikimedia-Incident, Operations, Maps
Gehel triaged T228497: Review sizing of maps cluster as High priority.
Jul 19 2019, 8:55 AM · Wikimedia-Incident, Operations, Maps
Gehel created T228497: Review sizing of maps cluster.
Jul 19 2019, 8:55 AM · Wikimedia-Incident, Operations, Maps

Jul 18 2019

Gehel updated the task description for T228122: DB reload for WDQS.
Jul 18 2019, 3:22 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Gehel updated the task description for T228122: DB reload for WDQS.
Jul 18 2019, 2:09 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Gehel updated the task description for T228122: DB reload for WDQS.
Jul 18 2019, 12:49 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Gehel updated the task description for T228122: DB reload for WDQS.
Jul 18 2019, 9:27 AM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata