Page MenuHomePhabricator

Mvolz (Marielle Volz)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Oct 15 2014, 9:50 PM (285 w, 2 d)
Availability
Available
IRC Nick
Mvolz
LDAP User
Mvolz
MediaWiki User
Mvolz (WMF) [ Global Accounts ]

mvolz@wikimedia.org

Recent Activity

Wed, Apr 1

Mvolz moved T248267: GSoC proposal for Support the ‘maps’ parameter in TemplateData Editor (GUI)" from Proposals in Progress to Submitted Proposals on the Google-Summer-of-Code (2020) board.
Wed, Apr 1, 11:33 AM · Google-Summer-of-Code (2020)

Tue, Mar 31

Mvolz added a comment to T163986: Revamp spec.yaml in citoid.

Reopening this -- we had some alerts today from Citoid that turned out to be latency associated with only 404s (graph). We suspect the root cause was elevated latency from example.com.
We should probably remove that last external URL from the spec and replace it with something we host -- even if the uptime still isn't 100%, at least we'll be alerting on our own issues and not on example.com's.
Marielle, can I ask you to take a look?

Tue, Mar 31, 6:06 PM · Patch-For-Review, User-Ryasmeen, Services (watching), User-mobrovac, VisualEditor, Citoid

Mon, Mar 30

Mvolz added a comment to T248267: GSoC proposal for Support the ‘maps’ parameter in TemplateData Editor (GUI)".

I'm not sure what you mean by auto-generate - do you mean suggesting the template parameters to use in the map?

Maps parameter is a way of JSON mapping the template and its parameters and their relationship with another set of parameters from another tool right? So, what I was thinking about is that some parameters can by TemplateData itself instead of leaving it for the user as it will not matter for the users to fill them by themselves. actually, it will make their workflow faster.

This is already done, by another tool. The user doesn't have to fill anything out by themselves already :).

Mon, Mar 30, 12:48 PM · Google-Summer-of-Code (2020)
Mvolz added a comment to T248267: GSoC proposal for Support the ‘maps’ parameter in TemplateData Editor (GUI)".

So, instead of directly storing the data inserted by the user from the GUI editor, we place them in the text editor using JS and it will be saved as usual we the user clicks "Save changes"? won't this make it harder for us to auto-generate things serial numbers, DOIs, ISSNs, etc? anyway if this does not seem achievable or unnecessary using Php, we can still do it with JS.

Mon, Mar 30, 10:13 AM · Google-Summer-of-Code (2020)

Sun, Mar 29

Mvolz added a comment to T248267: GSoC proposal for Support the ‘maps’ parameter in TemplateData Editor (GUI)".

And point two is, I'm not sure how much back-end Php work is needed - I expect this to be possible to do nearly all of it as front end (although I could be wrong about that!) So overall I would say add more time for front end work and break that down more, in the proposal.

Here comes the usage of Php as a back-end that is compatible with HTML, which means it can take the data inserted by the user and parsing it to JSON using a Hook. And also deals with the API(s) used to generate data like serial number, DOI, ISSN –will appear for the user but the input field will not be editable- and push it to the user.
And the way that this should work is when the user interacts with extension to make the parameter of type “map” it runs a Hook that is registered in “TemplateDataHooks.php” to add this data to the JSON.

This part should all be front-end, IMO. There's no reason to contact the back-end for this. It's easier to parse JSON with JavaScript than PHP anyway (and in fact our PHP JSON parser has a long standing bug!)

Sun, Mar 29, 3:02 PM · Google-Summer-of-Code (2020)

Thu, Mar 26

Mvolz lowered the priority of T115224: On URL submission, look up the archived page in the Internet Archive's index and add to the return data from High to Medium.
Thu, Mar 26, 10:07 AM · Internet-Archive, The-Wikipedia-Library, VisualEditor-MediaWiki-References, VisualEditor, Citoid
Mvolz triaged T248571: Update citoid to latest service-template-node as High priority.
Thu, Mar 26, 10:06 AM · Technical-Debt, Citoid
Mvolz created T248571: Update citoid to latest service-template-node.
Thu, Mar 26, 10:06 AM · Technical-Debt, Citoid
Mvolz triaged T247590: Fix citoid so it logs request_id throughout the request (use req.logger, not app.logger) as High priority.
Thu, Mar 26, 10:02 AM · Citoid, Core Platform Team Workboards (Clinic Duty Team)
Mvolz added a comment to T246990: Remember user's last tab preference.

lowering to medium due to covid related switch in priorities.

Thu, Mar 26, 10:02 AM · Citoid, Wikidata
Mvolz lowered the priority of T246990: Remember user's last tab preference from High to Medium.
Thu, Mar 26, 10:01 AM · Citoid, Wikidata

Wed, Mar 25

Mvolz added a comment to T248267: GSoC proposal for Support the ‘maps’ parameter in TemplateData Editor (GUI)".

@Mvolz, @Tchanders, @Mooeypoo - Hello,
I am adham Khatean, an undergraduate student from Egypt pursuing degree in physics, I am interested in participating in "support maps parameter in TemplateData editor (GUI) " as a GSoC student.
That is my proposal for the project, and I was wondering if you have any advice on improving it? Especially on the timeline part? Do you think there is any thing that I miss understood about the idea or the extension TemplateData itself?
Would you any other micro tasks that you think might make me more understanding of the idea or the extension?
Thanks in advance.

Wed, Mar 25, 10:40 AM · Google-Summer-of-Code (2020)
Mvolz added a project to T243882: Switch to new pubmed website: Technical-Debt.
Wed, Mar 25, 9:45 AM · Technical-Debt, Citoid

Sun, Mar 22

Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Sun, Mar 22, 7:05 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData

Fri, Mar 20

Mvolz added a comment to T208305: Support 'maps' parameter in TemplateData Editor (GUI).

Hello, I am interested in participating in the project as part of GSoC. I have installed MediaWiki on my device in addition to some other extensions including the required ones for this project and now trying to work around to really get familiar with the codebase. However, I have a problem importing Template:cite_journal


as one of these two errors always appear:

Fatal error: Maximum execution time of 120 seconds exceeded in C:\xampp\htdocs\mediawiki\extensions\Scribunto\includes\engines\LuaStandalone\LuaStandaloneEngine.php on line 533


OR

Fatal error: Maximum execution time of 120 seconds exceeded in C:\xampp\htdocs\mediawiki\includes\Title.php on line 431


although these pointed lines do not seem to contain anything related to this issue even when I tried to track there parameters and returns.
If you are familiar with this issue it would be very helpful if you could give me a hint about it or what I am doing wrong.
Thanks in advance.

Fri, Mar 20, 3:05 PM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData

Fri, Mar 13

Mvolz added a comment to T247560: Automatic references not working at euwiki.

Oopps! The user is me, so I get the notification. Thanks, I added the templatedata because I wasn't receiving it in the manual section. It may be a cache issue then, because now everything is working perfectly.
Thanks and take care!

Fri, Mar 13, 5:24 PM · User-Ryasmeen, Citoid, VisualEditor
Mvolz added a comment to T247560: Automatic references not working at euwiki.

A user added template data to the main template page, when there was already template data on the "dok" page. This overwrote the template data in the "dok" page, so consequently citoid wasn't fetching the correct configuration file and couldn't use the template at all.

Fri, Mar 13, 5:20 PM · User-Ryasmeen, Citoid, VisualEditor
Mvolz renamed T247590: Fix citoid so it logs request_id throughout the request (use req.logger, not app.logger) from Fix citoid so it logs request_id throughout the request to Fix citoid so it logs request_id throughout the request (use req.logger, not app.logger).
Fri, Mar 13, 9:38 AM · Citoid, Core Platform Team Workboards (Clinic Duty Team)
Mvolz reopened T247590: Fix citoid so it logs request_id throughout the request (use req.logger, not app.logger) as "Open".
Fri, Mar 13, 9:37 AM · Citoid, Core Platform Team Workboards (Clinic Duty Team)
Mvolz renamed T247590: Fix citoid so it logs request_id throughout the request (use req.logger, not app.logger) from Log request_id throughout the request in service-template to Fix citoid so it logs request_id throughout the request.
Fri, Mar 13, 9:36 AM · Citoid, Core Platform Team Workboards (Clinic Duty Team)
Mvolz added a comment to T247590: Fix citoid so it logs request_id throughout the request (use req.logger, not app.logger).

Request id seems to be only logged once here, on receiving the request:

Actually, it's not. As you can see here, the req.logger is a child logger that includes the request_id by default, so the intention is that all the logs made with req.logger will include the request_id field, as well as the 'request' field.
Example - log from mobile apps:

[2020-03-13T08:29:42.777Z]  INFO: mobileapps/391 on scb1002: Page or revision not found. (message="Page or revision not found.", status=404, detail="Page or revision not found.", request_id=1d999c24-091c-4a83-bdf6-87e2852b3e82, levelPath=info/404)
    type: https://mediawiki.org/wiki/HyperSwitch/errors/not_found
    --
    request: {
      "url": "/en.wikipedia.org/v1/page/summary/SHFNGH89M16Z336X",
      "headers": {
        "x-request-id": "1d999c24-091c-4a83-bdf6-87e2852b3e82",
        "content-length": "0"
      },
      "method": "GET",
      "params": {
        "0": "/en.wikipedia.org/v1/page/summary/SHFNGH89M16Z336X"
      },
      "query": {},
      "remoteAddress": "10.64.0.100",
      "remotePort": 34296
    }

The key is to use req.logger and not app.logger in your handlers. I can see that cited doesn't follow this rule - most of the handlers store a logger in the constructor and fetch it from app.logger. Making app.logger include details about the request is impossible - app is a global object and is shared between potentially multiple requests, so if we reassign the app.logger, the logs will all show the request_id of the latest received request, and not necessarily the request that a specific log belongs to.

Fri, Mar 13, 9:35 AM · Citoid, Core Platform Team Workboards (Clinic Duty Team)

Thu, Mar 12

Mvolz added a comment to T214038: Better UI flow for PDFs.

Hey @Mvolz we probably won't work on this feature this year, but feel free to ping me if you think that is a mistake or you'd like to discuss that more.

Thu, Mar 12, 2:31 PM · VisualEditor, Citoid
Mvolz closed T243504: Use log level warn in citoid whenever zotero is unresponsive, a subtask of T243444: Request took down both zotero and citoid (exceeding memory), as Resolved.
Thu, Mar 12, 2:27 PM · Operations, Citoid
Mvolz closed T243504: Use log level warn in citoid whenever zotero is unresponsive as Resolved.
Thu, Mar 12, 2:27 PM · Operations, Citoid
Mvolz added a comment to T243444: Request took down both zotero and citoid (exceeding memory).

I guess we aren't gonna find the source of this specific event. @Mvolz do you feel we are at least better prepared logging wise for the next time this happens?

Thu, Mar 12, 2:27 PM · Operations, Citoid
Mvolz triaged T243504: Use log level warn in citoid whenever zotero is unresponsive as High priority.
Thu, Mar 12, 2:13 PM · Operations, Citoid
Mvolz triaged T243882: Switch to new pubmed website as Medium priority.
Thu, Mar 12, 2:13 PM · Technical-Debt, Citoid
Mvolz triaged T245142: Restructure wikibase format to use "identifiers" and "containers" keys as Medium priority.
Thu, Mar 12, 2:12 PM · Knowledge-Integrity, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Research, Wikidata
Mvolz raised the priority of T219919: Move citoid logging to new logging pipeline from Medium to High.
Thu, Mar 12, 2:12 PM · observability, Citoid, Core Platform Team Legacy (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations

Mar 4 2020

marcella awarded T229654: "convert" button doesn't correctly detect if Citoid is enabled; we shouldn't offer convert button and message if automatic tab also isn't enabled. a Manufacturing Defect? token.
Mar 4 2020, 5:30 PM · User-Ryasmeen, MW-1.35-notes (1.35.0-wmf.22; 2020-03-03), Skipped QA, VisualEditor, Editing-team (Q3 2019-2020 Kanban Board), Citoid

Feb 26 2020

Mvolz committed rDEPLOYCHARTS3238ee76326a: Update Zotero to I5e24a0f18 (authored by Mvolz).
Update Zotero to I5e24a0f18
Feb 26 2020, 5:47 PM
Mvolz committed rDEPLOYCHARTS9ef87cb4f0a1: Update citoid to 79245b40b6 (authored by Mvolz).
Update citoid to 79245b40b6
Feb 26 2020, 3:20 PM

Feb 24 2020

Mvolz added a comment to T245934: cite button auto filling article name in capital letters.

This is not a bug. The VisualEditor "cite" dialog (which has nothing to do with the Cite extension) just calls Citoid, which relies on CrossRef data, which is just what publishers provide. In this case, the publisher has uppercase titles:
https://api.crossref.org/works/10.1097/00007890-197506000-00010
Citoid can and should avoid introducing its own junk, but it's not within its scope to clean up the garbage provided by publishers.

Feb 24 2020, 1:32 PM · Citoid, VisualEditor

Feb 20 2020

Mvolz added a comment to T244953: 5 character limit is too restrictive for structured data on commons for character-based languages.
Feb 20 2020, 4:02 PM · Structured-Data-Backlog, StructuredDataOnCommons

Feb 13 2020

Mvolz updated the task description for T208213: Add wikibase/wikidata export format to citoid service.
Feb 13 2020, 1:51 PM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz updated the task description for T208213: Add wikibase/wikidata export format to citoid service.
Feb 13 2020, 1:30 PM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz added a parent task for T208213: Add wikibase/wikidata export format to citoid service: T235788: Citoid should create or reuse items for sources.
Feb 13 2020, 1:29 PM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz added a subtask for T235788: Citoid should create or reuse items for sources: T208213: Add wikibase/wikidata export format to citoid service.
Feb 13 2020, 1:28 PM · Citoid, Wikidata
Mvolz updated the task description for T235788: Citoid should create or reuse items for sources.
Feb 13 2020, 1:28 PM · Citoid, Wikidata
Mvolz added a subtask for T199197: [2.11] Integrate Citoid in Wikidata: T235788: Citoid should create or reuse items for sources.
Feb 13 2020, 1:26 PM · Research, Knowledge-Integrity, Patch-For-Review, Citoid, WMF-Legal, Wikidata, Epic
Mvolz added a parent task for T235788: Citoid should create or reuse items for sources: T199197: [2.11] Integrate Citoid in Wikidata.
Feb 13 2020, 1:26 PM · Citoid, Wikidata
Mvolz updated the task description for T208213: Add wikibase/wikidata export format to citoid service.
Feb 13 2020, 12:50 PM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz updated the task description for T208213: Add wikibase/wikidata export format to citoid service.
Feb 13 2020, 12:49 PM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz updated the task description for T208213: Add wikibase/wikidata export format to citoid service.
Feb 13 2020, 12:49 PM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz updated the task description for T208213: Add wikibase/wikidata export format to citoid service.
Feb 13 2020, 12:44 PM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz created T245142: Restructure wikibase format to use "identifiers" and "containers" keys.
Feb 13 2020, 12:13 PM · Knowledge-Integrity, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Research, Wikidata
Mvolz added a comment to T208213: Add wikibase/wikidata export format to citoid service.

Are all aspects of this task now resolved? If not, what's outstanding?

Feb 13 2020, 11:59 AM · Research, Knowledge-Integrity, Patch-For-Review, Core Platform Team Legacy (Watching / External), Services (watching), Citoid, Wikidata, Epic
Mvolz closed T230057: Citoid: Generate ISBNs with hyphens, a subtask of T196353: Add citoid support for WikiBase to the Citoid extension, as Resolved.
Feb 13 2020, 11:55 AM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Wikidocumentaries, Wikidata, Citoid, VisualEditor
Mvolz closed T230057: Citoid: Generate ISBNs with hyphens as Resolved.
Feb 13 2020, 11:54 AM · Citoid
Mvolz added a comment to T245092: Citoid inserts bad information from Indian news sites.

I've opened a new translator request to Zotero for this one: https://github.com/zotero/translators/issues/2118

Feb 13 2020, 11:51 AM · Patch-For-Review, Citoid
Mvolz awarded T241180: RFC: Adopt a modern JavaScript framework for use with MediaWiki a Party Time token.
Feb 13 2020, 10:55 AM · Front-end-Standards-Group, Vue.js, TechCom-RFC (TechCom-RFC-Closed), Security-Team

Feb 12 2020

Mvolz created T244953: 5 character limit is too restrictive for structured data on commons for character-based languages.
Feb 12 2020, 4:36 AM · Structured-Data-Backlog, StructuredDataOnCommons

Feb 11 2020

Mvolz added a comment to T244070: Validate author field to remove emails.

Reported upstream to Zotero as well here: https://github.com/zotero/translators/issues/2117

Feb 11 2020, 1:38 PM · Citoid
Mvolz added a comment to T244788: Zotero puts raw JS/CSS code in reference template parameters / both citoid and zotero should validate fields to make sure this doesn't occur.

Reported two places:
https://github.com/zotero/translation-server/issues/111
https://github.com/zotero/translators/issues/2117

Feb 11 2020, 1:38 PM · Upstream, Security, Citoid
Mvolz moved T244788: Zotero puts raw JS/CSS code in reference template parameters / both citoid and zotero should validate fields to make sure this doesn't occur from Backlog to Zotero on the Citoid board.
Feb 11 2020, 12:35 PM · Upstream, Security, Citoid
Mvolz added a comment to T243504: Use log level warn in citoid whenever zotero is unresponsive.

Change 566747 now deployed, except the information contained in the error is totally useless. 🤦 Example of uselessness: https://logstash.wikimedia.org/app/kibana#/doc/logstash-*/logstash-2020.02.11/citoid?id=AXA0MBAdh3Uj6x1zvZsc&_g=h@9a6393e

Feb 11 2020, 12:22 PM · Operations, Citoid
Mvolz renamed T244788: Zotero puts raw JS/CSS code in reference template parameters / both citoid and zotero should validate fields to make sure this doesn't occur from Citoid puts raw JS/CSS code in reference template parameters to Zotero puts raw JS/CSS code in reference template parameters / both citoid and zotero should validate fields to make sure this doesn't occur.
Feb 11 2020, 9:49 AM · Upstream, Security, Citoid
Mvolz committed rDEPLOYCHARTS9cae07344ccf: Update citoid to I4ec7b8ad (authored by Mvolz).
Update citoid to I4ec7b8ad
Feb 11 2020, 9:45 AM

Feb 7 2020

Mvolz added a comment to T208305: Support 'maps' parameter in TemplateData Editor (GUI).

@Tchanders any ideas for good microtasks for this project?

Feb 7 2020, 10:28 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData
Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Feb 7 2020, 10:27 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData

Feb 5 2020

Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Feb 5 2020, 2:07 PM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData

Feb 3 2020

Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Feb 3 2020, 10:54 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData
Mvolz added a comment to T208305: Support 'maps' parameter in TemplateData Editor (GUI).

After going through https://www.mediawiki.org/wiki/Content_handlers page, I was able to enable missing extensions and import the template page Successfully


However I see no content when I navigate to the imported page

Is there any other step to see page content

Feb 3 2020, 10:53 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData
Mvolz moved T243504: Use log level warn in citoid whenever zotero is unresponsive from Backlog to Production on the Citoid board.
Feb 3 2020, 10:05 AM · Operations, Citoid
Mvolz moved T234544: Alert on 0 zotero requests from zotero from Backlog to Production on the Citoid board.
Feb 3 2020, 10:05 AM · Operations, observability, serviceops, Citoid
Mvolz moved T235788: Citoid should create or reuse items for sources from Backlog to Wikibase/Wikidata Integration on the Citoid board.
Feb 3 2020, 10:05 AM · Citoid, Wikidata
Mvolz moved T239713: Citoid is logging all request / response headers as separate fields from Backlog to Production on the Citoid board.
Feb 3 2020, 10:05 AM · Core Platform Team (Icebox), serviceops, Operations, Citoid
Mvolz closed T242776: Add unit tests to the CI pipeline for citoid, a subtask of T225236: Figure out how to test Citoid with Zotero in the pipeline, as Resolved.
Feb 3 2020, 10:04 AM · Release-Engineering-Team (CI & Testing services), Core Platform Team, Citoid, Release Pipeline
Mvolz closed T242776: Add unit tests to the CI pipeline for citoid as Resolved.
Feb 3 2020, 10:04 AM · Citoid, Release Pipeline
Mvolz moved T244070: Validate author field to remove emails from Backlog to Service on the Citoid board.
Feb 3 2020, 10:04 AM · Citoid
Mvolz renamed T244070: Validate author field to remove emails from Author field should not be an email to Validate author field to remove emails.
Feb 3 2020, 10:03 AM · Citoid

Jan 31 2020

Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Jan 31 2020, 11:43 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData
Mvolz added a comment to T208305: Support 'maps' parameter in TemplateData Editor (GUI).

Hello @Mvolz thanks for the additional description! I am interested in working on this project,
Please when you say add some templates to your mediawiki extension, how do you mean?
Is there a Separate extension called Mediawiki? or are you referring to the TemplateData Extension?

Jan 31 2020, 11:41 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData

Jan 30 2020

Mvolz added a comment to T243444: Request took down both zotero and citoid (exceeding memory).

Thanks. That's working now, but I've downloaded the log file and it's just what's already available on kibana, warn level or higher. There's no debug level or message (10/20) in the logs - I don't suppose we have those anywhere?

Nope. What's in there is what citoid is instructed to log. The config is at https://gerrit.wikimedia.org/r/plugins/gitiles/operations/deployment-charts/+/master/charts/citoid/templates/config.yaml#16

Ah - well unfortunately without the trace and debug messages, and the missing err_body_internalURI in the warning log entries of interest, the logs seem largely useless in terms of figuring out which url was the culprit :/
I've put in a pr to bump up zotero misses up to warn, what do you think about logging trace and debug as well in the meantime? Too overkill?

info would be acceptable I guess. trace/debug might be an overkill though, especially given that citoid seems to log the body of the entire page (why does it do that again?). Also, we don't know when the next event will occur (it's months since we last got paged for zotero memory issues).

err_body_internalURI should ideally be in every single log message too, I guess I'll try to figure out why that isn't happening.

+1

Jan 30 2020, 11:06 AM · Operations, Citoid
Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Jan 30 2020, 11:00 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData
Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Jan 30 2020, 10:33 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData
Mvolz updated the task description for T208305: Support 'maps' parameter in TemplateData Editor (GUI).
Jan 30 2020, 10:32 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData
Mvolz renamed T208305: Support 'maps' parameter in TemplateData Editor (GUI) from Support 'maps' parameter in template data GUI editor to Support 'maps' parameter in TemplateData Editor (GUI).
Jan 30 2020, 10:15 AM · Google-Summer-of-Code (2020), VisualEditor, Outreach-Programs-Projects, TemplateData

Jan 29 2020

Mvolz created T243882: Switch to new pubmed website.
Jan 29 2020, 10:06 AM · Technical-Debt, Citoid

Jan 24 2020

Mvolz added a comment to T243444: Request took down both zotero and citoid (exceeding memory).

Thanks. That's working now, but I've downloaded the log file and it's just what's already available on kibana, warn level or higher. There's no debug level or message (10/20) in the logs - I don't suppose we have those anywhere?

Nope. What's in there is what citoid is instructed to log. The config is at https://gerrit.wikimedia.org/r/plugins/gitiles/operations/deployment-charts/+/master/charts/citoid/templates/config.yaml#16

Jan 24 2020, 2:37 PM · Operations, Citoid
Mvolz added a comment to T243131: visual editor seems to automatically replace long (good) urls with short urls.

(Note that this is not due to any change in the software, but rather that lots of websites seem to be using short urls in their metadata than ever before. So any change you're seeing is rather more distributed! )

Jan 24 2020, 1:37 PM · Citoid, VisualEditor
Mvolz added a comment to T243131: visual editor seems to automatically replace long (good) urls with short urls.

For this specific case, the url seems to be coming from

<meta property="og:url" content="https://www.faz.net/1.6469341" />

It would probably be better to use <link rel="canonical" href="https://www.faz.net/aktuell/gesellschaft/menschen/verleumdungsklage-von-e-jean-carroll-gegen-trump-16469341.html"/>, in theory. But this is coming from Zotero, so we can't really change how they pick which metadata to use, except possibly to file a bug. One possible solution is the one I've closed this as a duplicate of.

Jan 24 2020, 1:35 PM · Citoid, VisualEditor
Mvolz merged T243131: visual editor seems to automatically replace long (good) urls with short urls into T242089: Consider keeping user entered URL and removing tracking parameters .
Jan 24 2020, 1:27 PM · Security, Privacy Engineering, Citoid
Mvolz merged task T243131: visual editor seems to automatically replace long (good) urls with short urls into T242089: Consider keeping user entered URL and removing tracking parameters .
Jan 24 2020, 1:27 PM · Citoid, VisualEditor
Mvolz updated the task description for T243444: Request took down both zotero and citoid (exceeding memory).
Jan 24 2020, 11:35 AM · Operations, Citoid

Jan 23 2020

Mvolz added a comment to T243444: Request took down both zotero and citoid (exceeding memory).

-l app=citoid as that's the value for the app label, not citoid-production.
You can have a look at all the labels that are attached to pods with either https://gerrit.wikimedia.org/r/plugins/gitiles/operations/deployment-charts/+/master/charts/citoid/templates/deployment.yaml#17 or just by doing kubectl describe deployment and look at the pod template/labels stanza.
What it did ask for is the name of the container since there are 3 containers in the pod

  1. citoid-production (what you want)
  2. production-metrics-exporter (the prometheus exporter for the grafana dashboards)
  3. citoid-production-tls-proxy (the container that makes sure TLS is terminated before the app)

The exact call would be
kubectl logs -l app=citoid -c citoid-production

Jan 23 2020, 1:55 PM · Operations, Citoid
Mvolz added a comment to T243444: Request took down both zotero and citoid (exceeding memory).

it should be in the raw logs

Not sure what this refers to. If it is zotero logs, note that those don't exist. We had to turn them off as they were in a really bad format that caused issues to our logging pipeline. Assuming https://github.com/zotero/translation-server/issues/2 is addressed, we could reenable them. The disabling was done back in 827891af3d49beefc4a32042ff0ee2907dc77f0b
If it's the citoid logs, running kubectl logs -l app=citoid after having sourced .hfenv from the correct cluster directory works. But they are going to be way more difficult to parse of course.

Jan 23 2020, 12:31 PM · Operations, Citoid
Mvolz created T243504: Use log level warn in citoid whenever zotero is unresponsive.
Jan 23 2020, 11:31 AM · Operations, Citoid
Mvolz added a comment to T243444: Request took down both zotero and citoid (exceeding memory).

it should be in the raw logs

Not sure what this refers to. If it is zotero logs, note that those don't exist. We had to turn them off as they were in a really bad format that caused issues to our logging pipeline. Assuming https://github.com/zotero/translation-server/issues/2 is addressed, we could reenable them. The disabling was done back in 827891af3d49beefc4a32042ff0ee2907dc77f0b
If it's the citoid logs, running kubectl logs -l app=citoid after having sourced .hfenv from the correct cluster directory works. But they are going to be way more difficult to parse of course.
But I do see in logstash a err_body_internalURI attribute in some entries that seems to indeed have what we need?

Jan 23 2020, 11:20 AM · Operations, Citoid
Mvolz updated the task description for T243444: Request took down both zotero and citoid (exceeding memory).
Jan 23 2020, 11:12 AM · Operations, Citoid

Jan 22 2020

Mvolz created T243444: Request took down both zotero and citoid (exceeding memory).
Jan 22 2020, 7:03 PM · Operations, Citoid

Jan 21 2020

Mvolz committed rDEPLOYCHARTSc616cceecc3e: Update zotero to 5953b26 (codfw & eqiad) (authored by Mvolz).
Update zotero to 5953b26 (codfw & eqiad)
Jan 21 2020, 12:10 PM
Mvolz committed rDEPLOYCHARTSa8f933994914: Update citoid to 30f793422 (codfw & eqiad) (authored by Mvolz).
Update citoid to 30f793422 (codfw & eqiad)
Jan 21 2020, 11:09 AM
Mvolz committed rDEPLOYCHARTS9a59cc1e56b2: Update citoid to 30f793422 (staging cluster only) (authored by Mvolz).
Update citoid to 30f793422 (staging cluster only)
Jan 21 2020, 10:34 AM
Mvolz added a comment to T243070: Requesting +2 rights for Mvolz for operations/deployment-charts.

Unfortunately I'm still not seeing the ability to +2 :/

Jan 21 2020, 10:24 AM · Gerrit-Privilege-Requests, SRE-Access-Requests, Operations, Citoid
Mvolz reopened T243070: Requesting +2 rights for Mvolz for operations/deployment-charts, a subtask of T213269: Requesting access to Citoid/Zotero production servers for MVOLZ, as Open.
Jan 21 2020, 10:23 AM · Operations, SRE-Access-Requests, Citoid
Mvolz reopened T243070: Requesting +2 rights for Mvolz for operations/deployment-charts as "Open".
Jan 21 2020, 10:23 AM · Gerrit-Privilege-Requests, SRE-Access-Requests, Operations, Citoid

Jan 20 2020

Mvolz claimed T242776: Add unit tests to the CI pipeline for citoid.
Jan 20 2020, 1:53 PM · Citoid, Release Pipeline

Jan 17 2020

Mvolz removed a subtask for T213269: Requesting access to Citoid/Zotero production servers for MVOLZ: T242427: Revoke access Citoid/Zotero production servers for MVOLZ.
Jan 17 2020, 12:21 PM · Operations, SRE-Access-Requests, Citoid
Mvolz removed a parent task for T242427: Revoke access Citoid/Zotero production servers for MVOLZ: T213269: Requesting access to Citoid/Zotero production servers for MVOLZ.
Jan 17 2020, 12:21 PM · SRE-Access-Requests, Operations, Citoid