Page MenuHomePhabricator

Allow for logging recently updated entities
Closed, ResolvedPublic

Description

While applying updates, an additional logger UPDATED_ENTITY_IDS should catch updated entity IDs (one ID per log line), this logger by default is configured to collect entity IDs in gzipped plain text files with per-day rolling policy, limiting size to not exceed 10G (that is a guess value, and should be configured for production according to actual updates load and available disk space).

This updated entity IDs log will be useful while researching issues with updates and also provide a reliable and easy way to identify entities which were recently changed (see also task for testing of Merging Updater T231411)

Event Timeline

Hi @Igorkim78. Can you please associate at least one active project with this task (via the Add Action...Change Project Tags dropdown). This will allow others to get notified and see this task when looking at the corresponding project workboard. Thanks! Is this about Wikidata-Query-Service maybe?

Change 551549 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/puppet@production] [wdqs] add logging config for exporting updated entities

https://gerrit.wikimedia.org/r/551549

Change 551549 merged by Gehel:
[operations/puppet@production] [wdqs] add logging config for exporting updated entities

https://gerrit.wikimedia.org/r/551549

Change 551787 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] wdqs: fix logging configuration for updated entities

https://gerrit.wikimedia.org/r/551787

Change 551787 merged by Gehel:
[operations/puppet@production] wdqs: fix logging configuration for updated entities

https://gerrit.wikimedia.org/r/551787

Gehel claimed this task.