Maniphest T437694

Research how much overlap there is in requests for the same url
Open, Needs TriagePublic
Actions

Assigned To

Authored By

	Mvolz
	Fri, Sep 11, 10:33 AM

Project Tags

Referenced Files

	F105997634: On_demand_report_2026-10-01T10_03_33.214Z_5c4b6fe0-bd7f-11f1-a8a0-95afb48af0a7.outcome-isbn.png
	Sat, Oct 3, 7:14 AM

	F105997635: On_demand_report_2026-10-01T10_03_33.214Z_5c4b6fe0-bd7f-11f1-a8a0-95afb48af0a7.outcome-urls.png
	Sat, Oct 3, 7:14 AM

	F105997592: combined.dupes-linear-percent.png
	Sat, Oct 3, 7:14 AM

	F105997485: combined.dupes.png
	Sat, Oct 3, 7:14 AM

	F105997486: combined.dupes-isbn.png
	Sat, Oct 3, 7:14 AM

Subscribers

Description

Log scale

combined.dupes-isbn.png (1,650×825 px, 79 KB)

combined.dupes.png (1,650×825 px, 70 KB)

Linear

combined.dupes-linear-percent.png (1,650×825 px, 72 KB)

Repeats by outcome (success/failure) in small window (1day)

On_demand_report_2026-10-01T10_03_33.214Z_5c4b6fe0-bd7f-11f1-a8a0-95afb48af0a7.outcome-urls.png (1,650×825 px, 92 KB)

On_demand_report_2026-10-01T10_03_33.214Z_5c4b6fe0-bd7f-11f1-a8a0-95afb48af0a7.outcome-isbn.png (1,650×825 px, 82 KB)

Also added unique count data table to graphana:

https://logstash.wikimedia.org/app/dashboards#/view/5eaf4e40-f6b6-11eb-85b7-9d1831ce7631

TODO:

Explore how this changes with increased window length; does the shape stay the same?
What cache length would be suitable for failures? What about successes?

Event Timeline

Mvolz created this task.Fri, Sep 11, 10:33 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFri, Sep 11, 10:33 AM

Mvolz added a subtask: T438741: Retry with GET after certain failed HEAD checks in citoid.Mon, Sep 21, 2:00 PM

Mvolz removed a subtask: T438741: Retry with GET after certain failed HEAD checks in citoid.

Mvolz updated the task description. (Show Details)Sat, Oct 3, 7:14 AM

Mvolz updated the task description. (Show Details)

Mvolz attached a referenced file: F105997635: On_demand_report_2026-10-01T10_03_33.214Z_5c4b6fe0-bd7f-11f1-a8a0-95afb48af0a7.outcome-urls.png. (Show Details)

Mvolz attached a referenced file: F105997634: On_demand_report_2026-10-01T10_03_33.214Z_5c4b6fe0-bd7f-11f1-a8a0-95afb48af0a7.outcome-isbn.png. (Show Details)

Mvolz claimed this task.Sat, Oct 3, 7:16 AM

Mvolz attached a referenced file: F105997592: combined.dupes-linear-percent.png. (Show Details)

Mvolz attached a referenced file: F105997486: combined.dupes-isbn.png. (Show Details)

Mvolz attached a referenced file: F105997485: combined.dupes.png. (Show Details)