Page MenuHomePhabricator
Create Task
Maniphest T98750

Do not index type:api-feature-usage-sanitized events in Logstash's Elasticsearch
Closed, ResolvedPublic
Actions

Description

These are duplicate events of the type:mediawiki channel:api-feature-usage events that we already store with some information removed for presentation to the general public. These events are intended for storage in the production Elasticsearch servers (see T1272). We don't need to keep these in the Logstash Elasticsearch cluster.

Details

SubjectRepoBranchLines +/-
logstash: Exclude api-feature-usage-sanitized from indexingoperations/puppetproduction+1 -2
Customize query in gerrit

Related Objects

Event Timeline

bd808 created this task.May 11 2015, 4:25 PM
bd808 raised the priority of this task from to Needs Triage.
bd808 updated the task description. (Show Details)
bd808 added a project: Wikimedia-Logstash.
bd808 added subscribers: bd808, Aklapper.
bd808 added a project: User-bd808.May 12 2015, 1:11 AM
gerritbot subscribed.May 12 2015, 5:39 AM

Change 210277 had a related patch set uploaded (by BryanDavis):
logstash: Exclude api-feature-usage-sanitized from indexing

https://gerrit.wikimedia.org/r/210277

gerritbot added a project: Patch-For-Review.May 12 2015, 5:39 AM
bd808 moved this task from To Do to Needs Review/Feedback on the User-bd808 board.May 12 2015, 6:19 AM
gerritbot added a comment.May 13 2015, 5:32 PM

Change 210277 merged by Ori.livneh:
logstash: Exclude api-feature-usage-sanitized from indexing

https://gerrit.wikimedia.org/r/210277

ori mentioned this in rOPUPe94ea8c271bc: logstash: Exclude api-feature-usage-sanitized from indexing.May 13 2015, 5:32 PM
bd808 closed this task as Resolved.May 13 2015, 7:54 PM
bd808 claimed this task.
bd808 moved this task from Needs Review/Feedback to Done on the User-bd808 board.
bd808 moved this task from Done to Archive on the User-bd808 board.May 28 2015, 5:28 PM
bd808 moved this task from Backlog to Archive on the Wikimedia-Logstash board.Jun 5 2015, 6:55 PM
fgiunchedi added a project: observability.Aug 19 2019, 2:28 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL