HomePhabricator

logstash: Update filters for sending to es 2.x
7b7b129c0cfbUnpublished

Unpublished Commit · Learn More

Not On Permanent Ref: This commit is not an ancestor of any permanent ref.
This commit no longer exists in the repository. It may have been part of a branch which was deleted.This commit has been deleted in the repository: it is no longer reachable from any branch, tag, or ref.

Description

logstash: Update filters for sending to es 2.x

Post process logs to make them es 2.x compatible:

  • converts dot's in the properties into underscores.
  • Normalizes the pid and line fields into int. Some of the log types for nodejs services auto-created these as strings.
  • Drops the extra timestamp field. @timestamp is definitive, and this timestamp field is seen sometimes as a date, sometimes as a string in the auto generated mappings.

This needs to be tested on beta cluster before being merged.

Change-Id: I46d177ce1218eee6f86fa9468b917dc54b3d55da
Depends-On: Ibb83558
Bug: T138335

Details

Provenance
EBernhardsonAuthored on Jun 22 2016, 7:48 PM
ChangeId
I46d177ce1218eee6f86fa9468b917dc54b3d55da

Commit No Longer Exists

This commit no longer exists in the repository.