logstash: Update filters for sending to es 2.x
f243f99c9be7Unpublished
Actions

Unpublished Commit · Learn More

Not On Permanent Ref: This commit is not an ancestor of any permanent ref.

This commit no longer exists in the repository. It may have been part of a branch which was deleted.This commit has been deleted in the repository: it is no longer reachable from any branch, tag, or ref.

Description

logstash: Update filters for sending to es 2.x

Post process logs to make them es 2.x compatible:

converts dot's in the properties into underscores.
Normalizes the pid and line fields into int. Some of the log types for nodejs services auto-created these as strings.
Drops the extra timestamp field. @timestamp is definitive, and this timestamp field is seen sometimes as a date, sometimes as a string in the auto generated mappings.

This needs to be tested on beta cluster before being merged.

Change-Id: I46d177ce1218eee6f86fa9468b917dc54b3d55da
Depends-On: Ibb83558
Bug: T138335

Details

Provenance

EBernhardson

Authored on Jun 22 2016, 7:48 PM

ChangeId

I46d177ce1218eee6f86fa9468b917dc54b3d55da

Event Timeline

EBernhardson committed rOPUPf243f99c9be7: logstash: Update filters for sending to es 2.x (authored by EBernhardson).Jun 23 2016, 6:17 PM

Commit No Longer Exists

This commit no longer exists in the repository.