Page MenuHomePhabricator

Update CirrusSearchRequestSet schema to have a timestamp field
Closed, ResolvedPublic

Description

The CirrusSearchRequestSet schema needs to have a timestamp field for the imported data to be partitioned correctly. The schema needs to be updated in two places:

This is the schema on the analytics end (note that it has a different namespace, only as a temporary workaround on the import side of things)

  • On the monolog end (you can use the search namespace here - no problem).

To update on the analytics end, send us an updated schema version and we can update it/submit a patch to refinery-source and we can review and merge.

Event Timeline

madhuvishy assigned this task to EBernhardson.
madhuvishy raised the priority of this task from to High.
madhuvishy updated the task description. (Show Details)
madhuvishy added subscribers: bd808, gerritbot, Nemo_bis and 7 others.

Couple other changes to apply at same time:

  • index field should be indices (its an array)
  • integer fields should default to -1

Change 246990 had a related patch set uploaded (by EBernhardson):
Update CirrusSearchRequestSet avro schema

https://gerrit.wikimedia.org/r/246990

Change 246990 merged by Ottomata:
Update CirrusSearchRequestSet avro schema

https://gerrit.wikimedia.org/r/246990