Investigate / Correct timestamp and data not being properly read from Camus for CirrusSearchRequestSet logs.
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	JAllemandou
	Nov 5 2015, 4:03 PM

Description

Data imported with kafka seems not to have the data timsestamp, but the import-time timestamp.

Details

	Subject	Repo	Branch	Lines +/-
	Rename timestamp to ts for CirrusSearchRequestSet	operations/puppet	production	+4 -1
	Add support for custom timestamp and schema rev id in avro message decoders	analytics/refinery/source	master	+1 K -275

Customize query in gerrit

Related Objects

Mentioned In: T117575: Setup oozie task for adding and removing CirrusSearchRequestSet partitions in hive

Event Timeline

JAllemandou created this task.Nov 5 2015, 4:03 PM

JAllemandou raised the priority of this task from to Needs Triage.

JAllemandou updated the task description. (Show Details)

JAllemandou added a project: Analytics-Kanban.

JAllemandou subscribed.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptNov 5 2015, 4:03 PM

Change 251267 had a related patch set uploaded (by DCausse):
AvroBinaryMessageDecoder: added "ts" as a possible record for timestamp

https://gerrit.wikimedia.org/r/251267

gerritbot added a project: Patch-For-Review.Nov 5 2015, 5:36 PM

JAllemandou assigned this task to dcausse.Nov 5 2015, 6:04 PM

JAllemandou set Security to None.

JAllemandou moved this task from Next Up to In Code Review on the Analytics-Kanban board.

Change 252432 had a related patch set uploaded (by DCausse):
Rename timestamp to ts for CirrusSearchRequestSet

https://gerrit.wikimedia.org/r/252432

• Nuria moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Nov 11 2015, 4:20 PM

• Nuria moved this task from Ready to Deploy to In Code Review on the Analytics-Kanban board.Nov 11 2015, 5:06 PM

dcausse mentioned this in T117575: Setup oozie task for adding and removing CirrusSearchRequestSet partitions in hive.Nov 13 2015, 8:21 AM

• Nuria renamed this task from Investigate / Correct timestamp not being properly read from Camus for CirrusSearchRequestSet logs. to Investigate / Correct timestamp and data not being properly read from Camus for CirrusSearchRequestSet logs..Nov 20 2015, 5:04 PM

• Nuria subscribed.

bd808 subscribed.Nov 20 2015, 6:35 PM

Change 251267 merged by jenkins-bot:
Add support for custom timestamp and schema rev id in avro message decoders

https://gerrit.wikimedia.org/r/251267

JAllemandou moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Nov 25 2015, 9:29 AM

Change 252432 merged by Ottomata:
Rename timestamp to ts for CirrusSearchRequestSet

https://gerrit.wikimedia.org/r/252432

JAllemandou moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Dec 1 2015, 6:01 PM

• Nuria closed this task as Resolved.Dec 2 2015, 6:49 PM

Investigate / Correct timestamp and data not being properly read from Camus for CirrusSearchRequestSet logs.Closed, ResolvedPublicActions

Description

Details

Related Objects

Event Timeline

Investigate / Correct timestamp and data not being properly read from Camus for CirrusSearchRequestSet logs.
Closed, ResolvedPublic
Actions