Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based system to count pageviews to donatewiki
Closed, ResolvedPublic2 Estimated Story Points
Actions

Assigned To

None

Authored By

	AndyRussG
	Mar 13 2018, 7:14 PM

Referenced Files

None

Subscribers

Description

There are several pieces to this change: new features to write and deploy, bits of infrastructure to add or modify, tests to perform. We should try to coordinate it all, to ensure a reliable new system is in place within a reasonable timeframe.

For this task, we might list all the changes and tests that need to occur, roughly scope each out as best as possible, and plan when they could ideally happen. We could also try to determine whether coordination is needed with live FR campaigns or tests for any of the steps.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T183978 [Epic] Fundraising kafkatee changes
		Resolved		None	T189613 Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based system to count pageviews to donatewiki

Event Timeline

AndyRussG created this task.Mar 13 2018, 7:14 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 13 2018, 7:14 PM

AndyRussG mentioned this in T183978: [Epic] Fundraising kafkatee changes.Mar 13 2018, 7:15 PM

• DStrine moved this task from Triage to Completed in Q3 2017-18 on the Fundraising-Backlog board.Mar 13 2018, 8:12 PM

• DStrine added a project: Fundraising Sprint Fhabricator is spelled with an "F".Mar 13 2018, 8:28 PM

A bit of brainstorming about steps to carry out here...

CentralNotice EventLogging (done)
Donate Wiki EventLogging
Adjust DB ingress scripts to accept both EL events and data in the current format
Analytics, Traffic and FR infrastructure changes to send the event data to the DB ingress script
Create a parallel database for data from EL
Activate both systems in parallel to test
De-activate old system

What do you think? Surely I've missed a bunch... Thanks!!!!

• DStrine added a project: Fundraising Sprint Gravity wasn't always this pushy.Mar 27 2018, 8:12 PM

• Nuria renamed this task from Make a rough timeline/roadmap for Kafkatee changes to Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based architecture to count pageviews.Apr 10 2018, 4:49 PM

• Nuria renamed this task from Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based architecture to count pageviews to Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based architecture to count pageviews to donatewiki.

• Nuria renamed this task from Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based architecture to count pageviews to donatewiki to Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based systeme to count pageviews to donatewiki.Apr 10 2018, 4:53 PM

• Nuria renamed this task from Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based systeme to count pageviews to donatewiki to Make a rough timeline/roadmap to replace usage of Kafkatee by FR with an event-based system to count pageviews to donatewiki.

• DStrine added a project: Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol.Apr 10 2018, 8:07 PM

• DStrine moved this task from Completed in Q3 2017-18 to Current Sprint on the Fundraising-Backlog board.Apr 24 2018, 7:44 PM

• DStrine added a project: Fundraising Sprint Ivory and eggshell white are the same color.Apr 24 2018, 8:57 PM

AndyRussG moved this task from Backlog to Doing on the Fundraising Sprint Ivory and eggshell white are the same color board.Apr 25 2018, 1:58 PM

AndyRussG added a parent task: T183978: [Epic] Fundraising kafkatee changes.Apr 25 2018, 3:47 PM

AndyRussG added a comment.Apr 25 2018, 3:50 PM

This comment was removed by AndyRussG.

(Sorry, removed the previous comment since I put it on the wrong task... ;p )

Remaining to-do:

Adjust DB ingress scripts to accept both EL events and data in the current format
Analytics, Traffic and FR infrastructure changes to send the event data to the DB ingress script
Create a parallel database for data from EL
Activate both systems in parallel to test
De-activate old system

We're currently on point (1), trying to figure out how that should go (T192839). Really, really rough guesses about completion dates for point (1): Figure out how to do it, 2018-04-30; Make the actual changes, 2018-05-14.

Points 2-5, I think, are in Operations's domain... Any thoughts on those?

AndyRussG moved this task from Doing to Backlog on the Fundraising Sprint Ivory and eggshell white are the same color board.Apr 25 2018, 4:01 PM

kai.nissen subscribed.May 2 2018, 2:16 PM

• DStrine added a project: Fundraising Sprint Junebugs prefer July.May 8 2018, 8:34 PM

• DStrine added a project: Fundraising Sprint Karma chameleons hide amongst us.May 22 2018, 8:42 PM

• DStrine added a project: Fundraising Sprint Lactose is unusually tolerant.Jun 5 2018, 8:34 PM

• mepps moved this task from Backlog to Review on the Fundraising Sprint Lactose is unusually tolerant board.Jun 18 2018, 2:09 PM

• DStrine added a project: Fundraising Sprint Matt Damon to head up Space Force.Jun 18 2018, 8:21 PM

• DStrine added a project: Fundraising Sprint Naming Sprints Is Not Important.Jul 11 2018, 9:26 PM

• DStrine added a project: Fundraising Sprint Owls.Jul 24 2018, 8:14 PM

• DStrine added a project: Fundraising Sprint Pluto is still a planet.Aug 7 2018, 8:42 PM

• DStrine added a project: Fundraising Sprint Queue is pronounced GJif.Aug 21 2018, 8:47 PM