Python fundraising-tools queue module should be abstracted and support Redis
Closed, ResolvedPublic2 Estimated Story Points
Actions

Description

Our Python Queue class only speaks STOMP. We need to support the new Redis queue style, and have per-queue configuration to allow incremental migration and rollback.

Do something fun with writing a python AtomicReadBuffer.

Part of this is figuring out which Python jobs are actually running in Jenkins.

Details

	Subject	Repo	Branch	Lines +/-
	Make PayPal audit mirror to Redis	wikimedia/fundraising/tools	master	+47 -0
	Make PayPal audit mirror to Redis	wikimedia/fundraising/tools	master	+36 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	None	T117466 Q3 GOALS! (January-March) Keep at top of Q3 column
Resolved	None	T108229 [Epic] SPOF: Replace ActiveMQ donation queues with a more robust software stack
Resolved	None	T133108 [Epic] Rewrite all queue clients to use a single shim library, improve library
Resolved	XenoRyet	T130308 Python fundraising-tools queue module should be abstracted and support Redis

Event Timeline

awight created this task.Mar 17 2016, 9:24 PM

• DStrine set the point value for this task to 2.Mar 22 2016, 7:09 PM

• DStrine moved this task from Triage to Sprint +3 on the Fundraising-Backlog board.

• DStrine added a project: FR-ActiveMQ.Mar 30 2016, 6:27 PM

awight renamed this task from fundraising-tools queue operations should use Redis to fundraising-tools queue operations should use Kafka.Mar 30 2016, 6:31 PM

awight updated the task description. (Show Details)

• DStrine moved this task from Sprint +3 to Sprint +2 on the Fundraising-Backlog board.Mar 30 2016, 8:16 PM

• DStrine moved this task from Sprint +2 to Q3 2021-2022 on the Fundraising-Backlog board.

• DStrine moved this task from Q3 2021-2022 to Q4 FY21-22 on the Fundraising-Backlog board.

• DStrine moved this task from Q4 FY21-22 to Q3 2021-2022 on the Fundraising-Backlog board.Mar 30 2016, 8:20 PM

• DStrine moved this task from Q3 2021-2022 to Q4 FY21-22 on the Fundraising-Backlog board.

• atgo unsubscribed.Mar 30 2016, 8:29 PM

awight renamed this task from fundraising-tools queue operations should use Kafka to fundraising-tools queue operations should use a queue abstraction.Apr 19 2016, 9:19 PM

Restricted Application added a subscriber: TerraCodes. · View Herald TranscriptApr 19 2016, 9:19 PM

awight added a parent task: T133108: [Epic] Rewrite all queue clients to use a single shim library, improve library.Apr 19 2016, 9:19 PM

awight removed a parent task: T108229: [Epic] SPOF: Replace ActiveMQ donation queues with a more robust software stack.

awight moved this task from Q4 FY21-22 to Q3 2021-2022 on the Fundraising-Backlog board.Apr 22 2016, 6:04 PM

awight renamed this task from fundraising-tools queue operations should use a queue abstraction to fundraising-tools queue module should be abstracted and support Redis.Jul 15 2016, 2:05 AM

awight updated the task description. (Show Details)

awight moved this task from Backlog to PHP-Queue and library on the FR-ActiveMQ board.Jul 15 2016, 9:23 PM

awight renamed this task from fundraising-tools queue module should be abstracted and support Redis to Python fundraising-tools queue module should be abstracted and support Redis.Jul 27 2016, 9:01 PM

awight updated the task description. (Show Details)Aug 16 2016, 5:39 PM

XenoRyet claimed this task.Aug 17 2016, 5:58 PM

• DStrine added a project: Fundraising Sprint Pretending This Isn't Happening.Aug 17 2016, 11:13 PM

XenoRyet moved this task from Backlog to Doing on the Fundraising Sprint Pretending This Isn't Happening board.Aug 18 2016, 5:19 PM

XenoRyet moved this task from Doing to Review on the Fundraising Sprint Pretending This Isn't Happening board.Aug 29 2016, 7:55 PM

Change 307433 had a related patch set uploaded (by XenoRyet):
Make Paypal audit mirror to Redis

https://gerrit.wikimedia.org/r/307433

gerritbot added a project: Patch-For-Review.Aug 29 2016, 9:57 PM

Change 307632 had a related patch set uploaded (by XenoRyet):
Make PayPal audit mirror to Redis

https://gerrit.wikimedia.org/r/307632

Change 307632 abandoned by XenoRyet:
Make PayPal audit mirror to Redis

Reason:
errant changeID