Description

Some older (canceled/deleted) donations in our database are marked as scrubbed but still contain data.

for the broken entries:
- Scrub old entries that have is_scrubbed=1 as a false flag manually
  - we scrubbed manually all entries that were marked as is_scrubbed=1 and already exported --> we will try running this https://github.com/wmde/fundraising-backend/pull/1229 with 1000 items per batch (-> successful ✅ )
  - we still need to scrub the ones that are falsely set to is_scrubbed=1 but got never exported (-> those are status X, D, P, ...)
  - Investigate if tghere is any donor data in the data blobs of scrubbed entries:
    - child ticket: https://phabricator.wikimedia.org/T418399

for non-broken entries:
- implement scrubbing deleted donations and abandoned donations (outside of grace period) in DatabaseDonationAnonymizer.php: https://github.com/wmde/fundraising-donations/pull/346
  - deploy changes to test https://github.com/wmde/fundraising-backend/pull/1238
  - deploy changes to production https://github.com/wmde/fundraising-backend/pull/1238

Related Objects

Mentioned In: T424136: Scrubbing command to scrub historical data blobs
Mentioned Here: T373766: Scrub personal data in test database
T401247: Improve donation scrubbing query

Event Timeline

CorinnaHillebrand_WMDE created this task.Feb 25 2026, 5:17 PM

Restricted Application added a subscriber: • Aklapper. · View Herald TranscriptFeb 25 2026, 5:17 PM

AbbanWMDE renamed this task from Check data deletion status of old donations to [Spike] Check data deletion status of old donations.Mar 3 2026, 10:15 AM

AbbanWMDE added a project: WMDE-FUN-Sprint-2026-03-03.

AbbanWMDE set the point value for this task to 3.

CorinnaHillebrand_WMDE renamed this task from [Spike] Check data deletion status of old donations to Check data deletion status of old donations.Mar 3 2026, 10:16 AM

AbbanWMDE claimed this task.Mar 5 2026, 10:51 AM

AbbanWMDE moved this task from Todo to Doing on the WMDE-FUN-Sprint-2026-03-03 board.

We need to change the scrubbing script to also scrub status X and D status after a while,
also figure out how to proceed with status P (moderated)

this ticket might be relevant: https://phabricator.wikimedia.org/T401247

CorinnaHillebrand_WMDE updated Other Assignee, added: CorinnaHillebrand_WMDE.Mar 9 2026, 4:12 PM

@AbbanWMDE
I created a PR today to implement the missing "grace period" again for the donation scrubbing: https://github.com/wmde/fundraising-donations/pull/346

Please have a look, you can also extend/comment the PR already if you have other ideas on that.

CorinnaHillebrand_WMDE updated the task description. (Show Details)Mar 9 2026, 6:17 PM

CorinnaHillebrand_WMDE updated the task description. (Show Details)

CorinnaHillebrand_WMDE updated the task description. (Show Details)Mar 18 2026, 9:47 AM

CorinnaHillebrand_WMDE updated the task description. (Show Details)Mar 18 2026, 2:51 PM

CorinnaHillebrand_WMDE added a project: WMDE-FUN-Sprint-2026-03-17.Mar 19 2026, 8:35 AM

AbbanWMDE changed the point value for this task from 3 to 5.Mar 19 2026, 8:38 AM

AbbanWMDE moved this task from Todo to Doing on the WMDE-FUN-Sprint-2026-03-17 board.

CorinnaHillebrand_WMDE updated the task description. (Show Details)Mar 25 2026, 2:23 PM

CorinnaHillebrand_WMDE added a project: WMDE-Fundraising-Tech.Mar 26 2026, 11:10 AM

status update:
test database is scrubbed completely ✅
production database is scrubbed ✅

CorinnaHillebrand_WMDE updated the task description. (Show Details)Apr 7 2026, 2:04 PM

CorinnaHillebrand_WMDE updated the task description. (Show Details)

CorinnaHillebrand_WMDE updated the task description. (Show Details)Apr 7 2026, 2:12 PM

CorinnaHillebrand_WMDE updated the task description. (Show Details)

AbbanWMDE changed the point value for this task from 5 to 1.Apr 14 2026, 8:55 AM

investigate missing 8000 scrubbed=0 & name = NULL entries

CorinnaHillebrand_WMDE added a project: WMDE-FUN-Sprint-2026-04-14.Apr 14 2026, 9:01 AM

AbbanWMDE moved this task from Todo to Doing on the WMDE-FUN-Sprint-2026-04-14 board.Apr 14 2026, 9:01 AM

https://github.com/wmde/fundraising-donations/pull/346 is ready for review

AbbanWMDE updated the task description. (Show Details)Apr 15 2026, 10:35 AM

https://github.com/wmde/fundraising-donations/releases/tag/v26.0.0

CorinnaHillebrand_WMDE updated the task description. (Show Details)Apr 15 2026, 1:42 PM

https://github.com/wmde/fundraising-backend/pull/1238

just deployed this branch to test-backend

CorinnaHillebrand_WMDE updated the task description. (Show Details)Apr 15 2026, 2:07 PM

CorinnaHillebrand_WMDE moved this task from Backlog to Current Sprint on the WMDE-Fundraising-Tech board.

CorinnaHillebrand_WMDE updated the task description. (Show Details)Apr 15 2026, 2:56 PM

CorinnaHillebrand_WMDE moved this task from Review to Todo on the WMDE-FUN-Sprint-2026-04-14 board.Apr 17 2026, 8:03 AM

CorinnaHillebrand_WMDE updated the task description. (Show Details)Apr 22 2026, 12:27 PM

CorinnaHillebrand_WMDE mentioned this in T424136: Scrubbing command to scrub historical data blobs.Apr 22 2026, 12:34 PM

CorinnaHillebrand_WMDE updated the task description. (Show Details)

AbbanWMDE added a project: WMDE-FUN-Sprint-2026-04-28.Apr 28 2026, 8:45 AM

AbbanWMDE reassigned this task from AbbanWMDE to Mr.nonenone.Apr 30 2026, 4:41 AM

AbbanWMDE moved this task from Todo to Done on the WMDE-FUN-Sprint-2026-04-28 board.

AbbanWMDE moved this task from Done to Deploy on the WMDE-FUN-Sprint-2026-04-28 board.

AbbanWMDE moved this task from Deploy to Done on the WMDE-FUN-Sprint-2026-04-28 board.

AbbanWMDE subscribed.

AbbanWMDE removed Mr.nonenone as the assignee of this task.Apr 30 2026, 4:44 AM

AbbanWMDE updated Other Assignee, removed: CorinnaHillebrand_WMDE.

AbbanWMDE added a subscriber: Mr.nonenone.

AbbanWMDE closed this task as Resolved.Thu, Jul 16, 7:14 AM

Check data deletion status of old donationsClosed, ResolvedPublic1 Estimated Story PointsActions

Description

Related Objects

Event Timeline

Check data deletion status of old donations
Closed, ResolvedPublic1 Estimated Story Points
Actions