Page MenuHomePhabricator

Github says we maxed our shared storage quota
Closed, ResolvedPublic

Description

As admin on wikimedia github org. I got this email alerting about sharing storage usage: 3,887MB out of 2,048MB

image.png (639×787 px, 60 KB)

Downloading our usage report in the past seven days is this:

DateProductRepository SlugQuantityUnit TypePrice Per UnitActions Workflow
2020-09-19shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-20shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-21shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-22shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-23actionswikimedia/wikipedia-ios-deploy50MACOS$0.08.github/workflows/main.yml
2020-09-23shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-24actionswikimedia/wikipedia-ios-deploy49MACOS$0.08.github/workflows/main.yml
2020-09-24shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-25actionswikimedia/wikipedia-ios-deploy88MACOS$0.08.github/workflows/main.yml
2020-09-25shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-25shared storagewikimedia/wikipedia-ios-deploy2.1284gb$0.25
2020-09-26actionswikimedia/wikipedia-ios-deploy86MACOS$0.08.github/workflows/main.yml
2020-09-26shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-26shared storagewikimedia/wikipedia-ios-deploy3.528gb$0.25
2020-09-27shared storagewikimedia/wikipedia-ios0.9713gb$0.25
2020-09-27shared storagewikimedia/wikipedia-ios-deploy3.7913gb$0.25

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

I just want to point out that my personal paypal account is the billing method for this github org and I can't remove it because it would break ores (another fun story), so I appriecate this being fixed. Let me know if I can help with anything

MarcoAurelio subscribed.

Confirm, as a Wikimedia-GitHub admin that I also got the same email, included another one on Sept., 26 telling us that we've used over 90% of the included services for the wikimedia account (mentions GitHub actions: 2730 out of 3000 minutes). I guess this is due to the repo being private, because it looks GitHub does not charge us for actions on public repos? Adding Release-Engineering-Team as well.

taavi renamed this task from Github syas we maxed our shared storage quota to Github says we maxed our shared storage quota .Sep 27 2020, 4:41 PM
LGoto triaged this task as High priority.Sep 28 2020, 6:44 PM
LGoto moved this task from Needs Triage to Engineering Backlog on the Wikipedia-iOS-App-Backlog board.

@Ladsgroup I was doing some CI experiments for iOS. I deleted the files stored by the actions and the repository itself, so we should be back under the quota as an org.

@Ladsgroup Let's figure out a way to get your personal paypal out of there. That is unfair to you and a vulnerability to the system. Now we have about 10 different reasons to have our call!

I guess https://github.com/nonprofit if not done already?

We have a coupon that makes everything free forever, I assume this came from github directly (I don't know if it was done by partnerships or not or it's just the nonprofit you mentioned) BUT:

  • If someone removes that coupon, by mistake or not or
  • If it doesn't cover some certain services or
  • If Github changes its mind and invalidates it (because corporations)

I'll be billed for gosh knows how much.

The usage storage is per day and per repository.

Looks like wikimedia/wikipedia-ios uses ~ 970MBytes

wikimedia/wikipedia-ios-deploy used some Mac OS X resources and its storage usage raised:

2020-09-252.1284 gb
2020-09-263.528 gb
2020-09-273.7913 gb

The repository has been removed by @JoeWalsh yesterday (18:47 UTC). We had some mail exchange about better supporting iOS CI, I guess that wikipedia-ios-deploy repository was transient and part of the experiment.

Given the repository has been deleted, I am guessing the notification will stop.

I just want to point out that my personal paypal account is the billing method for this github org and I can't remove it because it would break ores (another fun story), so I appriecate this being fixed. Let me know if I can help with anything

That must be addressed, do we have tasks for those concerns?

  • (edit filed as T264142) the billing method must be changed to be owned by the Wikimedia foundation, definitely not by an individual. I am not even sure what kind of restrictions we would have to put in place given there are a wide range of people being owner of the Github organization without even being employees or contractors. But that is a whole other can of worms to open.
  • Ditto for ORES, we would need a task for it. Not sure why it would require any billing method, I guess cause its using some specific feature. Surely we can migrate that to our own stack and the cost (cpu, storage etc) will end up being supported by Wikimedia eisting infrastructure. If at all feasible obviously.

If nobody else has worked on this yet I can take it.

The issue is solved. That was a one time experiment for the iOS application. There are some out of band communications going on for that use case.

T264142 got filed for changing the billing informations.

ORES use case is for LFS storage, I believe there is already a task for it even if I could not find it at this time. But I definitely have seen discussions going on related to how ORES is being deployed. So I am assuming it is tracked appropriately.