Mass bigdeletion scheduled for sr.wikinews
Open, NormalPublic

Description

See:

Most of them pages have thousands of revisions each and are a bunch. With the batched deletion feature now live I guess it might not be a problem but I'd like to ping you nonetheless because I don't want to cause db issues or high replag while doing this.

I'm thinking about using a pywiki script. Perhaps a waiting time of 30 seconds between deletions with a maxlag parameter of 3 would be db friendly?

Please let me know. Thank you.

Restricted Application added subscribers: Petar.petkovic, Aklapper. · View Herald TranscriptWed, Dec 19, 9:31 PM

Do you happen to know how big a batch is?

Do you happen to know how big a batch is?

I'm not sure I understand the question. The batch of pages to delete is actually listed above and consist of 350 pages, most of them with more than 5,000 revisions each. Thanks.

Sorry for not being clear enough - I mean from a pure DB point of view, the internal of those batches, as in: how many rows per DELETE would be issued on the database :-)
Can we manually try to delete one of the pages with the highest number of revisions first? instead to do all of the pages at once so we can see the impact?
Ideally we should not do it between 24th and 1st as there will be a lot less people around due to holidays

Marostegui triaged this task as Normal priority.Thu, Dec 20, 6:40 AM
Marostegui moved this task from Triage to Blocked external/Not db team on the DBA board.

Right, my question is answered at T198176#4724935
I think with that and your additional suggestion of waiting 30 seconds + maxlag of 3 we should be fine. However, it doesn't hurt to do a first manual run to double check? Would you be ok with that?

@Marostegui Unfortunately I'll have to do all this by hand given that the pywiki script fails due to returning an error message which is not an error (T212356). I can find the page with most revisions and coordinate with you to monitor the screens if you're okay with that as well. Thanks.

@Marostegui Unfortunately I'll have to do all this by hand given that the pywiki script fails due to returning an error message which is not an error (T212356). I can find the page with most revisions and coordinate with you to monitor the screens if you're okay with that as well. Thanks.

Sounds good to me - ping me once you've got it so we can arrange a day/time for it

@Marostegui Given that db67de7fad isn't yet live in WMF branches, perhaps we could wait until it is there so we can do it with the bot, notwithstanding the supervision of the ops/dba team to avoid lag, db locks, etc. What do you think?

Sounds good to me!

@Marostegui Given that db67de7fad isn't yet live in WMF branches, perhaps we could wait until it is there so we can do it with the bot, notwithstanding the supervision of the ops/dba team to avoid lag, db locks, etc. What do you think?

I think to we can wait until deployment of db67de7fad.. This is not urgent.

@Marostegui Given that db67de7fad isn't yet live in WMF branches, perhaps we could wait until it is there so we can do it with the bot, notwithstanding the supervision of the ops/dba team to avoid lag, db locks, etc. What do you think?

I think to we can wait until deployment of db67de7fad.. This is not urgent.

I think to this is deployed. I will try to delete pages again which I can. I will update list (https://sr.wikinews.org/wiki/User:MarcoAurelio/ToDel) after it.

I can give this another try.

I can give this another try.

I will tell you when you can try. I will start now.

Okay.

@MarcoAurelio I tryed, but I still have problems. As generator for pages which should be deleted use contributions from user Millbot-Weather. As summary use [[:m:Special:Permalink/18727625#srwikinews-delreq]] ([[:phab:T212346|T212346]]). Thanks!

I see that you're being able to delete some of those pages. Please note that pages with more than one thousand of revisions are not deleted instantly but via a JobQueue job so it can take some time until the deletion happens. I'll check it out later which pages you were not able to delete and try on them.

I see that you're being able to delete some of those pages. Please note that pages with more than one thousand of revisions are not deleted instantly but via a JobQueue job so it can take some time until the deletion happens. I'll check it out later which pages you were not able to delete and try on them.

I deleting categories related to things for which we doing this now. These categories are made by second bot. I will generate new list on your page. I will let you know later when I delete all pages which I can.

Please note that pages with more than one thousand of revisions are not deleted instantly but via a JobQueue job so it can take some time until the deletion happens.

I saw it.

Zoranzoki21 added a comment.EditedFri, Jan 11, 1:32 PM

@MarcoAurelio I generated you new list for first part of deletion. See https://sr.wikinews.org/wiki/Корисник:MarcoAurelio/ToDel

You can start when you feel conform to do it. When you delete all these pages, I will generate new list again. I did not want to exaggerate with a list because of possible crash in browser for loading.

Thank you. I'll try to delete those pages then. To avoid flooding recent changes, do you think I can get a local bot flag at sr.wikinews? Ping @dungodung as one of the local bureaucrats.

Thank you. I'll try to delete those pages then. To avoid flooding recent changes, do you think I can get a local bot flag at sr.wikinews? Ping @dungodung as one of the local bureaucrats.

You will get it. I will ask another bureaucrat to give you it.

I don't see a need for deleting those pages.

I don't see a need for deleting those pages.

Thanks for your comment @dungodung - On meta they said there was a community discussion. Nevertheless, until this is clarified, I'll abstain from deleting anything.

As you can see on [[sr:n:Викивести:Форум]] there was no discussion about this at all. Also, I wouldn't consider a few disparate users that contribute here and there a community...

As you can see on [[sr:n:Викивести:Форум]] there was no discussion about this at all. Also, I wouldn't consider a few disparate users that contribute here and there a community...

There is not active community. You no know what wiki project should be. For you only is importmant number of articles. Ende. Too you no know to say something good for users. When you make mistakes, noone must not tell you something bad to you. When we make mistakes, you are first to shout. @Ranko95, @Novak_Watchmen, @Acamicamacaraca, @MareBG and I were FOR. Perhaps the Wikimedia of Serbia will also introduce "seminar works" there. 😄

Please don't troll here.

Please don't troll here.

Again:

When you make mistakes, noone must not tell you something bad to you. When we make mistakes, you are first to shout.

Zoranzoki21 changed the task status from Open to Stalled.Fri, Jan 11, 5:24 PM

I will start public discussion so..

@Zoranzoki21 and @dungodung, as well as other subscribers- Phabricator is not the place for this kind of discussion- that should go to wiki. As @MarcoAurelio said, no deletion will happen until that happens, and even if some deletion happened already, it can be recovered. Please solve disputes on wiki, and only return to this ticket when a consensus is reached with a decision we can apply.

@Zoranzoki21 and @dungodung, as well as other subscribers- Phabricator is not the place for this kind of discussion- that should go to wiki. As @MarcoAurelio said, no deletion will happen until that happens, and even if some deletion happened already, it can be recovered. Please solve disputes on wiki, and only return to this ticket when a consensus is reached with a decision we can apply.

Okay, I will start public discussion. Until end of discussion, nothing will not be done.

@dungodung, @Zoranzoki21: This tone is not welcome here. Please read https://www.mediawiki.org/wiki/Bug_management/Phabricator_etiquette if you would like to be active on Wikimedia Phabricator. Thank you for keeping this a respectful place.

@dungodung, @Zoranzoki21: This tone is not welcome here. Please read https://www.mediawiki.org/wiki/Bug_management/Phabricator_etiquette if you would like to be active on Wikimedia Phabricator. Thank you for keeping this a respectful place.

@Aklapper Being blocked because of personal attitude... I understand the rules, but I answered the question only.

I started "public discussion": https://sr.wikinews.org/wiki/Викивести:Форум#Дискусија_о_брисању_садржаја_везаног_за_временску_прогнозу

Until now, noone was not opposed 😃. In 7 days we will have proof that I did not do anything on my own.

Zoranzoki21 changed the task status from Stalled to Open.Thu, Jan 17, 2:14 PM

Noone was not opposed, reopening.