Page MenuHomePhabricator
Create Task
Maniphest T194214

Create scripts to run the Commons notification bot on Toolforge
Closed, ResolvedPublic2 Estimated Story Points
Actions

Description

  • Initial run of the bot
  • Periodical runs of the bot
    • Should archive old list files
  • Cleanup of old logs/list files
  • Garbage collection of old DB entries

Related Objects
Search...

Event Timeline

MaxSem created this task.May 8 2018, 9:36 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 8 2018, 9:36 PM
MaxSem added a parent task: T188151: Create the Commons deletion bot which will post messages on article talk pages.May 8 2018, 9:36 PM
• TBolliger moved this task from New & TBD Tickets to Needs Discussion on the Community-Tech board.May 8 2018, 9:56 PM
Niharika subscribed.May 8 2018, 10:27 PM

Why are there list files? Are they gonna be too much to hold in memory? What's the database storing?

MaxSem added a comment.May 8 2018, 10:31 PM

Max number of files for deletion is ~10k tops. The number of them to be notified about at once would be in the dozens. DB is for state, list files are for passing wrk data between the scripts.

Niharika set the point value for this task to 2.May 8 2018, 11:37 PM
• TBolliger moved this task from Needs Discussion to Up Next (June 3-21) on the Community-Tech board.May 8 2018, 11:39 PM
• TBolliger edited projects, added Community-Tech-Sprint; removed Community-Tech.May 8 2018, 11:49 PM
MaxSem claimed this task.May 15 2018, 10:10 PM
MaxSem moved this task from Ready to In Development on the Community-Tech-Sprint board.
MaxSem added a comment.May 16 2018, 3:04 AM

Mostly done in [[ https://github.com/MaxSem/CommonsNotifier/commit/11730fc40bec7e8f74579b4b57e4be2c7b632168 | 11730fc ]].

MaxSem moved this task from In Development to Needs Review/Feedback on the Community-Tech-Sprint board.May 24 2018, 10:42 PM
Niharika added a comment.Jun 11 2018, 6:48 PM
In T194214#4209296, @MaxSem wrote:

Mostly done in [[ https://github.com/MaxSem/CommonsNotifier/commit/11730fc40bec7e8f74579b4b57e4be2c7b632168 | 11730fc ]].

I believe this is merged. Anything left to do here?

MaxSem moved this task from Needs Review/Feedback to In Development on the Community-Tech-Sprint board.Jun 11 2018, 10:54 PM

One thing that was discovered is that listfile archival breaks when there are none.

MaxSem closed this task as Resolved.Jun 14 2018, 2:21 AM
MaxSem moved this task from In Development to Q1 2018-19 on the Community-Tech-Sprint board.

Done. Now, among other things, bin/first-run doesn't break bin/cronjob.

• Vvjjkkii renamed this task from Create scripts to run the Commons notification bot on Toolforge to hcdaaaaaaa.Jul 1 2018, 1:11 AM
• Vvjjkkii reopened this task as Open.
• Vvjjkkii removed MaxSem as the assignee of this task.
• Vvjjkkii triaged this task as High priority.
• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed the point value for this task.
• Vvjjkkii removed a subscriber: Aklapper.
Niharika renamed this task from hcdaaaaaaa to Create scripts to run the Commons notification bot on Toolforge.Jul 1 2018, 4:58 AM
Niharika closed this task as Resolved.
Niharika assigned this task to MaxSem.
Niharika lowered the priority of this task from High to Medium.
Niharika removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
Niharika updated the task description. (Show Details)
Niharika set the point value for this task to 2.
Niharika added a subscriber: Aklapper.
Niharika moved this task from Q1 2018-19 to Archive on the Community-Tech-Sprint board.Jul 3 2018, 7:36 PM
Niharika edited projects, added Community-Tech; removed Community-Tech-Sprint.Jul 9 2018, 5:30 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits