Page MenuHomePhabricator

Create archive procedure for scripts
Closed, ResolvedPublic

Description

As discussed in T221801 (https://etherpad.wikimedia.org/p/hackathon-2019-pywikibot), there are so many scripts noone uses (anymore).

The following strategy was proposed and was supported by the participants:

  • Let anyone suggest a script to be deprecated (perhaps as a subtask of this?)
    • these scripts can no longer be needed, are not used (read it from WMF logs would be awesome), or never worked properly, perhaps are too specific.
    • don't forget non-WMF wikis can still use scripts WMF wikis don't need anymore.
    • also don't forget there are scripts, which are not used much, but once in a while you really appreciate their existence
    • finally please avoid author blindness. If you created a script, but it is not used, it should not be in the library
  • If the reason does make sense, move the script to archive folder and set the deprecation note in it:
    • There are concerns the script is not needed and if noone speaks up, it will be removed from framework in xx/yy/zz (year after).
  • If noone speaks up/protests in the year, remove the script completely.

(please improve if I misunderstood something)

Active scripts in scripts folder (Please mark it with [x] if you need it)

  • add_text.py
  • archivebot.py
  • basic.py
  • blockpageschecker.py
  • capitalize_redirects.py
  • casechecker.py
  • catall.py
  • category.py
  • checkimages.py
  • claimit.py
  • clean_sandbox.py
  • commonscat.py
  • commons_link.py
  • coordinate_import.py
  • cosmetic_changes.py
  • create_categories.py
  • data_ingestion.py
  • delete.py
  • disambredir.py
  • djvutext.py
  • editarticle.py
  • fixing_redirects.py
  • flickrripper.py
  • followlive.py
  • freebasemappingupload.py
  • harvest_template.py
  • illustrate_wikidata.py
  • image.py
  • imagecopy.py
  • imagecopy_self.py
  • imageharvest.py
  • imagerecat.py
  • imagetransfer.py
  • imageuncat.py
  • interwiki.py
  • interwikidata.py
  • isbn.py
  • listpages.py
  • login.py
  • lonelypages.py
  • makecat.py
  • match_images.py
  • misspelling.py
  • movepages.py
  • ndashredir.py
  • newitem.py
  • noreferences.py
  • nowcommons.py
  • pagefromfile.py
  • patrol.py
  • piper.py
  • protect.py
  • redirect.py
  • reflinks.py
  • replace.py
  • replicate_wiki.py
  • revertbot.py
  • selflink.py
  • shell.py
  • solve_disambiguation.py
  • spamremove.py
  • standardize_interwiki.py
  • states_redirect.py
  • surnames_redirects.py
  • table2wiki.py
  • template.py
  • templatecount.py
  • touch.py
  • transferbot.py
  • unlink.py
  • unusedfiles.py
  • upload.py
  • version.py
  • watchlist.py
  • weblinkchecker.py
  • welcome.py
  • wikisourcetext.py

Archived:

  • cfd.py

Related Objects

Event Timeline

I added the complete scripts list. All needed scripts can be marked with [x] here. Unmarked scripts may be archived probably but they don't need further development currently.

(no need to list wanted scripts, if someone speaks up, we can just revert its deprecation and missing scripts are a different task)

My most frequently used scripts:

  • category.py
    • Used by my bot via a rewrite of cfd.py.
    • If no one else uses this (or I get around to implementing multiple merge targets), I'll write my own without many of the complexities.
  • delete.py
  • movepages.py
  • template.py
  • touch.py
  • category.py
    • Used by my bot via a rewrite of cfd.py.
    • If no one else uses this (or I get around to implementing multiple merge targets), I'll write my own without many of the complexities.

My most used scripts are replace.py, basic.py (as a template) and category.py.

If you have some rewritten cfd.py, which works better than currently not even working Pywikibot's cfd.py, please share it with Pywikibot! :)

If you have some rewritten cfd.py, which works better than currently not even working Pywikibot's cfd.py, please share it with Pywikibot! :)

My script is here. I don't think it'll fix the issues that you have with cfd.py though.

JAnD added a subscriber: JAnD.

So many scripts not marked, this is something we should solve

Change 609468 had a related patch set uploaded (by JJMC89; owner: JJMC89):
[pywikibot/core@master] Archive scripts/cfd.py

https://gerrit.wikimedia.org/r/609468

Change 609468 merged by jenkins-bot:
[pywikibot/core@master] Archive scripts/cfd.py

https://gerrit.wikimedia.org/r/609468

Xqt updated the task description. (Show Details)

I propose archiving all unmarked scripts and removing all already archived scripts for 6.0 (T269066: Pywikibot release 6.0 dependencies).

Change 660644 had a related patch set uploaded (by JJMC89; owner: JJMC89):
[pywikibot/core@master] [6.0] Archive unused scripts and remove already archived scripts

https://gerrit.wikimedia.org/r/660644

@Xqt and @JJMC89: Is it possible to keep weblinkchecker.py and protect.py too?

I have just read the mail from Monday about the new Pywikibot-Release 6.0

Best regards
Udo T.

@Xqt and @JJMC89: Is it possible to keep weblinkchecker.py and protect.py too?

Sure, that was one of my Intention of that mail.

Xqt claimed this task.

Change 660644 merged by jenkins-bot:
[pywikibot/core@master] [6.0] Archive unused scripts and remove already archived scripts

https://gerrit.wikimedia.org/r/660644

Change 665473 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [tests] Remove tests/archive from pytest

https://gerrit.wikimedia.org/r/665473

Change 665473 merged by jenkins-bot:
[pywikibot/core@master] [tests] Remove tests/archive from pytest

https://gerrit.wikimedia.org/r/665473

Change 665638 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [cleanup] remove interwikidumps.py

https://gerrit.wikimedia.org/r/665638

Change 665641 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [tests] Update TestPwb test_similar_scripts_found

https://gerrit.wikimedia.org/r/665641

Change 665643 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [cleanup] remove interwiki config settings

https://gerrit.wikimedia.org/r/665643

Change 665638 merged by jenkins-bot:
[pywikibot/core@master] [cleanup] remove interwikidumps.py

https://gerrit.wikimedia.org/r/665638

Change 665641 merged by jenkins-bot:
[pywikibot/core@master] [tests] Update TestPwb test_similar_scripts_found

https://gerrit.wikimedia.org/r/665641

Change 665643 merged by jenkins-bot:
[pywikibot/core@master] [cleanup] remove interwiki config settings

https://gerrit.wikimedia.org/r/665643

Change 665647 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [cleanup] remove config settings of archived scripts

https://gerrit.wikimedia.org/r/665647

Change 665650 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [cleanup] remove interwiki_graph.py

https://gerrit.wikimedia.org/r/665650

Change 665647 merged by jenkins-bot:
[pywikibot/core@master] [cleanup] remove config settings of archived scripts

https://gerrit.wikimedia.org/r/665647

Change 665653 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [deps] Update scrips dependencies

https://gerrit.wikimedia.org/r/665653

Change 665650 merged by jenkins-bot:
[pywikibot/core@master] [cleanup] remove interwiki_graph.py

https://gerrit.wikimedia.org/r/665650

Change 665653 merged by jenkins-bot:
[pywikibot/core@master] [deps] Update scrips dependencies

https://gerrit.wikimedia.org/r/665653

Change 666179 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/i18n@master] [6.0] Remove pywikibot-featured messages

https://gerrit.wikimedia.org/r/666179

Change 666179 merged by jenkins-bot:
[pywikibot/i18n@master] [6.0] Remove pywikibot-featured messages

https://gerrit.wikimedia.org/r/666179

can we get reflinks.py back, please? noreferences and weblinkchecker are unarchived, so, no other dependencies for reflinks

can we get reflinks.py back, please? noreferences and weblinkchecker are unarchived, so, no other dependencies for reflinks

Sorry, haven't overseen your comment. It's ok to re-open a task or file a new one for such a case. Sure it will be restored. Thanks for using Pywikibot.

Change 669349 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [scripts] Restore reflinks.py

https://gerrit.wikimedia.org/r/669349

Change 669349 merged by jenkins-bot:
[pywikibot/core@master] [scripts] Restore reflinks.py

https://gerrit.wikimedia.org/r/669349

just noting that all the archived files need to have their git repository links updated at mediawikiwiki

I will look to do that in the next couple of days