Page MenuHomePhabricator
Create Task
Maniphest T183663

Improve the maintenance script that download Wikimedia database dump
Open, MediumPublic
Actions

Description

After T123885: Create a Python Pywikibot script to download Wikimedia database dump, a minimum script exists. We can now improve it.

Related Objects
Search...

Event Timeline

Framawiki created this task.Dec 24 2017, 4:32 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 24 2017, 4:32 PM
Framawiki added projects: Pywikibot, Pywikibot-Scripts.Dec 24 2017, 4:56 PM
Framawiki added a subscriber: eflyjason.
Restricted Application added a subscriber: pywikibot-bugs-list. · View Herald TranscriptDec 24 2017, 4:56 PM
Framawiki moved this task from Proposed tasks to Organizational on the Google-Code-in-2017 board.Dec 24 2017, 5:06 PM
Framawiki closed subtask T183668: download_dump.py: Use symlink instead of a copy for toolforge users as Resolved.Dec 26 2017, 8:43 AM
eflyjason closed subtask T183666: download_dump.py: Use response.iter_content as Resolved.Dec 27 2017, 12:47 AM
Ryan10145 closed subtask T183675: download_dump.py: Make download process atomic as Resolved.Dec 31 2017, 2:11 AM
zhuyifei1999 added subtasks: T184033: download_dump.py: Move the file location from `scripts/maintenance` to `scripts`, T184035: download_dump.py: Rename `revision` term in the script, T183789: download_dump.py: Support for "date specified" dumps, T184032: download_dump: Handle exception in `get_dump_name()` if there's a folder that contains not number string.Jan 3 2018, 6:03 AM
Aklapper moved this task from Organizational to Proposed tasks on the Google-Code-in-2017 board.Jan 3 2018, 4:05 PM
jayvdb added a comment.Jan 4 2018, 4:10 AM

No more tasks for this script should be created, as it currently untested, and mostly untestable by design.
It is not acceptable to be having students doing tasks which are not tested. The result is low quality work, and a poor educational experience for the students.
We should be increasing test coverage, not decreasing it.

See https://phabricator.wikimedia.org/T184033#3870750 . @Xqt is blocking the initial fix for this.

Framawiki closed subtask T184035: download_dump.py: Rename `revision` term in the script as Resolved.Jan 4 2018, 6:25 PM
Framawiki closed subtask T183664: download_dump.py: Add a progress bar as Resolved.Jan 5 2018, 7:31 PM
Framawiki removed a project: Google-Code-in-2017.Jan 5 2018, 7:45 PM

Thanks for your useful opinion @jayvdb , some remarkable work has already been done, and there are no more tasks available on GCI site, all was mark as done, but there are still a few patches to review.

Dvorapa reopened subtask T184035: download_dump.py: Rename `revision` term in the script as Open.May 20 2018, 8:14 PM
Dvorapa closed subtask T184035: download_dump.py: Rename `revision` term in the script as Resolved.May 23 2018, 1:30 AM
Xqt closed subtask T184032: download_dump: Handle exception in `get_dump_name()` if there's a folder that contains not number string as Resolved.Feb 6 2019, 4:09 PM
Xqt closed subtask T184033: download_dump.py: Move the file location from `scripts/maintenance` to `scripts` as Resolved.Aug 6 2020, 4:59 PM
rafidaslam closed subtask T183789: download_dump.py: Support for "date specified" dumps as Resolved.Oct 28 2020, 2:58 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL