Hydriz (Hydriz Scholz)
Developer and archivist

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Nov 15 2014, 12:47 PM (123 w, 2 d)
Availability
Available
IRC Nick
Hydriz
LDAP User
Hydriz
MediaWiki User
Hydriz

Hi, I am a developer and a data archivist for the Wikimedia datasets. I am the main volunteer-in-charge of data preservation of Wikimedia wikis onto Archive.org, working as a collections administrator there as well.

In the future, I will be working on statistics and data analytics, along with security of information systems.

My user project is here: User-Hydriz

Recent Activity

Yesterday

Hydriz committed rTBALfb498d825718: Delete the last file downloaded as it is likely to be corrupted (authored by Hydriz).
Delete the last file downloaded as it is likely to be corrupted
Sun, Mar 26, 2:12 PM
Hydriz committed rTBAL62d939a88908: Archive dumpstatus.json if the dump date is 20170320 or later (authored by Hydriz).
Archive dumpstatus.json if the dump date is 20170320 or later
Sun, Mar 26, 1:13 PM
Hydriz committed rTBAL2e67e09cb1e8: Fix an issue which makes it unable to update the database (authored by Hydriz).
Fix an issue which makes it unable to update the database
Sun, Mar 26, 1:02 PM

Sat, Mar 25

Hydriz committed rTBAL65ffa2d4ba67: Archive additional dumpstatus.json file (authored by Hydriz).
Archive additional dumpstatus.json file
Sat, Mar 25, 3:39 AM

Tue, Mar 21

Hydriz added a project to T155103: Create a truthy nt dump: User-Hydriz.
Tue, Mar 21, 4:19 AM · User-Hydriz, Dumps-Generation, Wikidata
Hydriz added a project to T129026: How much of our dumps infrastructure must be easily useable by third parties?: User-Hydriz.
Tue, Mar 21, 4:17 AM · User-Hydriz, Dumps-Rewrite

Sun, Mar 19

Hydriz committed rTBALc1a553563611: Store downloaded files in a date-based temporary directory (authored by Hydriz).
Store downloaded files in a date-based temporary directory
Sun, Mar 19, 10:16 AM

Sat, Mar 18

Hydriz committed rTBALe19f827f443e: Make top1000 file optional when archiving (authored by Hydriz).
Make top1000 file optional when archiving
Sat, Mar 18, 1:17 PM

Mon, Mar 13

Hydriz committed rTBAL0d792e0e1c69: Return True when all the processing is complete (authored by Hydriz).
Return True when all the processing is complete
Mon, Mar 13, 3:40 AM

Fri, Mar 10

Hydriz committed rTBALda8ace1603df: Add missing break line which resulted in an endless loop (authored by Hydriz).
Add missing break line which resulted in an endless loop
Fri, Mar 10, 2:40 PM

Thu, Mar 9

Hydriz committed rTBALaf7e7e8fa77b: Add support for CirrusSearch and Content Translation modules (authored by Hydriz).
Add support for CirrusSearch and Content Translation modules
Thu, Mar 9, 7:03 AM
Hydriz committed rTBAL5776967d4312: Pass verbose and debug arguments to BALArchiver (authored by Hydriz).
Pass verbose and debug arguments to BALArchiver
Thu, Mar 9, 7:03 AM

Wed, Mar 8

Hydriz created T159930: Create custom instance flavor for Dumps project.
Wed, Mar 8, 10:48 AM · User-Hydriz, Labs

Mon, Mar 6

Hydriz added a comment to T159068: Request creation of Wikimedia Incubator labs project.

Awesome. As always, health over work. Thanks for your help!

Mon, Mar 6, 3:02 PM · Labs

Sat, Mar 4

Hydriz committed rTBAL6a081ed348bb: Update copyright year to 2017 (authored by Hydriz).
Update copyright year to 2017
Sat, Mar 4, 8:13 AM

Thu, Mar 2

GitHub <noreply@github.com> committed rTBAL3be6a90c5d9f: Refactor the codebase to improve code quality (#7) (authored by Hydriz).
Refactor the codebase to improve code quality (#7)
Thu, Mar 2, 12:51 PM
GitHub <noreply@github.com> committed rTBAL7fcf0c3e5b48: Merge fc3d4b37dc04b271e27a97ebd098d7833f8f9a06 into… (authored by Hydriz).
Merge fc3d4b37dc04b271e27a97ebd098d7833f8f9a06 into…
Thu, Mar 2, 12:14 PM
Hydriz committed rTBALfc3d4b37dc04: Invoke an instance of BALConverter (authored by Hydriz).
Invoke an instance of BALConverter
Thu, Mar 2, 12:14 PM
GitHub <noreply@github.com> committed rTBALe38d7da24d71: Merge eb1e08b60ff2c70c01202e281a1a4037df6b16f6 into… (authored by Hydriz).
Merge eb1e08b60ff2c70c01202e281a1a4037df6b16f6 into…
Thu, Mar 2, 10:54 AM
GitHub <noreply@github.com> committed rTBALeb1e08b60ff2: Merge branch 'master' into refactor (authored by Hydriz).
Merge branch 'master' into refactor
Thu, Mar 2, 10:54 AM
Hydriz committed rTBAL61a4c69c7829: Minor fixes to certain functions to get them working (authored by Hydriz).
Minor fixes to certain functions to get them working
Thu, Mar 2, 10:54 AM
Hydriz committed rTBAL37c7df8372d3: Manually merge changes from master (authored by Hydriz).
Manually merge changes from master
Thu, Mar 2, 10:54 AM

Tue, Feb 28

Hydriz committed rTBALb5402c6b1677: Remove unsupported keyword argument (authored by Hydriz).
Remove unsupported keyword argument
Tue, Feb 28, 4:10 AM
Hydriz committed rTBAL6f38d02dfe20: Update function to latest internetarchive python library format (authored by Hydriz).
Update function to latest internetarchive python library format
Tue, Feb 28, 2:58 AM
Hydriz added a comment to T159068: Request creation of Wikimedia Incubator labs project.

Apologies. If Parsoid can run behind the webproxy then I am fine with not having a public IP. Thanks for your help!

Tue, Feb 28, 2:26 AM · Labs

Sun, Feb 26

Hydriz edited the description of T159068: Request creation of Wikimedia Incubator labs project.
Sun, Feb 26, 10:52 AM · Labs
Hydriz created T159068: Request creation of Wikimedia Incubator labs project.
Sun, Feb 26, 10:49 AM · Labs

Feb 18 2017

Hydriz committed rTBAL329c39a75bca: Update item title and description to show that there are TTL dumps (authored by Hydriz).
Update item title and description to show that there are TTL dumps
Feb 18 2017, 8:44 AM

Feb 16 2017

Hydriz added a project to T117023: Auto-generated infopages incorrectly links to the current page for Wikipedia: User-Hydriz.

I will have a look at this and see what I can do.

Feb 16 2017, 11:30 PM · User-Hydriz, MediaWiki-extensions-WikimediaIncubator

Jan 30 2017

Hydriz added a comment to T147177: An API for monitoring dumps of WMF wikis.

Quite glad that the proposed idea is largely based on my recommendations, I am humbled. :D

Jan 30 2017, 12:05 PM · Patch-For-Review, User-Hydriz, Dumps-Rewrite, Wikimedia-Developer-Summit (2017)

Dec 9 2016

Hydriz added a watcher for MediaWiki-extensions-HostStats: Hydriz.
Dec 9 2016, 2:11 PM

Nov 14 2016

Hydriz created MediaWiki-extensions-HostStats.
Nov 14 2016, 5:18 AM
Hydriz added a member for WikiApiary: Hydriz.
Nov 14 2016, 5:14 AM

Nov 13 2016

Hydriz moved T150596: OATHAuth extension should declare the issuer name when setting up 2FA from Review/Feedback to Done on the User-Hydriz board.
Nov 13 2016, 7:35 AM · MW-1.29-release (WMF-deploy-2016-11-15_(1.29.0-wmf.3)), Patch-For-Review, User-Hydriz, Easy, MediaWiki-extensions-OATHAuth
Hydriz moved T150596: OATHAuth extension should declare the issuer name when setting up 2FA from Backlog to Review/Feedback on the User-Hydriz board.
Nov 13 2016, 4:10 AM · MW-1.29-release (WMF-deploy-2016-11-15_(1.29.0-wmf.3)), Patch-For-Review, User-Hydriz, Easy, MediaWiki-extensions-OATHAuth
Hydriz created T150596: OATHAuth extension should declare the issuer name when setting up 2FA.
Nov 13 2016, 3:23 AM · MW-1.29-release (WMF-deploy-2016-11-15_(1.29.0-wmf.3)), Patch-For-Review, User-Hydriz, Easy, MediaWiki-extensions-OATHAuth

Oct 31 2016

Hydriz raised the priority of T134148: Dumps instances occasionally hammer NFS for temporary storage from "Normal" to "High".

Changing task priority, feel free to revert if you disagree.

Oct 31 2016, 6:04 AM · User-Hydriz, Labs
Hydriz updated subscribers of T134148: Dumps instances occasionally hammer NFS for temporary storage.

This issue has happened again today (and I was notified about it).

Oct 31 2016, 6:03 AM · User-Hydriz, Labs

Oct 27 2016

Hydriz renamed E313: MediaWiki Version 1.28.0 from MedaiWiki Version 1.28.0 to MediaWiki Version 1.28.0.
Oct 27 2016, 1:13 PM

Oct 25 2016

Hydriz set the image for Datasets-Archiving to F4657966: profile.
Oct 25 2016, 6:36 AM
GitHub <noreply@github.com> committed rTBALe2af75032727: Merge bc1ef72222b8612f6fd23ceb247008c733759612 into… (authored by Hydriz).
Merge bc1ef72222b8612f6fd23ceb247008c733759612 into…
Oct 25 2016, 2:34 AM
Hydriz committed rTBALbc1ef72222b8: Move dump directory checking into core (authored by Hydriz).
Move dump directory checking into core
Oct 25 2016, 2:34 AM
GitHub <noreply@github.com> committed rTBAL9e5d8a10df4b: Merge 7a4c26c8b2cc19cbe9840887e2595339331e7b30 into… (authored by Hydriz).
Merge 7a4c26c8b2cc19cbe9840887e2595339331e7b30 into…
Oct 25 2016, 1:49 AM
Hydriz committed rTBAL7a4c26c8b2cc: Use getConds in core (authored by Hydriz).
Use getConds in core
Oct 25 2016, 1:49 AM
Hydriz committed rTBAL5eac3207e841: Fix missing and unused imports (authored by Hydriz).
Fix missing and unused imports
Oct 25 2016, 1:33 AM
GitHub <noreply@github.com> committed rTBAL3609813971dd: Merge 5eac3207e841298b05611f32a9cf3d6c2d9b5455 into… (authored by Hydriz).
Merge 5eac3207e841298b05611f32a9cf3d6c2d9b5455 into…
Oct 25 2016, 1:33 AM
GitHub <noreply@github.com> committed rTBALbb18ea233e40: Merge 23f60e0535f087da55386f57e83f473d43a2331e into… (authored by Hydriz).
Merge 23f60e0535f087da55386f57e83f473d43a2331e into…
Oct 25 2016, 1:16 AM
Hydriz committed rTBAL23f60e0535f0: Move item claiming into core (authored by Hydriz).
Move item claiming into core
Oct 25 2016, 1:16 AM
Hydriz committed rTBAL756791ef6910: Move downloadFiles function into core (authored by Hydriz).
Move downloadFiles function into core
Oct 25 2016, 12:37 AM
GitHub <noreply@github.com> committed rTBAL82234a2f7d0c: Merge 756791ef6910d0f462c063a681639e54b77fff69 into… (authored by Hydriz).
Merge 756791ef6910d0f462c063a681639e54b77fff69 into…
Oct 25 2016, 12:37 AM
GitHub <noreply@github.com> committed rTBAL260f4030cb01: Merge bd72567da6b60684f8aa119e02e19095e4f9bf76 into… (authored by Hydriz).
Merge bd72567da6b60684f8aa119e02e19095e4f9bf76 into…
Oct 25 2016, 12:13 AM
Hydriz committed rTBALbd72567da6b6: Fix imports in previous commit (authored by Hydriz).
Fix imports in previous commit
Oct 25 2016, 12:13 AM
Hydriz committed rTBAL3fc3d1ec6c65: Move extractLinks function into core (authored by Hydriz).
Move extractLinks function into core
Oct 25 2016, 12:13 AM

Oct 24 2016

GitHub <noreply@github.com> committed rTBAL1788ff3b80cd: Merge fa93a3361f50642e017eec9504560aba0e4f6fd9 into… (authored by Hydriz).
Merge fa93a3361f50642e017eec9504560aba0e4f6fd9 into…
Oct 24 2016, 11:57 PM
Hydriz committed rTBALfa93a3361f50: Add classmethod and staticmethod attributes to public functions (authored by Hydriz).
Add classmethod and staticmethod attributes to public functions
Oct 24 2016, 11:57 PM
GitHub <noreply@github.com> committed rTBAL0881ba17a170: Merge f60cc061f7384c3a4bd00cac1d878e9a5f5c4597 into… (authored by Hydriz).
Merge f60cc061f7384c3a4bd00cac1d878e9a5f5c4597 into…
Oct 24 2016, 1:29 PM
Hydriz committed rTBALf60cc061f738: Place variables outside of __init__ function (authored by Hydriz).
Place variables outside of __init__ function
Oct 24 2016, 1:29 PM
GitHub <noreply@github.com> committed rTBALbb3899dec290: Merge 663107dca2df6772ead34a6a9f85de985828bb12 into… (authored by Hydriz).
Merge 663107dca2df6772ead34a6a9f85de985828bb12 into…
Oct 24 2016, 1:01 PM
Hydriz committed rTBAL663107dca2df: Separate update function into various smaller functions (authored by Hydriz).
Separate update function into various smaller functions
Oct 24 2016, 1:01 PM
GitHub <noreply@github.com> committed rTBAL21bdb96f6276: Merge 007f4a11b799cc5ef24883e9807403275cad2402 into… (authored by Hydriz).
Merge 007f4a11b799cc5ef24883e9807403275cad2402 into…
Oct 24 2016, 12:35 PM
Hydriz committed rTBAL007f4a11b799: Create new function to generate list of files to actually upload (authored by Hydriz).
Create new function to generate list of files to actually upload
Oct 24 2016, 12:35 PM
GitHub <noreply@github.com> committed rTBALcb6d1f98b08a: Merge ada69ce18dade03c93c31260c4b09238b917359a into… (authored by Hydriz).
Merge ada69ce18dade03c93c31260c4b09238b917359a into…
Oct 24 2016, 12:18 PM
Hydriz committed rTBALada69ce18dad: Separate the various steps into different functions (authored by Hydriz).
Separate the various steps into different functions
Oct 24 2016, 12:18 PM
GitHub <noreply@github.com> committed rTBAL530d9a76f679: Merge a05ab44394a80bdace615bfd183e8e555d9f18ca into… (authored by Hydriz).
Merge a05ab44394a80bdace615bfd183e8e555d9f18ca into…
Oct 24 2016, 11:55 AM
Hydriz committed rTBALa05ab44394a8: Some additional fixes (authored by Hydriz).
Some additional fixes
Oct 24 2016, 11:55 AM
GitHub <noreply@github.com> committed rTBALa5fd8dc372d0: Merge 94e605f8dec11bd31c98d0a97f146493010bc439 into… (authored by Hydriz).
Merge 94e605f8dec11bd31c98d0a97f146493010bc439 into…
Oct 24 2016, 11:48 AM
Hydriz committed rTBAL94e605f8dec1: Extract upload function into BALArchiver and separate metadata (authored by Hydriz).
Extract upload function into BALArchiver and separate metadata
Oct 24 2016, 11:48 AM
GitHub <noreply@github.com> committed rTBAL02bc53246911: Merge ef98652f0932eed844bdc3d4172dbde1e52e9802 into… (authored by Hydriz).
Merge ef98652f0932eed844bdc3d4172dbde1e52e9802 into…
Oct 24 2016, 11:09 AM
Hydriz committed rTBALef98652f0932: Separate exception handling into a separate function (authored by Hydriz).
Separate exception handling into a separate function
Oct 24 2016, 11:09 AM
GitHub <noreply@github.com> committed rTBALf28b2376232d: Merge 554a0b0c79bca93add938935301148b6725ea31b into… (authored by Hydriz).
Merge 554a0b0c79bca93add938935301148b6725ea31b into…
Oct 24 2016, 9:39 AM
Hydriz committed rTBAL554a0b0c79bc: Separate argument parsing into a separate function (authored by Hydriz).
Separate argument parsing into a separate function
Oct 24 2016, 9:39 AM
Hydriz committed rTBAL8d03a6b346f7: Re-add missing hostname variable (authored by Hydriz).
Re-add missing hostname variable
Oct 24 2016, 9:39 AM
Hydriz committed rTBAL6f5c96597721: Update code to be compatible with internetarchive > 0.9.8 (authored by Hydriz).
Update code to be compatible with internetarchive > 0.9.8
Oct 24 2016, 9:39 AM
Hydriz committed rTBALdc0563c96c62: Allow the argparse function to be called directly (authored by Hydriz).
Allow the argparse function to be called directly
Oct 24 2016, 9:39 AM
Hydriz committed rTBALc12896478478: Create new classmethod for initializing BALSqlDb instance (authored by Hydriz).
Create new classmethod for initializing BALSqlDb instance
Oct 24 2016, 9:39 AM

Oct 15 2016

Hydriz added a hashtag to Datasets-General-or-Unknown: wikimedia-xml-dumps.
Oct 15 2016, 12:51 PM
Hydriz changed hashtags for Datasets-General-or-Unknown, added wikimedia-xml-dumps, wikimedia-datasets; removed Wikimedia-XML-dumps.
Oct 15 2016, 12:50 PM
Hydriz closed T146347: Dumps not transferring to labs as "Invalid".

Nothing we can do here. Dumps for October 2016 is transferring fine as far as I can see.

Oct 15 2016, 11:05 AM · Datasets-General-or-Unknown
Hydriz edited projects for T144894: MediaWiki:Lastmodifiedat should mention time zone, added: MediaWiki-Interface; removed LastModified.

Not part of the LastModified extension, but rather it is a MediaWiki core issue.

Oct 15 2016, 11:00 AM · MediaWiki-Interface
Hydriz moved T63608: LastModified should pass jshint from Backlog to Completed on the LastModified board.
Oct 15 2016, 10:57 AM · Patch-For-Review, LastModified
Hydriz closed T43417: LastModified should not be displayed while creating a non-existent page as "Resolved".

Was already fixed with rELMO2ea90a47cdfe6ea89a86b35011d464f358f05ccc

Oct 15 2016, 10:57 AM · LastModified
Hydriz moved T147177: An API for monitoring dumps of WMF wikis from Backlog to Review/Feedback on the User-Hydriz board.
Oct 15 2016, 10:51 AM · Patch-For-Review, User-Hydriz, Dumps-Rewrite, Wikimedia-Developer-Summit (2017)
Hydriz added a project to T147177: An API for monitoring dumps of WMF wikis: User-Hydriz.
Oct 15 2016, 10:51 AM · Patch-For-Review, User-Hydriz, Dumps-Rewrite, Wikimedia-Developer-Summit (2017)
Hydriz moved T147593: Facilitate Wikidev'17 main topic "Building on Wikimedia services: APIs and Developer Resources" from Backlog to Review/Feedback on the User-Hydriz board.
Oct 15 2016, 10:44 AM · User-Hydriz, User-Nikerabbit, Wikimedia-Developer-Summit
Hydriz added a project to T147593: Facilitate Wikidev'17 main topic "Building on Wikimedia services: APIs and Developer Resources": User-Hydriz.
Oct 15 2016, 10:43 AM · User-Hydriz, User-Nikerabbit, Wikimedia-Developer-Summit
Hydriz added a comment to T147593: Facilitate Wikidev'17 main topic "Building on Wikimedia services: APIs and Developer Resources".

@RobLa-WMF This topic seems too broad for me to facilitate discussions on, as I am only focusing on the Wikimedia dumps at the moment. Nonetheless, I am available to help if the need arises. :)

Oct 15 2016, 10:42 AM · User-Hydriz, User-Nikerabbit, Wikimedia-Developer-Summit
Hydriz added a member for Project-Admins: Hydriz.
Oct 15 2016, 2:22 AM

Oct 14 2016

Hydriz closed T138883: bugs.wmflabs: bad gateway bugzilla.wmflabs: can't connect to db as "Resolved".

http://bugs.wmflabs.org should be used, and that error is now resolved so it is usable now.

Oct 14 2016, 3:39 PM · Wikimedia-Bugzilla, Labs-project-other
Hydriz added a comment to T706: Requests for addition to the #acl*Project-Admins group (in comments).

I am working on the Wikimedia dumps (such as Datasets-Archiving and Dumps-Generation) and would be great to have project-creation rights so that I can create subprojects and milestones during the course of my work. Thanks!

Oct 14 2016, 3:29 PM · Project-Admins
Hydriz added a comment to T147177: An API for monitoring dumps of WMF wikis.

Kickstarting the discussion based on some notes I have when I was planning for T92966.

Oct 14 2016, 1:42 PM · Patch-For-Review, User-Hydriz, Dumps-Rewrite, Wikimedia-Developer-Summit (2017)

Sep 28 2016

Hydriz added a comment to T146797: Link modification during import process for new wikis should simplify redundantly piped links.

This functionality is something that we do manually when we export the pages from the Wikimedia Incubator. Have a look at our handbook on the steps that we take when a new wiki is created.

Sep 28 2016, 3:19 AM · MediaWiki-extensions-WikimediaIncubator, MediaWiki-Export-or-Import

Aug 27 2016

Hydriz added a project to T134148: Dumps instances occasionally hammer NFS for temporary storage: User-Hydriz.
Aug 27 2016, 4:29 AM · User-Hydriz, Labs

Aug 16 2016

Hydriz triaged T139791: Flow: Handle missing content when dumping as "High" priority.

Is there any progress on this? The past few dumps of testwiki has been failing since dumping of Flow data was introduced.

Aug 16 2016, 11:21 AM · Collaboration-Team-Triage, Dumps-Generation, Flow

Aug 8 2016

Hydriz added a project to T133547: set up automated HTML (restbase) dumps on francium: Datasets-Archiving.
Aug 8 2016, 1:41 PM · Services (next), Patch-For-Review, Datasets-Archiving, Dumps-Generation

Jul 3 2016

Hydriz moved T122864: Mediacounts missing top1000 files after 2016-01-01: rsync fails from Incoming to Done on the Datasets-Archiving board.
Jul 3 2016, 10:28 AM · Analytics-Kanban, Datasets-Webstatscollector, Datasets-Archiving, Analytics-Cluster
Hydriz moved T119511: Publish recurring Flow dumps at http://dumps.wikimedia.org/ from Incoming to Done on the Datasets-Archiving board.
Jul 3 2016, 10:27 AM · Collab-Team-2016-Apr-Jun-Q4, Datasets-Archiving, MW-1.27-release (WMF-deploy-2016-01-19_(1.27.0-wmf.11)), Blocked-on-Operations, Dumps-Generation, Flow

Jul 2 2016

Hydriz added a hashtag to User-Hydriz: hydriz.
Jul 2 2016, 2:39 PM
Hydriz added a watcher for User-Hydriz: Hydriz.
Jul 2 2016, 2:33 PM
Hydriz added a subtask for T139225: Create User-Hydriz project: T555: Per-user projects for personal work in progress tracking.
Jul 2 2016, 4:39 AM · User-Luke081515, Project-Admins
Hydriz added a parent task for T555: Per-user projects for personal work in progress tracking: T139225: Create User-Hydriz project.
Jul 2 2016, 4:39 AM · Upstream, Phabricator (Upstream)