Page MenuHomePhabricator
Create Task
Maniphest T202528

Mass upload of person data
Closed, DuplicatePublic
Actions

Description

After T202396 has been done and we've got about 60,000 items with Libris URI's, we can add other information from the database (birthdates, nationalities etc).

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedAlicia_Fagerving_WMSET202527 Process and upload the Libris authorities database
 DuplicateAlicia_Fagerving_WMSET202528 Mass upload of person data
 ResolvedAlicia_Fagerving_WMSET202400 Introduce accuracy check for dates
 ResolvedAlicia_Fagerving_WMSET202534 Map people's professions
 ResolvedAlicia_Fagerving_WMSET202538 Map any extra external identifiers
 DuplicateAlicia_Fagerving_WMSET202609 Collect statistics about the full authority data upload.
 ResolvedAlicia_Fagerving_WMSET202882 Implement adding surname
 ResolvedAlicia_Fagerving_WMSET204343 Save unmatched surnames to report
 ResolvedAlicia_Fagerving_WMSET205276 Optimize querying for surname
 DeclinedNoneT206600 Move cache handling to WikidataItem
 ResolvedAlicia_Fagerving_WMSET203370 Map people's nationalities
 ResolvedAlicia_Fagerving_WMSET203380 Add descriptions
 ResolvedAlicia_Fagerving_WMSET203633 Add profession to WD item
 ResolvedAlicia_Fagerving_WMSET203634 Add nationality to WD item
 ResolvedAlicia_Fagerving_WMSET203636 Add P31 = Q5 to WD item
 ResolvedAlicia_Fagerving_WMSET203639 Test upload of person data
 ResolvedAlicia_Fagerving_WMSET203640 Add VIAF and ISNI numbers
 ResolvedAlicia_Fagerving_WMSET203748 Add labels
 ResolvedAlicia_Fagerving_WMSET204472 Post bot request for mass upload of person data
 ResolvedAlicia_Fagerving_WMSET207625 Update mapping information
 ResolvedAlicia_Fagerving_WMSET205278 Implement adding first name
 ResolvedAlicia_Fagerving_WMSET205374 Process variations of life span years
 ResolvedAlicia_Fagerving_WMSET205373 Handle single dates erroneously in life span field
 ResolvedAlicia_Fagerving_WMSET205372 Handle death-only life spans
 ResolvedAlicia_Fagerving_WMSET205371 Handle malformed hyphens in life years
 ResolvedAlicia_Fagerving_WMSET205375 Handle birth year not using hyphen format
 ResolvedAlicia_Fagerving_WMSET205613 Exclude lifespans with keywords indicating ambiguity
 ResolvedAlicia_Fagerving_WMSET205614 Exclude lifespans without numbers
 ResolvedAlicia_Fagerving_WMSET205685 Add "?" as exclusion keyword for lifespan
 ResolvedAlicia_Fagerving_WMSET205686 Process lifespan using "b." instead of "f."
 ResolvedAlicia_Fagerving_WMSET205688 Add "verksam" as exclusion keyword for lifespan
 ResolvedAlicia_Fagerving_WMSET206106 Discard all remaining problematic lifespans
 ResolvedAlicia_Fagerving_WMSET206122 Implement reports for unmatched data
 ResolvedAlicia_Fagerving_WMSET206625 [Auth] Add unmatched values to report

Event Timeline

Alicia_Fagerving_WMSE created this task.Aug 22 2018, 1:11 PM
Alicia_Fagerving_WMSE added a subtask: T202400: Introduce accuracy check for dates.
Alicia_Fagerving_WMSE moved this task from Backlog to Blocked on the WMSE-Library-Data-2018 board.Aug 23 2018, 11:35 AM
Alicia_Fagerving_WMSE moved this task from Blocked to Backlog on the WMSE-Library-Data-2018 board.Aug 27 2018, 2:42 PM
Alicia_Fagerving_WMSE claimed this task.Sep 3 2018, 9:48 AM
Alicia_Fagerving_WMSE added a subtask: T203640: Add VIAF and ISNI numbers.Sep 6 2018, 8:42 AM
Lokal_Profil closed subtask T202534: Map people's professions as Resolved.Sep 14 2018, 10:17 AM
Lokal_Profil closed subtask T203370: Map people's nationalities as Resolved.
Lokal_Profil closed subtask T203633: Add profession to WD item as Resolved.Sep 14 2018, 10:19 AM
Lokal_Profil closed subtask T203636: Add P31 = Q5 to WD item as Resolved.
Lokal_Profil closed subtask T202538: Map any extra external identifiers as Resolved.
Lokal_Profil closed subtask T203640: Add VIAF and ISNI numbers as Resolved.
Lokal_Profil closed subtask T203748: Add labels as Resolved.
Lokal_Profil closed subtask T203634: Add nationality to WD item as Resolved.Sep 14 2018, 10:23 AM
Alicia_Fagerving_WMSE added a subtask: T205278: Implement adding first name.Sep 24 2018, 12:50 PM
Alicia_Fagerving_WMSE added a subtask: T205372: Handle death-only life spans.Sep 25 2018, 6:43 AM
Alicia_Fagerving_WMSE added a subtask: T205371: Handle malformed hyphens in life years.
Alicia_Fagerving_WMSE removed a subtask: T205371: Handle malformed hyphens in life years.Sep 25 2018, 7:03 AM
Alicia_Fagerving_WMSE removed a subtask: T205372: Handle death-only life spans.Sep 25 2018, 7:06 AM
Lokal_Profil subscribed.Oct 19 2018, 1:20 PM
This comment was removed by Lokal_Profil.
Alicia_Fagerving_WMSE moved this task from 🗃️ Inbox to 📆 This week on the User-Alicia_Fagerving_WMSE board.Oct 22 2018, 7:39 AM
Alicia_Fagerving_WMSE closed subtask T204472: Post bot request for mass upload of person data as Resolved.Oct 25 2018, 2:18 PM
Alicia_Fagerving_WMSE closed subtask T205278: Implement adding first name as Resolved.
Alicia_Fagerving_WMSE closed subtask T205374: Process variations of life span years as Resolved.
Alicia_Fagerving_WMSE closed subtask T203380: Add descriptions as Resolved.Oct 25 2018, 2:25 PM
Alicia_Fagerving_WMSE closed subtask T202882: Implement adding surname as Resolved.Oct 25 2018, 2:38 PM
Alicia_Fagerving_WMSE closed subtask T202400: Introduce accuracy check for dates as Resolved.Oct 25 2018, 2:50 PM
Alicia_Fagerving_WMSE closed subtask T206122: Implement reports for unmatched data as Resolved.
Alicia_Fagerving_WMSE closed subtask T206625: [Auth] Add unmatched values to report as Resolved.
Alicia_Fagerving_WMSE added a comment.Oct 26 2018, 9:41 AM

The bot request was approved today, without discussion or revision of code from my side.

I'll start the upload at some point during the weekend.

Alicia_Fagerving_WMSE closed subtask T203639: Test upload of person data as Resolved.Oct 26 2018, 9:41 AM
Alicia_Fagerving_WMSE moved this task from Backlog to In progress on the WMSE-Library-Data-2018 board.
Alicia_Fagerving_WMSE added a comment.Oct 28 2018, 2:40 PM

Started the upload today.

Alicia_Fagerving_WMSE moved this task from 📆 This week to ♾️ Watching on the User-Alicia_Fagerving_WMSE board.Nov 8 2018, 9:31 AM
Alicia_Fagerving_WMSE moved this task from In progress to Done on the WMSE-Library-Data-2018 board.Jan 16 2019, 12:23 PM
Alicia_Fagerving_WMSE closed this task as a duplicate of T202607: Collect statistics about the URI upload.Apr 29 2019, 1:42 PM
Jopparn moved this task from ♾️ Watching to ☑️ Done on the User-Alicia_Fagerving_WMSE board.Jun 2 2020, 10:01 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL