Page MenuHomePhabricator
Create Task
Maniphest T156765

Upload media files from SMVK-Cypern-2017-01 to Wikimedia Commons
Closed, ResolvedPublic
Actions

Description

Uploading the media files from the GLAM to Wikimedia Commons will make it possible to start using the files in the different Wikimedia projects.

611 image files on the original external hard drive.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedLokal_ProfilT156765 Upload media files from SMVK-Cypern-2017-01 to Wikimedia Commons
 Resolved• Mattias_Ostmar-WMSET156766 Generate all description files and look at category statistics for SMVK-Cypern-2017-01
 ResolvedLokal_ProfilT156767 Upload a minor selection of images (~10 files) for SMVK-Cypern-2017-01
 DeclinedNoneT156768 Setup GLAM dashboard for SMVK-Cypern-2017-01
 ResolvedJopparnT156769 [Story] Upload all the media files for SMVK-Cypern-2017-01
 InvalidNoneT156771 Handle any identified maintenance issues for SMVK-Cypern-2017-01
 Resolved• Mattias_Ostmar-WMSET162432 Handle missing values for depicted place
 Resolved• Mattias_Ostmar-WMSET162799 Fix broken SMVK-MM-link template in infobox
 Resolved• Mattias_Ostmar-WMSET162889 Create Creator Template for John Lindros
 Resolved• Mattias_Ostmar-WMSET163669 Remove cat "Nicosia" from <Fotonr> C01145
 InvalidNoneT156772 Identify some nice example media files from SMVK-Cypern-2017-01
 ResolvedLokal_ProfilT156773 Update the landing page on Wikimedia Commons for SMVK-Cypern-2017-01
 InvalidNoneT156782 Inform and involve identified volunteers in translations of SMVK-Cypern-2017-01’s landing page
 InvalidNoneT156774 [Story] Communicate about the batch upload for SMVK-Cypern-2017-01
 InvalidNoneT156775 Identify the relevant volunteer communities that would like to help out with the SMVK-Cypern-2017-01 batch upload
 ResolvedLokal_ProfilT156787 Long term follow up on batch upload from SMVK-Cypern-2017-01
 InvalidJopparnT156778 Write press release about batch upload from SMVK-Cypern-2017-01
 Invalid• AxelPettersson_WMSET156785 Report progress about batch upload to SMVK-Cypern-2017-01
 Resolved• Mattias_Ostmar-WMSET165057 Use title case for "Svenska Cypernexpeditionen" in filenames
 Resolved• Mattias_Ostmar-WMSET165056 Swedish Cyprus Expedition added as both meta category and content category
 Resolved• Mattias_Ostmar-WMSET165055 Depicted people cannot use wikitext
 Resolved• Mattias_Ostmar-WMSET165058 Use en dash between years in descriptions
 Resolved• Mattias_Ostmar-WMSET156763 Create any maintenance categories on Commons which may be needed for SMVK-Cypern-2017-01
 InvalidNoneT156776 Inform and involve the identified volunteers about template translation for SMVK-Cypern-2017-01
 Resolved• Mattias_Ostmar-WMSET157948 Discuss standard way of coding batch uploads in relation to BatchUploadTools and legacy scripts
 Resolved• Mattias_Ostmar-WMSET158625 Move filename creation to create_infotext.py
 Resolved• Mattias_Ostmar-WMSET158626 move smvk link creation to create infotexts file
 Declined• Mattias_Ostmar-WMSET158630 Refactor create_infobox.py in new file make_infotexts.py to use new class CypernItem
 Resolved• Mattias_Ostmar-WMSET158945 generate more rich description texts for SMVK-Cypern-2017-01
 Resolved• Mattias_Ostmar-WMSET162776 Generate enriched filenames
Resolved• Mattias_Ostmar-WMSET159107 Break out people mapping as json file
 Duplicate• Mattias_Ostmar-WMSET158549 Create method for handling depicted people
 Resolved• Mattias_Ostmar-WMSET158636 Alter handling of depicted persons to instead create list of flipped names first
 Resolved• Mattias_Ostmar-WMSET163304 Extract keywords from <Beskrivning> to ensure category coverage
 Invalid• Mattias_Ostmar-WMSET163305 Create keyword Wikitable for mapping of <Beskrivning>
 Resolved• Mattias_Ostmar-WMSET163315 Filter relevant keywords for SMVK-Cypern_2017-01 <Beskrivning> field
 Resolved• Mattias_Ostmar-WMSET163316 Add Category:Interiors_of_tombs by <Beskrivning> keyword extraction SMVK-Cypern_2017-01
 Resolved• Mattias_Ostmar-WMSET163317 Add Category:Archaelogical_exhibitions by <Beskrivning> keyword extraction SMVK-Cypern_2017-01
 Resolved• Mattias_Ostmar-WMSET163306 Manually analyse inventive keyword combinations from <Beskrivning> to select for Commons categories
 ResolvedLokal_ProfilT162355 Handle missing values in <Fotodatum>
 Resolved• Mattias_Ostmar-WMSET163534 Create "catch-all" categorization logic for uncategorized SMVK-Cypern_2017-01
 Resolved• Mattias_Ostmar-WMSET164186 Fix indentation error when adding commons categories to self.content_cats circa line 372
 Resolved• Mattias_Ostmar-WMSET164707 Remov erraneous left-over else-clause for no mapped place value
 InvalidNoneT156780 Write blogpost about cooperation with SMVK-Cypern-2017-01
 InvalidNoneT156781 Inform the relevant volunteer communities about the new media files from SMVK-Cypern-2017-01

Event Timeline

• Mattias_Ostmar-WMSE created this task.Jan 31 2017, 9:36 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 31 2017, 9:36 AM
• Mattias_Ostmar-WMSE created subtask T156766: Generate all description files and look at category statistics for SMVK-Cypern-2017-01.Jan 31 2017, 9:36 AM
• Mattias_Ostmar-WMSE created subtask T156780: Write blogpost about cooperation with SMVK-Cypern-2017-01.Jan 31 2017, 9:57 AM
• Mattias_Ostmar-WMSE created subtask T156781: Inform the relevant volunteer communities about the new media files from SMVK-Cypern-2017-01.
• Mattias_Ostmar-WMSE moved this task from Backlog to In process on the Connected-Open-Heritage-Batch-uploads (SMVK-Cypern_2017-01) board.May 31 2017, 6:41 PM

Testupload of 10 images:

Computer: Mac OS X Macbook Air

Prepuload script run :

python /Users/mos/anaconda3/lib/python3.6/site-packages/batchupload/prepUpload.py -in_path:/Users/mos/Documents/10_example_images_cypern -out_path:/Users/mos/Documents/10_example_images_cypern_renamed -data_path:./SMVK-Cypern_2017-02_wikiformat_data.json

Upload script:

`
python /Users/mos/anaconda3/lib/python3.6/site-packages/batchupload/uploader.py -in_path:/Users/mos/Documents/10_example_images_cypern_renamed/ -confirm

Error found on all uploaded images:
Error in template * unknown parameter name (Template:Photograph): 'objects history'

Solution:
search and replace "objects history" with "object history" in SMVK-Cypern_2017-02_wikiformat_data.json

• Mattias_Ostmar-WMSE added a comment.May 31 2017, 6:50 PM

Full upload of all images:
Computer: Mac OS X Macbook Air. If run on work Linux computer, replace /Users/ with /home/
Run in Dropbox/wmse/SMVK/SMVK-Cypern_2017-01which is also the repo location.

python /Users/mos/anaconda3/lib/python3.6/site-packages/batchupload/prepUpload.py -in_path:/Users/mos/Cypern -out_path:/Users/mos/Cypern_renamed -data_path:./SMVK-Cypern_2017-02_wikiformat_data.json
`

Full upload script:

python /Users/mos/anaconda3/lib/python3.6/site-packages/batchupload/uploader.py -in_path:/Users/mos/Cypern_renamed/ -confirm
• Mattias_Ostmar-WMSE updated the task description. (Show Details)Jun 1 2017, 2:04 PM

588 images uploaded on first try.

Re-run using:

python /Users/mos/anaconda3/lib/python3.6/site-packages/batchupload/uploader.py -in_path:/Users/mos/Cypern_renamed/Uploaded_errors/ -confirm -nochunk
• Mattias_Ostmar-WMSE added a comment.Jun 1 2017, 2:39 PM

604 totally uploaded after second upload in /Uploaded_errors/

The 11 remaining files generated warnings that the files already exists on Commons, see paste.

• Mattias_Ostmar-WMSE moved this task from In process to Done on the Connected-Open-Heritage-Batch-uploads (SMVK-Cypern_2017-01) board.Jun 1 2017, 2:39 PM
Lokal_Profil subscribed.Jun 1 2017, 2:43 PM
In T156765#3307667, @Mattias_Ostmar-WMSE wrote:

The 11 remaining files generated warnings that the files already exists on Commons, see paste.

Since the filenames are the same I would guess that they were actually uploaded as part of the same run. So if 10-11 images are missing then it must be some others.

• Mattias_Ostmar-WMSE added a comment.EditedJun 1 2017, 2:46 PM

There were 611 image files on the external hard drive and 614 rows in the metadata document. When I uploaded the 10 first auto-uploaded images I _copied_ the image files, instead of moved them, so they should raise a warning each of them.

Lokal_Profil added a comment.Jun 1 2017, 3:01 PM

So there are 611-604=7 images unaccounted for. Not a biggie but do we know why they were not uploaded? Were there any images that didn't get renamed?

Lokal_Profil closed this task as Resolved.Jun 1 2017, 3:37 PM
Lokal_Profil claimed this task.
Lokal_Profil closed subtask T156766: Generate all description files and look at category statistics for SMVK-Cypern-2017-01 as Resolved.
Lokal_Profil closed subtask T156780: Write blogpost about cooperation with SMVK-Cypern-2017-01 as Invalid.Jul 2 2018, 12:42 PM
Lokal_Profil closed subtask T156781: Inform the relevant volunteer communities about the new media files from SMVK-Cypern-2017-01 as Invalid.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits