Page MenuHomePhabricator

Don-vip
User

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Mar 9 2019, 11:20 PM (85 w, 3 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Don-vip [ Global Accounts ]

Recent Activity

Sep 23 2020

Don-vip added a comment to T254060: ApiUpload allows duplicates when ignorewarnings is set..

@Don-vip in that case, everything is working as designed. Duplicate prevention is only advisory, if you ignore warnings, you can upload dupes.

Sep 23 2020, 8:07 PM · Documentation, Platform Engineering, Tool-spacemedia, MediaWiki-API, Commons
Don-vip added a comment to T254060: ApiUpload allows duplicates when ignorewarnings is set..

@kevinbazira Yes I set this flag. My params are set as follows:

Sep 23 2020, 6:47 PM · Documentation, Platform Engineering, Tool-spacemedia, MediaWiki-API, Commons

Jul 13 2020

Don-vip committed R2610:dfcc5705e6ee: fix NPE (authored by Don-vip).
fix NPE
Jul 13 2020, 9:47 PM

Jul 11 2020

Don-vip committed R2610:6e8dec61c5d0: Fix ESA upload (authored by Don-vip).
Fix ESA upload
Jul 11 2020, 6:22 PM

Jul 10 2020

Don-vip committed R2610:5cfc653d60e7: https://tools.wmflabs.org/spacemedia/ now redirects to https://spacemedia. (authored by Don-vip).
https://tools.wmflabs.org/spacemedia/ now redirects to https://spacemedia.
Jul 10 2020, 11:14 PM
Don-vip closed T230284: Request increased quota for spacemedia Toolforge tool as Resolved.

@Don-vip I think this is ready for you to give it another try. I did a test with a tool of mine and was able to create a 6Gi container after making the smae edit I made for spacemedia.

Jul 10 2020, 10:32 PM · Toolforge (Quota-requests), Tool-spacemedia
Don-vip added a comment to T230284: Request increased quota for spacemedia Toolforge tool.

What does "not starting" look like? Did you capture any log or event output from Kubernetes about the pod?

Jul 10 2020, 9:39 PM · Toolforge (Quota-requests), Tool-spacemedia
Don-vip reopened T230284: Request increased quota for spacemedia Toolforge tool as "Open".

The only way to start my application is still to ask for 4Gi only:

webservice --cpu 1 --mem 4Gi jdk11 start /data/project/spacemedia/run.sh
Jul 10 2020, 8:04 PM · Toolforge (Quota-requests), Tool-spacemedia
Don-vip added a comment to T230284: Request increased quota for spacemedia Toolforge tool.

@aborrero I still see a 4 Gi limit when I use kubectl:

Jul 10 2020, 11:15 AM · Toolforge (Quota-requests), Tool-spacemedia

Jun 27 2020

Don-vip committed R2610:a99b032f78d5: handle VE API errors (authored by Don-vip).
handle VE API errors
Jun 27 2020, 8:16 PM

Jun 21 2020

Don-vip committed R2610:fdefdb083db6: save media when found uploaded prior to upload (authored by Don-vip).
save media when found uploaded prior to upload
Jun 21 2020, 6:51 PM
Don-vip committed R2610:8b3a6ca041e2: New manual upload mode without unicity check (authored by Don-vip).
New manual upload mode without unicity check
Jun 21 2020, 5:31 PM

Jun 20 2020

Don-vip committed R2610:aac3959dca41: Disable automatic upload of media with known duplicates, too risky... (authored by Don-vip).
Disable automatic upload of media with known duplicates, too risky...
Jun 20 2020, 12:41 PM
Don-vip committed R2610:f312b4c5dcea: Don't mark imported files as ignored (authored by Don-vip).
Don't mark imported files as ignored
Jun 20 2020, 12:09 PM

Jun 17 2020

Don-vip committed R2610:6cfdca45c4d0: Display commons links of duplicates (authored by Don-vip).
Display commons links of duplicates
Jun 17 2020, 8:13 PM
Don-vip added a comment to T230284: Request increased quota for spacemedia Toolforge tool.

@bd808 thank you for the docs, I now understand better what it implies. It looks like a significant effort to move away from Toolforge, I'm not ready yet to spend the required amount of work. Can we please try the intermediate solution by increasing the limit to 6Gb, at least to see if it's enough?

Jun 17 2020, 7:41 PM · Toolforge (Quota-requests), Tool-spacemedia

Jun 16 2020

Don-vip committed R2610:4cc21fd91e51: Display all commons file names, add new field to store file size (authored by Don-vip).
Display all commons file names, add new field to store file size
Jun 16 2020, 10:57 PM
Don-vip committed R2610:a41785b7c6b1: Disable check of NASA SIRS now that upload is done; won't be updated (authored by Don-vip).
Disable check of NASA SIRS now that upload is done; won't be updated
Jun 16 2020, 10:57 PM

Jun 14 2020

Don-vip committed R2610:382b8f215ac4: Enable automatic upload for ESA (authored by Don-vip).
Enable automatic upload for ESA
Jun 14 2020, 8:06 PM
Don-vip committed R2610:5bc02b3015f3: fix NPE (authored by Don-vip).
fix NPE
Jun 14 2020, 8:06 PM
Don-vip committed R2610:1d49da61a63f: retry with santized URL in case of http-invalid-url (authored by Don-vip).
retry with santized URL in case of http-invalid-url
Jun 14 2020, 8:06 PM
Don-vip committed R2610:68c82cccae4e: Handle multiple categories in "other fields" (authored by Don-vip).
Handle multiple categories in "other fields"
Jun 14 2020, 8:06 PM

Jun 11 2020

Don-vip committed R2610:b3ede52dbab6: Ignore "upstream request timeout" errors in ESA uploads (authored by Don-vip).
Ignore "upstream request timeout" errors in ESA uploads
Jun 11 2020, 11:02 PM
Don-vip committed R2610:acb8cd9e7c90: Define new UploadException (authored by Don-vip).
Define new UploadException
Jun 11 2020, 11:02 PM
Don-vip committed R2610:3121a8aa3c4e: Allow longer ignored reasons (authored by Don-vip).
Allow longer ignored reasons
Jun 11 2020, 5:01 PM
Don-vip committed R2610:7c5e5f85b7cb: fix handling of problems during ESA uploads (authored by Don-vip).
fix handling of problems during ESA uploads
Jun 11 2020, 12:33 PM

Jun 10 2020

Don-vip committed R2610:769d54a497fb: Catch tiffinfo errors in ESA uploads (authored by Don-vip).
Catch tiffinfo errors in ESA uploads
Jun 10 2020, 7:05 PM
Don-vip committed R2610:24513d288bd7: Directly put in "images" category for Copernicus Sentinel media (authored by Don-vip).
Directly put in "images" category for Copernicus Sentinel media
Jun 10 2020, 11:17 AM
Don-vip committed R2610:dbbe03f504cb: fix ExoMars / CaSSIS categories (authored by Don-vip).
fix ExoMars / CaSSIS categories
Jun 10 2020, 11:17 AM

Jun 7 2020

Don-vip committed R2610:8d09a80aa8f8: catch ESA upload errors (authored by Don-vip).
catch ESA upload errors
Jun 7 2020, 1:43 PM
Don-vip committed R2610:ca68dc950134: Enable automatic upload for ESA (authored by Don-vip).
Enable automatic upload for ESA
Jun 7 2020, 12:16 PM
Don-vip committed R2610:b7df40f69e6e: better handling of "upstream request timeout" error (authored by Don-vip).
better handling of "upstream request timeout" error
Jun 7 2020, 11:14 AM
Don-vip committed R2610:2ffb12a7df12: fix NPE at startup (authored by Don-vip).
fix NPE at startup
Jun 7 2020, 11:14 AM

Jun 6 2020

Don-vip committed R2610:197a97a413ac: Better ESA categories for ExoMars mission (authored by Don-vip).
Better ESA categories for ExoMars mission
Jun 6 2020, 2:33 PM
Don-vip committed R2610:3bafde714db0: upload fixes (authored by Don-vip).
upload fixes
Jun 6 2020, 1:48 PM
Don-vip committed R2610:3c96ca55e478: handle "upstream request timeout" error (authored by Don-vip).
handle "upstream request timeout" error
Jun 6 2020, 12:29 PM
Don-vip committed R2610:64a4eccb5ab9: upload fixes (authored by Don-vip).
upload fixes
Jun 6 2020, 12:25 PM
Don-vip committed R2610:bc181b10bfd5: Better naming of other versions (authored by Don-vip).
Better naming of other versions
Jun 6 2020, 10:31 AM
Don-vip committed R2610:ec45a1597155: use correct filename for variants (authored by Don-vip).
use correct filename for variants
Jun 6 2020, 10:31 AM

Jun 5 2020

Don-vip committed R2610:b6e97c007c78: ESA fixes, SHA-1 computation fix, allow to reset SHA-1 hashes (authored by Don-vip).
ESA fixes, SHA-1 computation fix, allow to reset SHA-1 hashes
Jun 5 2020, 11:06 PM
Don-vip awarded T254060: ApiUpload allows duplicates when ignorewarnings is set. a Hungry Hippo token.
Jun 5 2020, 10:38 PM · Documentation, Platform Engineering, Tool-spacemedia, MediaWiki-API, Commons
Don-vip updated the task description for T254060: ApiUpload allows duplicates when ignorewarnings is set..
Jun 5 2020, 10:37 PM · Documentation, Platform Engineering, Tool-spacemedia, MediaWiki-API, Commons
Don-vip removed a project from T234530: API sometimes does not return consistent data (sha1 does not match content): Tool-spacemedia.
Jun 5 2020, 10:35 PM · Platform Engineering (Icebox), MediaWiki-API

May 31 2020

Don-vip committed R2610:df7c31bb01a4: upload fixes (authored by Don-vip).
upload fixes
May 31 2020, 7:14 PM
Don-vip committed R2610:741122245bcb: Fixed ESA mapping (authored by Don-vip).
Fixed ESA mapping
May 31 2020, 7:14 PM
Don-vip added a comment to T254060: ApiUpload allows duplicates when ignorewarnings is set..

Replag where/according to what?
Sure, to cloud it's pretty lagged as per https://replag.toolforge.org/, but that's irrelevant to uploading to commons

May 31 2020, 10:25 AM · Documentation, Platform Engineering, Tool-spacemedia, MediaWiki-API, Commons

May 30 2020

Don-vip created T254060: ApiUpload allows duplicates when ignorewarnings is set..
May 30 2020, 12:09 PM · Documentation, Platform Engineering, Tool-spacemedia, MediaWiki-API, Commons

May 29 2020

Don-vip added a project to T234530: API sometimes does not return consistent data (sha1 does not match content): Tool-spacemedia.
May 29 2020, 9:01 PM · Platform Engineering (Icebox), MediaWiki-API
Don-vip committed R2610:00517a83c38e: ESA upload fixes (authored by Don-vip).
ESA upload fixes
May 29 2020, 8:52 PM
Don-vip added a comment to T234530: API sometimes does not return consistent data (sha1 does not match content).
May 29 2020, 8:43 PM · Platform Engineering (Icebox), MediaWiki-API
Don-vip awarded T234530: API sometimes does not return consistent data (sha1 does not match content) a Hungry Hippo token.
May 29 2020, 8:06 PM · Platform Engineering (Icebox), MediaWiki-API
Don-vip awarded T212428: includes/Revision/RevisionStore.php: Main slot of revision (number) not found in database! a Hungry Hippo token.
May 29 2020, 8:05 PM · Platform Team Workboards (Clinic Duty Team), User-brennen, Platform Team Initiatives (MCR), MW-1.33-notes (1.33.0-wmf.23; 2019-03-26), MediaWiki-Revision-backend, Multi-Content-Revisions (Reactive), Wikimedia-production-error
Don-vip added a comment to T234530: API sometimes does not return consistent data (sha1 does not match content).
May 29 2020, 8:03 PM · Platform Engineering (Icebox), MediaWiki-API

May 28 2020

Don-vip committed R2610:aa4de205a628: Enable ESA manual upload on dev build, add "other fields" (authored by Don-vip).
Enable ESA manual upload on dev build, add "other fields"
May 28 2020, 11:21 PM
Don-vip moved T232161: Preserve ESA paragraphs from In progress to Done on the Tool-spacemedia board.
May 28 2020, 10:36 PM · Tool-spacemedia
Don-vip closed T232161: Preserve ESA paragraphs as Declined.
May 28 2020, 10:36 PM · Tool-spacemedia

May 26 2020

Don-vip committed R2610:591504512728: Enable automatic upload for NASA SIRS (authored by Don-vip).
Enable automatic upload for NASA SIRS
May 26 2020, 8:33 PM
Don-vip committed R2610:232b5bdc0961: fix SIRS upload bug (authored by Don-vip).
fix SIRS upload bug
May 26 2020, 8:12 PM
Don-vip committed R2610:b08f55d10f12: Enable manual upload for NASA SIRS (authored by Don-vip).
Enable manual upload for NASA SIRS
May 26 2020, 7:25 PM

May 24 2020

Don-vip committed R2610:7d574b5b1386: [maven-release-plugin] prepare for next development iteration (authored by Don-vip).
[maven-release-plugin] prepare for next development iteration
May 24 2020, 10:24 PM
Don-vip committed R2610:3d03c0c3a307: Ignore release temporary files (authored by Don-vip).
Ignore release temporary files
May 24 2020, 10:24 PM
Don-vip committed R2610:714f84f34e6d: [maven-release-plugin] prepare release spacemedia-0.3.0 (authored by Don-vip).
[maven-release-plugin] prepare release spacemedia-0.3.0
May 24 2020, 10:15 PM
Don-vip committed R2610:ee76b88f0791: Add SCM information in POM (authored by Don-vip).
Add SCM information in POM
May 24 2020, 10:14 PM
Don-vip committed R2610:4f63ad160223: fix DVIDS upload bugs, enable automatic upload for USAFSPC (authored by Don-vip).
fix DVIDS upload bugs, enable automatic upload for USAFSPC
May 24 2020, 12:18 PM

May 23 2020

Don-vip committed R2610:7256993baf90: enable automatic upload for DVIDS (authored by Don-vip).
enable automatic upload for DVIDS
May 23 2020, 7:54 PM
Don-vip committed R2610:e58bf1f15598: Enable automatic upload for US Space Command (authored by Don-vip).
Enable automatic upload for US Space Command
May 23 2020, 6:38 PM
Don-vip committed R2610:aca530cee804: milim template is based on information template (authored by Don-vip).
milim template is based on information template
May 23 2020, 6:38 PM
Don-vip committed R2610:eb028f2ac0ce: JPA transaction fixes (authored by Don-vip).
JPA transaction fixes
May 23 2020, 6:03 PM
Don-vip committed R2610:627f3271f530: fix DVIDS upload title (authored by Don-vip).
fix DVIDS upload title
May 23 2020, 4:13 PM
Don-vip committed R2610:a381e947f246: JPA transaction fixes (authored by Don-vip).
JPA transaction fixes
May 23 2020, 4:10 PM
Don-vip committed R2610:f98dd387c246: Enable upload of DVIDS images (authored by Don-vip).
Enable upload of DVIDS images
May 23 2020, 2:29 PM

May 21 2020

Don-vip committed R2610:2eb013c3b971: Mediawiki upload API considers dot as a filename extension separator (authored by Don-vip).
Mediawiki upload API considers dot as a filename extension separator
May 21 2020, 1:00 AM

May 20 2020

Don-vip committed R2610:da3edbda6c59: Enable automatic upload of SMC Flickr images (authored by Don-vip).
Enable automatic upload of SMC Flickr images
May 20 2020, 11:15 PM
Don-vip committed R2610:90e57630448b: Generate correct links (authored by Don-vip).
Generate correct links
May 20 2020, 4:50 PM

May 19 2020

Don-vip committed R2610:c4830ab3f039: Use DataTables to sort table on index page (authored by Don-vip).
Use DataTables to sort table on index page
May 19 2020, 10:50 PM
Don-vip committed R2610:1749f3a127f9: better hashcode/equals for Media class (authored by Don-vip).
better hashcode/equals for Media class
May 19 2020, 3:07 PM
Don-vip committed R2610:8206d7c3c739: delete downloaded YouTube videos (authored by Don-vip).
delete downloaded YouTube videos
May 19 2020, 12:28 PM

May 18 2020

Don-vip committed R2610:de7a8f30aeba: improve YouTube videos handling (authored by Don-vip).
improve YouTube videos handling
May 18 2020, 9:18 PM
Don-vip committed R2610:983ba1d0753d: improve YouTube videos handling (authored by Don-vip).
improve YouTube videos handling
May 18 2020, 6:23 PM
Don-vip added a project to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads: Tool-spacemedia.

I'm also facing this issue in my tool. It runs on Toolforge/k8s to detect new CC videos published by Arianespace, using YouTube API, and faces HTTP 429 errors too.

May 18 2020, 1:45 PM · Tool-spacemedia, Upstream, cloud-services-team (Kanban), Cloud-VPS, video2commons
Don-vip awarded T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads a Hungry Hippo token.
May 18 2020, 1:37 PM · Tool-spacemedia, Upstream, cloud-services-team (Kanban), Cloud-VPS, video2commons

May 17 2020

Don-vip committed R2610:db3be0915c12: update to bootstrap 4.5.0 (authored by Don-vip).
update to bootstrap 4.5.0
May 17 2020, 8:14 PM
Don-vip committed R2610:90405e517776: Avoid deleting all Youtube videos in case of http 429 (authored by Don-vip).
Avoid deleting all Youtube videos in case of http 429
May 17 2020, 7:23 PM
Don-vip committed R2610:2b90f0c5ff1b: catch RestClientException during SHA-1 updates (authored by Don-vip).
catch RestClientException during SHA-1 updates
May 17 2020, 7:08 PM
Don-vip committed R2610:35a803b4976e: update current youtube videos for http 429 (authored by Don-vip).
update current youtube videos for http 429
May 17 2020, 3:22 PM

May 15 2020

Don-vip committed R2610:443c53a0639c: Add 404 error page (authored by Don-vip).
Add 404 error page
May 15 2020, 11:02 PM

May 14 2020

Don-vip committed R2610:4f9087919f24: fix detection of non-free YouTube videos (authored by Don-vip).
fix detection of non-free YouTube videos
May 14 2020, 11:34 AM
Don-vip committed R2610:4858259ef993: log http status code (authored by Don-vip).
log http status code
May 14 2020, 8:53 AM
Don-vip committed R2610:cf8e4e076e44: update Maven plugins (authored by Don-vip).
update Maven plugins
May 14 2020, 8:53 AM
Don-vip committed R2610:a2a2684eba9c: Ignore downloaded video files (authored by Don-vip).
Ignore downloaded video files
May 14 2020, 8:53 AM

May 11 2020

Don-vip committed R2610:9de38d8b456a: Delete no-longer free YouTube videos (authored by Don-vip).
Delete no-longer free YouTube videos
May 11 2020, 7:38 PM
Don-vip committed R2610:37d11e340b29: Record start/end/duration of update tasks for each agency, cleanup code (authored by Don-vip).
Record start/end/duration of update tasks for each agency, cleanup code
May 11 2020, 7:06 PM
Don-vip committed R2610:985f899ca516: only mark images readable when we actually can read it for sure (authored by Don-vip).
only mark images readable when we actually can read it for sure
May 11 2020, 6:07 PM
Don-vip committed R2610:33bfb6833332: add robustness (authored by Don-vip).
add robustness
May 11 2020, 6:07 PM

May 10 2020

Don-vip committed R2610:25d1727b4df5: T251026 - display preview of duplicate files (authored by Don-vip).
T251026 - display preview of duplicate files
May 10 2020, 10:15 PM
Don-vip committed R2610:19c0b0b7c172: Cleanup NASA Flickr descriptions (authored by Don-vip).
Cleanup NASA Flickr descriptions
May 10 2020, 10:15 PM
Don-vip committed R2610:1c2ba4b4ea99: fix NPE (authored by Don-vip).
fix NPE
May 10 2020, 7:35 PM
Don-vip committed R2610:2c82b03a4465: T251026 - allow to reset ignored media (authored by Don-vip).
T251026 - allow to reset ignored media
May 10 2020, 2:55 PM
Don-vip committed R2610:01daba058f65: T232156 - fix renamed category (authored by Don-vip).
T232156 - fix renamed category
May 10 2020, 2:45 PM
Don-vip committed R2610:677690a7a40d: T251026 - allow to reset duplicates (authored by Don-vip).
T251026 - allow to reset duplicates
May 10 2020, 2:45 PM