Page MenuHomePhabricator
Create Task
Maniphest T366612

Publish Data Engineering maintained NodeJS packages to GitLab and use them in depender code
Closed, ResolvedPublic5 Estimated Story Points
Actions

Description

Once T366537 is done, we should make use of it to publish npm packages to GitLab, and update the downstream dependers to require the packages from GitLab.

Should publish npm packages to GitLab

Need to have package.json update to require from gitlab

  • eventgate
  • eventgate-wikimedia
  • eventstreams
  • schemas/event/primary
  • schemas/event/secondary

Details

Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Use Node 20 and Wikimedia GitLab package registryrepos/data-engineering/schemas-event-secondary!21tchinnode20-update-dependenciesmaster
Use Node 20 and Wikimedia GitLab package registryrepos/data-engineering/schemas-event-primary!7tchinnode20-update-dependenciesmaster
Add pipeline to publish to GitLab registryrepos/data-engineering/node-rdkafka-factory!3tchinadd-publish-pipelinemaster
Add pipeline to publish to GitLab registryrepos/data-engineering/eventgate!3tchinadd-publish-pipelinemaster
Add pipeline to publish to GitLab registryrepos/data-engineering/jsonschema-tools!55tchingitlab-publishingmaster
Customize query in GitLab

Related Objects
Search...

Event Timeline

Ottomata created this task.Jun 4 2024, 3:28 PM
Ottomata mentioned this in T366611: Migrate Data Engineering NodeJS library repos to GitLab.
Ottomata updated the task description. (Show Details)Jun 4 2024, 3:33 PM
Ottomata edited subscribers, added: Snwachukwu; removed: Sandaru.Jun 4 2024, 3:42 PM
Ottomata set the point value for this task to 5.Jun 6 2024, 6:40 PM
Ottomata mentioned this in T367322: Create a Maven package registry in Gitlab.Jun 12 2024, 2:44 PM
• lbowmaker edited projects, added Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering.Jul 12 2024, 2:39 PM
CodeReviewBot added a comment.Sep 8 2024, 5:53 PM

tchin updated https://gitlab.wikimedia.org/repos/data-engineering/jsonschema-tools/-/merge_requests/55

Add pipeline to publish to GitLab registry

gmodena moved this task from Next Up to In progress on the Data-Engineering (Q1 2024 July 1st - September 30th) board.Sep 9 2024, 2:16 PM
CodeReviewBot added a comment.Sep 12 2024, 11:29 AM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/jsonschema-tools/-/merge_requests/55

Add pipeline to publish to GitLab registry

CodeReviewBot added a project: Patch-For-Review.Sep 12 2024, 12:04 PM

tchin opened https://gitlab.wikimedia.org/repos/data-engineering/eventgate/-/merge_requests/3

Add pipeline to publish to GitLab registry

CodeReviewBot added a comment.Sep 12 2024, 12:09 PM

tchin opened https://gitlab.wikimedia.org/repos/data-engineering/node-rdkafka-factory/-/merge_requests/3

Add pipeline to publish to GitLab registry

CodeReviewBot added a comment.Sep 18 2024, 8:03 PM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/node-rdkafka-factory/-/merge_requests/3

Add pipeline to publish to GitLab registry

CodeReviewBot added a comment.Sep 18 2024, 8:03 PM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/eventgate/-/merge_requests/3

Add pipeline to publish to GitLab registry

tchin updated the task description. (Show Details)Oct 5 2024, 11:50 PM
tchin updated the task description. (Show Details)Oct 7 2024, 12:12 AM

Seems like we missed KafkaSSE during the GitLab migration

tchin updated the task description. (Show Details)Oct 8 2024, 3:31 AM
tchin added a comment.Oct 8 2024, 3:35 AM

Also added node-rdkafka-prometheus to the list

tchin updated the task description. (Show Details)Oct 8 2024, 4:21 AM

node-rdkafka-prometheus is now on gitlab. KafkaSSE looks like it's going to be a bit more difficult since the tests require a full kafka setup and I can't seem to even run it locally... although I guess I can skip getting CI to work for it for now

tchin added a comment.Oct 8 2024, 4:26 AM

Oh jeez there's also @wikimedia/url-get that I just found

tchin updated the task description. (Show Details)Oct 8 2024, 5:05 AM
Ahoelzl edited projects, added Data-Engineering (Q2 2024 October 1st - December 31th); removed Data-Engineering (Q1 2024 July 1st - September 30th).Oct 9 2024, 1:51 PM
Ahoelzl moved this task from Next Up to In progress on the Data-Engineering (Q2 2024 October 1st - December 31th) board.
tchin updated the task description. (Show Details)Oct 14 2024, 2:02 PM
tchin updated the task description. (Show Details)Oct 24 2024, 4:25 PM
CodeReviewBot added a comment.Nov 1 2024, 2:12 AM

tchin opened https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-primary/-/merge_requests/7

Use Node 20 and Wikimedia GitLab package registry

CodeReviewBot added a comment.Nov 1 2024, 2:21 AM

tchin opened https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/21

Use Node 20 and Wikimedia GitLab package registry

CodeReviewBot added a comment.Nov 16 2024, 4:49 AM

tchin opened https://gitlab.wikimedia.org/repos/data-engineering/eventgate/-/merge_requests/4

Use Node 20 and Wikimedia GitLab package registry

CodeReviewBot added a comment.Nov 26 2024, 3:42 PM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/eventgate/-/merge_requests/4

Use Node 20 and Wikimedia GitLab package registry

CodeReviewBot added a comment.Dec 13 2024, 5:18 AM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-primary/-/merge_requests/7

Use Node 20 and Wikimedia GitLab package registry

CodeReviewBot added a comment.Dec 13 2024, 5:18 AM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/21

Use Node 20 and Wikimedia GitLab package registry

tchin updated the task description. (Show Details)Dec 16 2024, 3:22 PM
Ottomata added a subtask: T383814: Upgrade eventgate-wikimedia to node20.Jan 15 2025, 8:41 PM
Ahoelzl edited projects, added Data-Engineering (Q3 2025 January 1st - March 31th); removed Data-Engineering (Q2 2024 October 1st - December 31th).Jan 18 2025, 12:31 AM
Ahoelzl moved this task from Next Up to In progress on the Data-Engineering (Q3 2025 January 1st - March 31th) board.
Ahoelzl moved this task from In progress to Blocked/Paused on the Data-Engineering (Q3 2025 January 1st - March 31th) board.Jan 24 2025, 6:35 PM
tchin updated the task description. (Show Details)Feb 18 2025, 1:40 PM
Ottomata updated the task description. (Show Details)Feb 18 2025, 4:17 PM
Ottomata moved this task from Blocked/Paused to Done on the Data-Engineering (Q3 2025 January 1st - March 31th) board.
Ahoelzl closed this task as Resolved.Apr 3 2025, 3:22 PM
Ahoelzl closed subtask T383814: Upgrade eventgate-wikimedia to node20 as Resolved.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits