Page MenuHomePhabricator

Update refinery gobblin jars to use new gobblin-wmf jars and update puppet gobblin jobs
Closed, ResolvedPublic

Description

Once we have jars built from the new gobblin-wmf repo, we should update refinery to have the new jar (the one with dependency) in the artifacts folder replacing the original gobblin jar, and we should update the puppet jobs accordingly (change jar name).

Event Timeline

odimitrijevic moved this task from Incoming to Ingest on the Data-Engineering board.

Change 771431 had a related patch set uploaded (by Ottomata; author: Ottomata):

[analytics/refinery@master] Add gobblin-wmf-core-1.0.0-jar-with-dependencies.jar

https://gerrit.wikimedia.org/r/771431

Change 771431 merged by Ottomata:

[analytics/refinery@master] Add gobblin-wmf-core-1.0.0-jar-with-dependencies.jar

https://gerrit.wikimedia.org/r/771431

Change 771614 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/puppet@production] gobblin - Use new gobblin-wmf-core jar in hadoop test cluster

https://gerrit.wikimedia.org/r/771614

Change 771614 merged by Ottomata:

[operations/puppet@production] gobblin - Use new gobblin-wmf-core jar in hadoop test cluster

https://gerrit.wikimedia.org/r/771614

Change 771625 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/puppet@production] gobblin - Revert gobblin jar on hadoop test cluster

https://gerrit.wikimedia.org/r/771625

Change 771626 had a related patch set uploaded (by Ottomata; author: Ottomata):

[analytics/gobblin-wmf@main] Change version of guava to 25.0-jre

https://gerrit.wikimedia.org/r/771626

Change 771625 merged by Ottomata:

[operations/puppet@production] gobblin - Revert gobblin jar on hadoop test cluster

https://gerrit.wikimedia.org/r/771625

Change 771626 merged by jenkins-bot:

[analytics/gobblin-wmf@main] Change version of guava to 23.0

https://gerrit.wikimedia.org/r/771626

Change 771693 had a related patch set uploaded (by Ottomata; author: Ottomata):

[analytics/refinery@master] Add gobblin-wmf-core-1.0.1-jar-with-dependencies.jar

https://gerrit.wikimedia.org/r/771693

Change 771693 merged by Ottomata:

[analytics/refinery@master] Add gobblin-wmf-core-1.0.1-jar-with-dependencies.jar

https://gerrit.wikimedia.org/r/771693

Mentioned in SAL (#wikimedia-operations) [2022-03-21T13:20:42Z] <otto@deploy1002> Started deploy [analytics/refinery@11909fa] (hadoop-test): gobblin-wmf-core-1.0.1 - T297939

Mentioned in SAL (#wikimedia-operations) [2022-03-21T13:29:35Z] <otto@deploy1002> Finished deploy [analytics/refinery@11909fa] (hadoop-test): gobblin-wmf-core-1.0.1 - T297939 (duration: 08m 53s)

Mentioned in SAL (#wikimedia-operations) [2022-03-21T13:55:33Z] <otto@deploy1002> Started deploy [analytics/refinery@11909fa] (hadoop-test): gobblin-wmf-core-1.0.1 - T297939

Mentioned in SAL (#wikimedia-operations) [2022-03-21T13:55:40Z] <otto@deploy1002> Finished deploy [analytics/refinery@11909fa] (hadoop-test): gobblin-wmf-core-1.0.1 - T297939 (duration: 00m 06s)

Mentioned in SAL (#wikimedia-operations) [2022-03-21T14:54:22Z] <otto@deploy1002> Started deploy [analytics/refinery@33f66db] (hadoop-test): gobblin-wmf-core-1.0.1 - T297939

Mentioned in SAL (#wikimedia-operations) [2022-03-21T15:01:31Z] <otto@deploy1002> Finished deploy [analytics/refinery@33f66db] (hadoop-test): gobblin-wmf-core-1.0.1 - T297939 (duration: 07m 10s)

Change 772416 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/puppet@production] gobblin - use gobblin-wmf-core-1.0.1 in hadoop-test

https://gerrit.wikimedia.org/r/772416

Change 772416 merged by Ottomata:

[operations/puppet@production] gobblin - use gobblin-wmf-core-1.0.1 in hadoop-test

https://gerrit.wikimedia.org/r/772416

Change 772456 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/puppet@production] gobblin - use gobblin-wmf-core-1.0.1 in analytics-hadoop

https://gerrit.wikimedia.org/r/772456

Change 772456 merged by Ottomata:

[operations/puppet@production] gobblin - use gobblin-wmf-core-1.0.1 in analytics-hadoop

https://gerrit.wikimedia.org/r/772456