Implement Automated Batch Execution for Non-Platform Engineering
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	lbowmaker
	Sep 30 2021, 5:48 PM

Description

User Story

As a dataset producer, I need a reliable way for my code to be executed automatically so that other teams/applications can rely on and use their outputs

Success Criteria

A non-platform engineer can read clear process documentation
A non-platform engineer can read clear code standards and coding requirements to move their code into the automated execution system
A non-platform engineer has 1 proof of concept job running in the automated execution system

Related Objects
Search...

Status	Subtype	Assigned	Task
Resolved		lbowmaker	T292218 Implement Automated Batch Execution for Non-Platform Engineering
Resolved		None	T292220 Define and Document Coding Standards
Resolved		lbowmaker	T292738 Define and Document Workflow Process
Declined		lbowmaker	T292739 Define and Document Deployment Process
Resolved		None	T292740 Refactor Existing Image Recommendation Code (may need breaking down to more tasks)
Resolved		None	T280585 📊Image Matching experiments should be deterministic
Resolved		gmodena	T292741 Define and Implement CI Checks
Resolved		gmodena	T292743 Create Code Repo and Structure
Declined		lbowmaker	T292744 Setup Script Scheduling Tool (needs grooming to more tasks)
Invalid		lbowmaker	T292745 Deploy POC Script to Automated Execution System
Declined		lbowmaker	T292747 Define and Create Logging Routines - Airflow UI
Resolved		gmodena	T292748 [SPIKE] Create Generic Components for Scheduling
Resolved	Spike	gmodena	T293382 [SPIKE] Investigate Different CI Checks
Declined		lbowmaker	T294478 Implement Image Recommendations Algorithm Performance Metrics
Resolved	Spike	lbowmaker	T294479 [SPIKE] Decide best approach for storage and visualization of Image Recs Metrics
Resolved		gmodena	T294480 Implement Image Recommendations DAG Performance Metrics
Resolved		• Clarakosi	T295337 Support Ad-hoc run of Image Recs Data Pipeline
Resolved	Spike	lbowmaker	T295338 [SPIKE] Investigate More Frequent Runs of Image Recs Data Pipeline
Declined		gmodena	T295364 [PLACEHOLDER] Pipelines Rep Structure Changes after RFC

Event Timeline

lbowmaker created this task.Sep 30 2021, 5:48 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 30 2021, 5:48 PM

lbowmaker renamed this task from [DRAFT SANDBOX] Test Ticket to [DRAFT SANDBOX] Test Ticket - Implement Batch Path to Production for Non-Platform Engineering.Sep 30 2021, 6:09 PM

lbowmaker updated the task description. (Show Details)

lbowmaker moved this task from Work in Progress ⚙️ to Backlog on the Generated Data Platform board.Sep 30 2021, 6:15 PM

lbowmaker renamed this task from [DRAFT SANDBOX] Test Ticket - Implement Batch Path to Production for Non-Platform Engineering to Implement Batch Path to Production for Non-Platform Engineering.Sep 30 2021, 6:20 PM

• DAbad moved this task from Backlog to Product Roadmap on the Generated Data Platform board.Oct 1 2021, 2:19 PM

Aklapper updated the task description. (Show Details)Oct 2 2021, 11:48 AM

lbowmaker updated the task description. (Show Details)Oct 7 2021, 1:46 PM

lbowmaker added a subtask: T292738: Define and Document Workflow Process.Oct 7 2021, 1:54 PM

lbowmaker renamed this task from Implement Batch Path to Production for Non-Platform Engineering to Implement Automated Batch Execution for Non-Platform Engineering.Oct 7 2021, 6:28 PM

lbowmaker updated the task description. (Show Details)

lbowmaker updated the task description. (Show Details)Oct 7 2021, 7:04 PM

Ottomata subscribed.Oct 18 2021, 7:26 PM

lbowmaker moved this task from Product Roadmap to Product Roadmap on the Generated Data Platform board.Oct 19 2021, 9:08 PM

lbowmaker edited projects, added Generated Data Platform (Product Roadmap); removed Generated Data Platform.

lbowmaker moved this task from Backlog to Now (Deliver) on the Generated Data Platform (Product Roadmap) board.Oct 19 2021, 9:12 PM

lbowmaker closed subtask T292743: Create Code Repo and Structure as Resolved.Jan 10 2022, 1:50 PM

lbowmaker closed subtask T292741: Define and Implement CI Checks as Resolved.

lbowmaker closed subtask T295337: Support Ad-hoc run of Image Recs Data Pipeline as Resolved.Feb 23 2022, 1:51 PM

lbowmaker closed subtask T292740: Refactor Existing Image Recommendation Code (may need breaking down to more tasks) as Resolved.Apr 4 2022, 12:50 PM

lbowmaker closed subtask T292220: Define and Document Coding Standards as Resolved.

lbowmaker closed subtask T293382: [SPIKE] Investigate Different CI Checks as Resolved.Jun 9 2022, 1:33 PM