Page MenuHomePhabricator

ACraze (accraze)
Disabled

Projects

User Details

User Since
Jun 17 2019, 4:51 PM (157 w, 4 d)
Roles
Disabled
IRC Nick
accraze
LDAP User
Unknown
MediaWiki User
ACraze (WMF) [ Global Accounts ]
This account has been disabled.

Recent Activity

May 2 2022

elukey awarded T301413: Upload editquality model binaries to storage a Party Time token.
May 2 2022, 6:40 AM · artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)

Mar 14 2022

ACraze updated the task description for T301409: Migrate editquality models.
Mar 14 2022, 6:50 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)

Mar 9 2022

ACraze committed rMLISbbc11f5665ab: topic: add http error handling (authored by ACraze).
topic: add http error handling
Mar 9 2022, 7:24 AM
ACraze committed rMLIS2d7b220ca9ca: topic: revert to non-transformer architecture (authored by ACraze).
topic: revert to non-transformer architecture
Mar 9 2022, 7:15 AM

Mar 8 2022

ACraze committed rMLIS97fcf861106c: articlequality: add http error handling (authored by ACraze).
articlequality: add http error handling
Mar 8 2022, 4:33 PM
ACraze committed rMLIS1ff17a01a2e5: draftquality: remove transformer code (authored by ACraze).
draftquality: remove transformer code
Mar 8 2022, 11:56 AM
ACraze committed rMLIS7d41764495cd: draftquality: add http error response (authored by ACraze).
draftquality: add http error response
Mar 8 2022, 11:56 AM

Feb 28 2022

ACraze added a comment to T300270: Return meaningful HTTP responses in Lift Wing's revscoring backends.

To keep archives happy: We had discussed potentially creating a base 'revscoring' isvc class that would include error handling. After looking into the DRY approach, it seems we may want to keep each class separate as there are just enough differences to where DRY would not be all that helpful in the long run. (i.e. testing for specific revscoring errors, fetching text vs feature values, model.bin vs. model.bz2, etc..)

Feb 28 2022, 8:24 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), Lift-Wing

Feb 24 2022

ACraze committed rMLIS3a12553b351a: editquality: handle revision not found error (authored by ACraze).
editquality: handle revision not found error
Feb 24 2022, 11:33 AM
ACraze added a project to T294434: Implement an online feature store: Machine-Learning-Team.
Feb 24 2022, 6:06 AM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze added a comment to T294434: Implement an online feature store.

To keep archives happy:

Feb 24 2022, 6:05 AM · Machine-Learning-Team (Active Tasks), Lift-Wing

Feb 22 2022

ACraze added a comment to T301415: Add editquality isvc configurations to ml-services helmfile.

After talking with @elukey and @kevinbazira on IRC, it seems that we may need to split up the revscoring-editquality namespace as some nodes are filling up with pods.

Feb 22 2022, 11:10 PM · Patch-For-Review, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)

Feb 17 2022

ACraze committed rMLIS9913696a9ed7: editquality: handle http bad request (authored by ACraze).
editquality: handle http bad request
Feb 17 2022, 10:04 AM

Feb 16 2022

ACraze changed the status of T300270: Return meaningful HTTP responses in Lift Wing's revscoring backends from Open to In Progress.
Feb 16 2022, 5:58 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze changed the status of T300270: Return meaningful HTTP responses in Lift Wing's revscoring backends, a subtask of T272917: Lift Wing proof of concept, from Open to In Progress.
Feb 16 2022, 5:58 PM · Epic, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze moved T300270: Return meaningful HTTP responses in Lift Wing's revscoring backends from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Feb 16 2022, 5:58 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze committed rMLISc839c6a7d54e: editquality: fix double preprocess call (authored by ACraze).
editquality: fix double preprocess call
Feb 16 2022, 4:35 PM

Feb 15 2022

ACraze added a comment to T301766: Support (or not) the ORES augmented feature output in liftwing.

The feature names are stored in the model instance and then we get the feature values back from the extractor, so we will need to combine them together before including them in the response, something like:

Feb 15 2022, 4:33 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), Lift-Wing

Feb 14 2022

ACraze changed the status of T301415: Add editquality isvc configurations to ml-services helmfile, a subtask of T301409: Migrate editquality models, from Open to In Progress.
Feb 14 2022, 8:15 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze changed the status of T301415: Add editquality isvc configurations to ml-services helmfile from Open to In Progress.
Feb 14 2022, 8:15 PM · Patch-For-Review, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze moved T301415: Add editquality isvc configurations to ml-services helmfile from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Feb 14 2022, 8:13 PM · Patch-For-Review, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to P20723 Upload editquality model binaries to storage.

I ran this inside the models/ dir in the editquality repo, just make sure to run git lfs pull first

Feb 14 2022, 8:12 PM · editquality-modeling, Lift-Wing
ACraze changed the status of T301409: Migrate editquality models from Open to In Progress.
Feb 14 2022, 8:04 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze closed T298990: Topic model transformer as Resolved.
Feb 14 2022, 8:04 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze closed T298990: Topic model transformer, a subtask of T294419: Factor out feature retrieve functionality to a transformer, as Resolved.
Feb 14 2022, 8:04 PM · Patch-For-Review, Epic, Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze moved T301409: Migrate editquality models from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Feb 14 2022, 8:03 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze edited P20723 Upload editquality model binaries to storage.
Feb 14 2022, 5:51 PM · editquality-modeling, Lift-Wing
ACraze added a comment to T301413: Upload editquality model binaries to storage.

I just uploaded all of the editquality model files to storage on stat1008 (using this script: P20723).

Feb 14 2022, 5:49 PM · artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created P20723 Upload editquality model binaries to storage.
Feb 14 2022, 5:47 PM · editquality-modeling, Lift-Wing
ACraze changed the status of T301413: Upload editquality model binaries to storage, a subtask of T301409: Migrate editquality models, from Open to In Progress.
Feb 14 2022, 4:41 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze changed the status of T301413: Upload editquality model binaries to storage from Open to In Progress.
Feb 14 2022, 4:41 PM · artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze claimed T301413: Upload editquality model binaries to storage.
Feb 14 2022, 4:41 PM · artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze moved T301413: Upload editquality model binaries to storage from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Feb 14 2022, 4:40 PM · artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze moved T301412: Revert editquality isvc architecture to predictor-only from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Feb 14 2022, 4:40 PM · Patch-For-Review, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated the task description for T301412: Revert editquality isvc architecture to predictor-only.
Feb 14 2022, 4:33 PM · Patch-For-Review, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)

Feb 9 2022

ACraze added a comment to T294419: Factor out feature retrieve functionality to a transformer.

To recap from discussion at the team technical meeting today:

  • revscoring transformers for editquality/draftquality/topics are very heavy, especially since they need to mount the model binary in the pod to extract features.
    • articlequality does not need to load the model first to extract features, as it accepts raw article text.
  • for editquality, using transformers means 30+ additional pods
  • there is no clear benefit of managing this overhead complexity due to the way revscoring works
Feb 9 2022, 10:44 PM · Patch-For-Review, Epic, Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze triaged T301409: Migrate editquality models as High priority.
Feb 9 2022, 9:46 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created T301415: Add editquality isvc configurations to ml-services helmfile.
Feb 9 2022, 9:38 PM · Patch-For-Review, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created T301413: Upload editquality model binaries to storage.
Feb 9 2022, 9:23 PM · artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created T301412: Revert editquality isvc architecture to predictor-only.
Feb 9 2022, 9:07 PM · Patch-For-Review, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a subtask for T301409: Migrate editquality models: T284689: Create migration plan for editquality models from ORES to Lift Wing.
Feb 9 2022, 8:56 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a parent task for T284689: Create migration plan for editquality models from ORES to Lift Wing: T301409: Migrate editquality models.
Feb 9 2022, 8:56 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, editquality-modeling, revscoring, Lift-Wing
ACraze created T301409: Migrate editquality models.
Feb 9 2022, 8:56 PM · Epic, artificial-intelligence, editquality-modeling, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T301378: Custom enwiki-goodfaith Explainer.

I managed to get an explainer attached to the enwiki-goodfaith Inference Service on ml-sandbox and was able to retrieve an explanation from the :explain endpoint.

Feb 9 2022, 5:53 PM · Machine-Learning-Team (Active Tasks), Patch-For-Review, Lift-Wing
ACraze updated the task description for T301378: Custom enwiki-goodfaith Explainer.
Feb 9 2022, 5:44 PM · Machine-Learning-Team (Active Tasks), Patch-For-Review, Lift-Wing
ACraze created T301378: Custom enwiki-goodfaith Explainer.
Feb 9 2022, 5:14 PM · Machine-Learning-Team (Active Tasks), Patch-For-Review, Lift-Wing

Feb 8 2022

ACraze moved T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability from In Progress to Blocked on the Machine-Learning-Team (Active Tasks) board.
Feb 8 2022, 4:14 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)

Feb 7 2022

ACraze added a comment to T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability.

The deploy CR has been merged and we are scheduling a deployment on Wednesday morning, will update here once it is complete.

Feb 7 2022, 6:54 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze closed T298943: Editquality Transformer as Resolved.
Feb 7 2022, 6:35 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze closed T298943: Editquality Transformer, a subtask of T294419: Factor out feature retrieve functionality to a transformer, as Resolved.
Feb 7 2022, 6:34 PM · Patch-For-Review, Epic, Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze claimed T293677: Sunset MiniKF sandboxes.
Feb 7 2022, 6:15 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze updated the task description for T293677: Sunset MiniKF sandboxes.
Feb 7 2022, 5:59 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze added a comment to T293677: Sunset MiniKF sandboxes.

I have cleared out & deleted the old s3 buckets. I have also added documentation for our dev model storage: https://wikitech.wikimedia.org/wiki/User:Accraze/MachineLearning/ML-Sandbox#Model_Storage

Feb 7 2022, 5:57 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze added a comment to T298943: Editquality Transformer.

Confirming I was able to run the editquality transformer image on ml-sandbox last week:

Feb 7 2022, 5:30 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)

Feb 4 2022

ACraze added a comment to T293677: Sunset MiniKF sandboxes.

@kevinbazira - I took a look at your isvc spec, tried to deploy it and noticed that the Knative Revisions were failing.

Feb 4 2022, 7:32 PM · Machine-Learning-Team (Active Tasks), Lift-Wing

Feb 3 2022

ACraze added a comment to T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability.

The articlequality PR has been merged and the repo has been mirrored to Gerrit again.

Feb 3 2022, 8:48 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze moved T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability from Blocked to In Progress on the Machine-Learning-Team (Active Tasks) board.
Feb 3 2022, 8:47 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T293677: Sunset MiniKF sandboxes.

@kevinbazira - I believe model storage is now ready on ml-sandbox. Can you try these steps to see if you can upload a model binary to our minio object store?

Feb 3 2022, 8:11 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze changed the status of T293677: Sunset MiniKF sandboxes from Open to In Progress.
Feb 3 2022, 7:58 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze moved T293677: Sunset MiniKF sandboxes from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Feb 3 2022, 7:58 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze added a comment to T293677: Sunset MiniKF sandboxes.

I have installed a minio test instance on ml-sandbox and am able to use it for model storage. I have also configured s3cmd to use minio and can use our model_upload script.

Feb 3 2022, 4:41 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze closed T299972: ML Sandbox Transformer Configuration as Resolved.
Feb 3 2022, 4:21 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T299972: ML Sandbox Transformer Configuration.

Excellent, networking issues have been resolved and we can now run transformers on ml-sandbox.
Marking this as RESOLVED.

Feb 3 2022, 4:20 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Feb 2 2022

ACraze added a comment to T299972: ML Sandbox Transformer Configuration.

@kevinbazira - can you try hitting enwiki-articlequality on the ml-sandbox to confirm the transformer routing works for you too? I have a test script in my home_dir if you want to use:

Feb 2 2022, 11:00 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T299972: ML Sandbox Transformer Configuration.

I think I've got the networking issue solved. The top-level isvc was unable to route to the transformer, because my cluster-local-gateway did not have the ports configured correctly in the Istio Operator.

Feb 2 2022, 10:57 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze committed rMLIS8ede0d44b8b2: editquality: fix transformer python version (authored by ACraze).
editquality: fix transformer python version
Feb 2 2022, 5:04 PM

Feb 1 2022

ACraze moved T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability from In Progress to Blocked on the Machine-Learning-Team (Active Tasks) board.
Feb 1 2022, 5:13 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)

Jan 31 2022

ACraze added a comment to T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability.

Repos have been mirrored and should be in sync again.

Jan 31 2022, 10:40 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T293677: Sunset MiniKF sandboxes.

I've been reading the KServe docs and found an example of using minio for storage in a local cluster:
https://github.com/kserve/website/blob/main/docs/modelserving/kafka/kafka.md

Jan 31 2022, 6:51 PM · Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze committed rMLIS2c16c1546e81: editquality: adding model to transformer (authored by kevinbazira).
editquality: adding model to transformer
Jan 31 2022, 4:52 PM

Jan 28 2022

ACraze added a comment to T299972: ML Sandbox Transformer Configuration.

I've been rebuilding the sandbox cluster using the install script with the updated charts for knative and kserve. The KServe stack is able to load with all containers running fine, however, now when I deploy a new isvc (i.e. enwiki-articlequality) in a custom namespace like kserve-test, it seems that the images are unable to be pulled from WMF docker registry:

Jan 28 2022, 9:39 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T298943: Editquality Transformer.

@kevinbazira - I noticed an issue with the new transformer. It seems since we need to pass self.model.features to the extractor, we will also need to load the model inside of the transformer as well. The model binary file should already be mounted at /mnt/models/model.bin, so you can load it similar to the predictor.

Jan 28 2022, 6:58 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 27 2022

ACraze added a comment to T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability.

I think there is still some more work to be done for observability, so maybe leave it for the future.
@elukey -- any objections to this? ^^

Jan 27 2022, 10:28 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability.

Confirming the model repos have all been manually mirrored.

Jan 27 2022, 9:51 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze changed the status of T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability from Open to In Progress.

Starting the initial work to deploy the article quality model for Dutch Wikipedia.

Jan 27 2022, 8:35 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze moved T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Jan 27 2022, 8:30 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze renamed T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability from Deploy nlwiki articlequality model to ORES deployment - Winter 2022 - nlwiki articlequality model.
Jan 27 2022, 8:30 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T300270: Return meaningful HTTP responses in Lift Wing's revscoring backends.

It looks like we can do this using tornado.web.HTTPError and add the status code and message, similar to how it's done here:
https://github.com/kserve/kserve/blob/master/python/kserve/kserve/model.py#L112

Jan 27 2022, 5:08 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), Lift-Wing

Jan 26 2022

ACraze added a comment to T299972: ML Sandbox Transformer Configuration.

I can hit a transformer endpoint directly, but I get a 503 error. When I inspect the transformer logs, I see the following

Jan 26 2022, 9:21 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze changed the status of T299972: ML Sandbox Transformer Configuration from Open to In Progress.
Jan 26 2022, 9:14 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a parent task for T223782: Build article quality model for Dutch Wikipedia: T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability.
Jan 26 2022, 8:27 PM · artificial-intelligence, articlequality-modeling, Wikilabels, Machine-Learning-Team
ACraze added a subtask for T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability: T223782: Build article quality model for Dutch Wikipedia.
Jan 26 2022, 8:27 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze created T300195: ORES deployment - Winter 2022 - nlwiki articlequality/hiwiki editquality/ores observability.
Jan 26 2022, 8:26 PM · Patch-For-Review, artificial-intelligence, articlequality-modeling, ORES, Machine-Learning-Team (Active Tasks)
ACraze closed T298989: Draftquality transformer as Resolved.
Jan 26 2022, 7:58 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze closed T298989: Draftquality transformer, a subtask of T294419: Factor out feature retrieve functionality to a transformer, as Resolved.
Jan 26 2022, 7:57 PM · Patch-For-Review, Epic, Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze added a comment to T298989: Draftquality transformer.

The cert-manager blocker is gone (see: T298976). I was able to deploy the new transformer successfully to both eqiad and codfw

Jan 26 2022, 7:57 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated subscribers of T298943: Editquality Transformer.

It seems the editquality-transformer image has not been published yet. I think this is due to the integration/config patchset being merged after the the pipeline patchset got merged in the inference services repo. The 'publish' pipeline only gets triggered during the postmerge on jenkins now, so we will need to trigger the pipeline in order to get an image into the WMF docker registry.

Jan 26 2022, 4:32 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T298989: Draftquality transformer.

Deployment for the new transformer is currently blocked on T298976

Jan 26 2022, 4:19 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 24 2022

ACraze claimed T299972: ML Sandbox Transformer Configuration.
Jan 24 2022, 8:40 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze moved T299972: ML Sandbox Transformer Configuration from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Jan 24 2022, 8:39 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created T299972: ML Sandbox Transformer Configuration.
Jan 24 2022, 8:39 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze moved T298989: Draftquality transformer from In Progress to Blocked on the Machine-Learning-Team (Active Tasks) board.
Jan 24 2022, 7:15 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 20 2022

ACraze committed rMLIS3fb7b1c1168d: draftquality: configure transformer pipelines (authored by ACraze).
draftquality: configure transformer pipelines
Jan 20 2022, 7:26 AM

Jan 19 2022

ACraze added a comment to T296173: Load test the Lift Wing cluster.

@elukey i've been reading the kserve docs (https://kserve.github.io/website/master/modelserving/v1beta1/custom/custom_model/#parallel-inference) and I think we should tune the 'frontend-endpoint' and try the tornado workers first. Definitely interested in the ray workers too though, but I think that might be a bit more complex..?

Jan 19 2022, 10:08 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze closed T298995: Inference Service pipeline intermittent failures as Resolved.
Jan 19 2022, 9:51 PM · Release Pipeline (Blubber), Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T298995: Inference Service pipeline intermittent failures.

Ok I think all images that need to be updated have been updated. Going to mark this as RESOLVED.

Jan 19 2022, 9:51 PM · Release Pipeline (Blubber), Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze committed rMLISf6d58c8c8e5e: draftquality: add transformer blubberfile (authored by ACraze).
draftquality: add transformer blubberfile
Jan 19 2022, 3:51 PM

Jan 18 2022

ACraze changed the status of T298989: Draftquality transformer from Open to In Progress.
Jan 18 2022, 9:36 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze changed the status of T298989: Draftquality transformer, a subtask of T294419: Factor out feature retrieve functionality to a transformer, from Open to In Progress.
Jan 18 2022, 9:36 PM · Patch-For-Review, Epic, Machine-Learning-Team (Active Tasks), Lift-Wing
ACraze moved T298989: Draftquality transformer from Backlog to In Progress on the Machine-Learning-Team (Active Tasks) board.
Jan 18 2022, 9:36 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)