Page MenuHomePhabricator

Test on a Z11 shows [object Object] instead of result and expected value
Closed, ResolvedPublicBUG REPORT

Description

Steps to replicate the issue (include links if applicable):

What happens?:
It shows:
Expected result: [object Object]
Actual result: [object Object]

What should have happened instead?:
Expected result: "Albany is the capital of New York."
Actual result: ...?

Software version (on Special:Version page; skip for WMF-hosted wikis like Wikipedia):

Other information (browser name/version, screenshots, etc.):

Event Timeline

Jdforrester-WMF renamed this task from Test shows [object Object] instead of result and expected value to Test on a Z11 shows [object Object] instead of result and expected value.Sep 17 2025, 3:54 PM
Jdforrester-WMF triaged this task as Medium priority.

Expected result:

Screenshot 2025-09-19 at 12.13.32.png (1,024×600 px, 81 KB)

  1. Showing "Errors: None". Why: No 'errors' key in error metadata from API:
    • The UI says there are no errors because there is an expected and actual result in the error metadata from the orchestrator but there is not 'errors' key. So the UI thinks there are no errors.
    • Solution: Question is whether the orchestrator should return an 'errors' key yes or no (technically this IS an error) or that is should be fixed in the frontend code.
  2. The other issue why 'expectedTestResult' and 'actualTestResult' don't show up is because the K2 is not a string value (like the other metadata) but an object of Z11.
    • Solution: Question is whether the backend should return a string value or if the frontend should account for a Z11 object
DSmit-WMF changed the task status from Open to In Progress.Sep 19 2025, 10:17 AM
DSmit-WMF claimed this task.

As discussed in the team:

I will create a patch so the diff shows up as:

Screenshot 2025-09-19 at 12.32.34.png (1,012×638 px, 76 KB)

I will also set an error message instead of "None"

Change #1189825 had a related patch set uploaded (by Daphne Smit; author: Daphne Smit):

[mediawiki/extensions/WikiLambda@master] Metadata mixin: Make sure expectedTestResult and actualTestResult are transformed to strings

https://gerrit.wikimedia.org/r/1189825

Change #1189825 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Metadata mixin: Make sure expectedTestResult and actualTestResult are transformed to strings

https://gerrit.wikimedia.org/r/1189825