Page MenuHomePhabricator
Create Task
Maniphest T106772

test WikidataPageBanner its integration with Wikibase
Open, LowPublic
Actions

Description

Test cases exercising the code lines calling into Wikidata related code need to be written

Configuration in CI was done, so the below is historic.

Given that the internals of Wikidata cannot be guaranteed to be stable we should make sure that the integration of WikidataPageBanner with it is tested and that the these are run by the CI. This requires that at least one job is run with Wikibase available.

One can add Wikidata as a dependency of WikidataPageBanner to its test job in integration/config.git/zuul/ext_dependencies.py . Then to run those tests before deployment T96264 needs to be done and WikidataPageBanner also needs to be added to the mediawiki-extensions-hhvm job.

An alternative implementation that only uses interfaces that have stability guarantees is outlined in T106773: use wikibase composer managed libraries together with the API.

Details

SubjectRepoBranchLines +/-
Revert "Revert "WikidataPageBanner should run Wikibase tests""integration/configmaster+1 -0
WikidataPageBanner should run Wikibase testsintegration/configmaster+1 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Jdlrobson created this task.Jul 24 2015, 12:44 AM
Jdlrobson raised the priority of this task from to Needs Triage.
Jdlrobson updated the task description. (Show Details)
Jdlrobson added projects: Wikidata-Page-Banner, Wikidata, Wikibase-DataModel-Services, Jenkins.
Jdlrobson moved this task to June 26-July 18 on the Wikidata-Page-Banner board.
Jdlrobson subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 24 2015, 12:44 AM
Jdlrobson added a parent task: T106773: find extensions using code directly from Wikibase and provide mechanism with a stable interface.Jul 24 2015, 1:51 AM
Jdlrobson mentioned this in T106713: WikidataPageBanner incompatible with latest Wikidata.
JanZerebecki renamed this task from WikidataPageBanner tests should be run by Wikibase to WikidataPageBanner tests should run with Wikibase.Jul 24 2015, 2:04 PM
JanZerebecki updated the task description. (Show Details)
JanZerebecki edited projects, added Continuous-Integration-Config; removed Jenkins.
JanZerebecki set Security to None.
Jdlrobson added subscribers: JanZerebecki, hashar.Aug 5 2015, 5:34 PM

@JanZerebecki @hashar could you help me get this setup? I'm not to familiar with how this stuff works.

Jdlrobson moved this task from June 26-July 18 to Backlog on the Wikidata-Page-Banner board.Aug 5 2015, 5:34 PM
JanZerebecki added a comment.Aug 5 2015, 7:48 PM

Sure. What is your question? Which part of this task are you trying to tackle and at what steps are you trying?

Jdlrobson added a comment.Aug 6 2015, 8:07 PM

The problem I'm seeing is there is no entry for Wikidata in integration/config.git/zuul/ext_dependencies.py and I always get confused about the differences between WikibaseClient/Lib/View

I feel like it is more complicated then adding
'Wikibase': ['WikidataPageBanner']
to ext_dependencies.py
or is it really that easy?

(note: I don't have much experience with setting up QA infrastructure)

JanZerebecki added a comment.Aug 6 2015, 10:12 PM

To have the code you are using around when Jenkins runs the WikidataPageBanner tests, adding 'WikidataPageBanner': ['Wikidata'] is just that easy for the jobs that are relevant here and are used by WikidataPageBanner: mwext-testextension-hhvm, mwext-testextension-zend, mwext-qunit.

Why do you want to declare that Wikibase depends on WikidataPageBanner?

Did you consider using Wikidata through its Mediawiki API instead? (Those are intended for others to use. What WikidataPageBanner uses right now is a private interface.) That would sidestep the whole issue.

JanZerebecki renamed this task from WikidataPageBanner tests should run with Wikibase to test WikidataPageBanner its integration with Wikibase.Aug 10 2015, 4:35 PM
JanZerebecki updated the task description. (Show Details)
JanZerebecki added a subtask: T98029: Deploy PageBanner extension on English Wikivoyage project.
Ricordisamoa subscribed.Aug 10 2015, 4:36 PM
Lydia_Pintscher removed a subtask: T98029: Deploy PageBanner extension on English Wikivoyage project.Aug 10 2015, 4:47 PM
Lydia_Pintscher added a parent task: T98029: Deploy PageBanner extension on English Wikivoyage project.
Jdlrobson added a comment.Aug 10 2015, 5:56 PM

I don't really agree this is a blocker, given this feature has to be turned on via a feature flag. It could be a blocker for enabling that feature flag but given this is running on the beta cluster now we will certainly be finding serious bugs before they hit production.

greg subscribed.Aug 10 2015, 6:31 PM

Right, this blocks production deploy, not Beta Cluster.

Jdlrobson added a comment.Aug 10 2015, 6:41 PM

Let me try again.. :)
The Wikidata integration must be turned on explicitly via a global config variable which is off by default so I'm suggesting this /doesn't/ block a production deploy. The extension has a soft dependency on Wikidata.

Jdlrobson removed a parent task: T98029: Deploy PageBanner extension on English Wikivoyage project.Aug 13 2015, 4:39 PM

I'll get to this next week. The wikidata part of the extension is a soft dependency and we are not turning it on just yet.

Jdlrobson moved this task from Backlog to Epics on the Wikidata-Page-Banner board.Aug 13 2015, 7:38 PM
Jdlrobson added a parent task: T108839: Configuration changes for English Wikivoyage for WikidataPageBanner.
JanZerebecki added a comment.Aug 14 2015, 2:50 PM

Thank you.

Jdlrobson added a comment.Aug 15 2015, 12:17 AM

API is definitely something we could explore - but doesn't that internally run an API request and I'm not sure if that would scale?

I think this is enough provided Wikibase follows normal deprecation procedures (it's worth noting MobileFrontend uses the Wikibase API like this too)!

gerritbot subscribed.Aug 15 2015, 12:17 AM

Change 231724 had a related patch set uploaded (by Jdlrobson):
WikidataPageBanner should run Wikibase tests

https://gerrit.wikimedia.org/r/231724

gerritbot added a project: Patch-For-Review.Aug 15 2015, 12:17 AM
gerritbot added a comment.Aug 15 2015, 12:37 AM

Change 231724 merged by jenkins-bot:
WikidataPageBanner should run Wikibase tests

https://gerrit.wikimedia.org/r/231724

• Konfused-Kitten mentioned this in rCICF340476e4954e: WikidataPageBanner should run Wikibase tests.Aug 15 2015, 12:40 AM
Jdlrobson closed this task as Resolved.Aug 15 2015, 12:42 AM
Jdlrobson claimed this task.

Let us know if anything else is needed!

Jdlrobson reopened this task as Open.Aug 15 2015, 3:59 AM

Seeing:
03:50:47 1) ResourcesTest::testMissingDependencies
03:50:47 The module 'wikibase' required by 'wikibase.datamodel.__namespace' must exist
03:50:47 Failed asserting that an array contains 'wikibase'.
03:50:47
03:50:47 /mnt/jenkins-workspace/workspace/mwext-testextension-zend/src/tests/phpunit/structure/ResourcesTest.php:84
03:50:47 /mnt/jenkins-workspace/workspace/mwext-testextension-zend/src/tests/phpunit/MediaWikiTestCase.php:131
03:50:47
Have I configured it wrong.. or is there a bug in wikibase?

JanZerebecki added a comment.Aug 15 2015, 9:48 AM

*sigh* I forgot about T95897, which needs to be fixed for it to work. (Otherwise Wikibase is disabled. The error comes from T109171 which we don't need to fix for this to work.)

Jdlrobson added a comment.Aug 15 2015, 3:44 PM

https://gerrit.wikimedia.org/r/#/c/231779/

Jdlrobson added a subscriber: Sumit.Aug 15 2015, 7:15 PM

^ @Sumit fyi.

Lydia_Pintscher moved this task from incoming to monitoring on the Wikidata board.Aug 17 2015, 3:17 PM
Jdlrobson added a comment.Aug 17 2015, 3:56 PM

@JanZerebecki anything we can do in the mean time? e.g. run the extensions test in Wikibase builds? I just want to ensure any broken tests are caught before they hit any of our instances.

gerritbot added a comment.Aug 18 2015, 3:50 PM

Change 232278 had a related patch set uploaded (by JanZerebecki):
Revert "Revert "WikidataPageBanner should run Wikibase tests""

https://gerrit.wikimedia.org/r/232278

gerritbot added a comment.Aug 18 2015, 3:55 PM

Change 232278 merged by jenkins-bot:
Revert "Revert "WikidataPageBanner should run Wikibase tests""

https://gerrit.wikimedia.org/r/232278

JanZerebecki mentioned this in rCICF700f38020a19: Revert "Revert "WikidataPageBanner should run Wikibase tests"".Aug 18 2015, 3:56 PM
JanZerebecki added a comment.Aug 18 2015, 4:15 PM

I fixed the problem and restored your patch. It is now working.

In T106772#1541906, @Jdlrobson wrote:

API is definitely something we could explore - but doesn't that internally run an API request and I'm not sure if that would scale?

Not sure if that works for this case, but there is FauxRequest. I don't think the scalability of doing the API request is worse than doing the same thing via Wikibase internal functions.

Jdlrobson closed this task as Resolved.Aug 18 2015, 9:33 PM

Thanks a bunch @JanZerebecki !
Can you open a new task describing moving to API request and tag it with MobileFrontend and WikidataPageBanner - as MobileFrontend is doing exactly the same and it would be good to tackle this properly separately.

JanZerebecki reopened this task as Open.Aug 21 2015, 2:44 PM
JanZerebecki removed a parent task: T106773: find extensions using code directly from Wikibase and provide mechanism with a stable interface.
JanZerebecki added a parent task: T103070: [Story] Find extensions using code directly from Wikibase and provide mechanism with a stable interface.

I don't think there is a yet a test that exercises the code lines that call Wikibase.

JanZerebecki mentioned this in T109836: Try replacing Wikibase usages with API usages.Aug 21 2015, 2:57 PM
hashar triaged this task as High priority.Aug 24 2015, 2:03 PM
Jdlrobson moved this task from Epics to Backlog on the Wikidata-Page-Banner board.Aug 28 2015, 7:28 PM
thiemowmde removed a project: Wikibase-DataModel-Services.Sep 10 2015, 2:45 PM
Jdlrobson removed a project: Patch-For-Review.Sep 23 2015, 7:30 PM
Jdlrobson removed Jdlrobson as the assignee of this task.Sep 30 2015, 5:50 PM
Jdlrobson removed projects: Wikidata, Wikidata-Page-Banner.
JanZerebecki added projects: Wikidata, Wikidata-Page-Banner.Sep 30 2015, 6:00 PM
JanZerebecki removed a project: Continuous-Integration-Config.
Jdlrobson added a comment.Sep 30 2015, 6:14 PM

The code change needs to be made in Continuous-Integration-Config no? Even the description mentions " integration/config.git/zuul/ext_dependencies.py "

So I'm very confused by the projects on this card. This doesn't require any changes in Wikidata nor WikidataPageBanner that I can see unless I'm missing something...

JanZerebecki updated the task description. (Show Details)Sep 30 2015, 6:22 PM

T106772#1560579

Jdlrobson added a comment.Sep 30 2015, 6:35 PM

Right now the Wikidata extension is a soft dependency so I guess this would be a test that only works when both installed? (I assume you can skip it if not?)

JanZerebecki added a comment.Sep 30 2015, 6:38 PM

Yes.

Jdlrobson added a comment.Sep 30 2015, 6:42 PM

Thanks for your clarifications!

MBinder_WMF added a project: Web-Team-Backlog.May 17 2016, 6:33 PM
• Jhernandez lowered the priority of this task from High to Low.May 25 2016, 4:19 PM
• Jhernandez moved this task from Incoming to Triaged but Future on the Web-Team-Backlog board.
• Jhernandez added a project: patch-welcome.
Jdlrobson moved this task from Triaged but Future to Tracking on the Web-Team-Backlog board.Jul 7 2017, 11:27 PM
Jdlrobson edited projects, added Web-Team-Backlog (Tracking); removed Web-Team-Backlog.
Jdlrobson moved this task from Untriaged to Discuss further on the Web-Team-Backlog (Tracking) board.
Jdlrobson moved this task from Discuss further to Untag on the Web-Team-Backlog (Tracking) board.Dec 7 2021, 7:32 PM
Jdlrobson removed a project: Web-Team-Backlog (Tracking).Dec 7 2021, 7:47 PM
Pppery added a project: Test-Coverage.Wed, Mar 27, 5:23 PM
Restricted Application added a project: wmde-wikidata-tech. · View Herald TranscriptWed, Mar 27, 5:23 PM
ArthurTaylor moved this task from Incoming to Other Projects on the wmde-wikidata-tech board.Tue, Apr 2, 2:52 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL