Page MenuHomePhabricator
Create Task
Maniphest T90177

Create end-to-end automated test for Wikipedia native app(s)
Closed, DeclinedPublic
Actions

Description

Please reach out to the commenters on this thread or Brian Gerstle (bgerstle) directly on Freenode webchat on the #wikimedia-mobile channel.

We have been discussing doing this for some time. The Hackathon would be an ideal situation to create a spike that would be valuable into the future.

Our current thinking is to use Appium and SauceLabs for this work.

At various time we have reviewed mobile test frameworks, and Appium seems to be both well supported and also the best fit for our existing UI test framework.

There are also platform-specific "integration test" frameworks that might be worth exploring:

Related Objects
Search...

Event Timeline

• Cmcmahon created this task.Feb 20 2015, 4:04 PM
• Cmcmahon raised the priority of this task from to Medium.
• Cmcmahon updated the task description. (Show Details)
• Cmcmahon added projects: Wikimedia-Hackathon-2015, Release-Engineering-Team, Mobile-Apps.
• Cmcmahon added subscribers: • Cmcmahon, zeljkofilipin.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 20 2015, 4:04 PM
Qgil moved this task from Backlog to Hacking proposals on the Wikimedia-Hackathon-2015 board.Feb 24 2015, 7:17 PM
Dbrant subscribed.Feb 26 2015, 2:05 PM
Dbrant added a parent task: T91510: Hackathon-able / volunteer-worthy tasks for Mobile Apps.Mar 4 2015, 3:32 PM
• Deskana updated the task description. (Show Details)Mar 10 2015, 4:20 PM
• Deskana edited projects, added Wikipedia-Android-App-Backlog; removed Mobile-Apps.
• Deskana set Security to None.
• bearND subscribed.Mar 10 2015, 8:40 PM
• Deskana moved this task from Needs Triage to Tracking on the Wikipedia-Android-App-Backlog board.Mar 16 2015, 9:15 PM
zeljkofilipin mentioned this in T92565: Release/QA tasks at the Wikimedia Hackathon 2015.Mar 17 2015, 4:46 PM
Liuxinyu970226 subscribed.Mar 18 2015, 6:03 AM
• BGerstle-WMF subscribed.Mar 19 2015, 9:57 PM
Etonkovidova subscribed.Mar 19 2015, 11:17 PM

The question came from iOS App team: Do we have the similar ticket for iOS App? Or iOS App test automation is already in progress?

zeljkofilipin added a comment.Mar 20 2015, 11:21 AM

@Etonkovidova: we do not have a similar ticket for ios, feel free to create one!

• BGerstle-WMF added a comment.Mar 20 2015, 4:19 PM

I have experience with setting up Appium for iOS and had been hoping to do so soon. Happy to help!

• BGerstle-WMF added a comment.Mar 20 2015, 4:20 PM

Also, would be nice to leverage Vagrant here for faster and more reliable tests.

zeljkofilipin mentioned this in T74641: investigate using ChromeDriver on Android.Mar 26 2015, 12:39 PM
• BGerstle-WMF added a comment.May 11 2015, 9:00 PM

Any updates on this? Would love to hack on it at Lyon.

greg added subscribers: dduvall, greg.May 11 2015, 9:02 PM
In T90177#1277439, @BGerstle-WMF wrote:

Any updates on this? Would love to hack on it at Lyon.

No.

@zeljkofilipin / @dduvall / @Etonkovidova: would this be something you'd like to work on at the hackathon?

zeljkofilipin removed a subscriber: • Cmcmahon.May 12 2015, 1:25 PM
In T90177#1277450, @greg wrote:

@zeljkofilipin / @dduvall / @Etonkovidova: would this be something you'd like to work on at the hackathon?

I am interested.

zeljkofilipin added a comment.May 12 2015, 1:28 PM
In T90177#1277439, @BGerstle-WMF wrote:

Any updates on this? Would love to hack on it at Lyon.

What kind of updates are you looking for? :)

• BGerstle-WMF added a project: Wikipedia-iOS-App-Backlog.May 13 2015, 3:32 PM
• BGerstle-WMF moved this task from Needs Triage to Product Backlog on the Wikipedia-iOS-App-Backlog board.
• BGerstle-WMF moved this task from Product Backlog to Tracking on the Wikipedia-iOS-App-Backlog board.May 13 2015, 3:34 PM

@zeljkofilipin mainly whether or not anyone is actually hacking on this. i'd be happy to hack on it, but haven't found a non-WMF buddy yet, so wasn't sure if it was kosher for me to hack on this with other WMF people.

greg added a comment.May 13 2015, 3:49 PM
In T90177#1282338, @BGerstle-WMF wrote:

@zeljkofilipin mainly whether or not anyone is actually hacking on this. i'd be happy to hack on it, but haven't found a non-WMF buddy yet, so wasn't sure if it was kosher for me to hack on this with other WMF people.

I think we're definitely open to working on it while there :) And yeah, it's a hard balancing act at Hackathons between dedicated hacking time with coworkers you rarely see vs welcoming and helping and doing awesome things with volunteers you even more rarely see.

greg added a project: Continuous-Integration-Infrastructure.May 13 2015, 4:15 PM
Qgil subscribed.May 18 2015, 11:12 AM

It is time to promote Wikimedia-Hackathon-2015 activities in the program (training sessions and meetings) and main wiki page (hacking projects and other ongoing activities). Follow the instructions, please. If you have questions, about this message, ask here.

• BGerstle-WMF mentioned this in T97712: [SPIKE] Try to crash the app using automated tests.May 18 2015, 9:34 PM
• BGerstle-WMF renamed this task from Create end-to-end test for Wikipedia Android app to Hacking: Create end-to-end automated test for Wikipedia native app(s).May 18 2015, 9:38 PM
• BGerstle-WMF claimed this task.
• BGerstle-WMF updated the task description. (Show Details)
• BGerstle-WMF mentioned this in T100071: Workshop: Writing tests for native apps.May 23 2015, 11:05 AM
greg renamed this task from Hacking: Create end-to-end automated test for Wikipedia native app(s) to Create end-to-end automated test for Wikipedia native app(s).May 27 2015, 10:36 PM
greg removed a project: Wikimedia-Hackathon-2015.
hashar removed a project: Continuous-Integration-Infrastructure.Jun 2 2015, 2:45 PM
hashar subscribed.

Removed Continuous-Integration-Infrastructure for now since not much work is needed on the infra right now. The task is still in Release-Engineering-Team though.

greg added a project: Browser-Tests-Infrastructure.Sep 9 2015, 11:26 PM

For lack of a better home project (other than team) I'm putting this in Browser-Tests,which are also end-to-end automated tests, just, yeah, different (not sure it's worth it to make an native apps specific E2E phab project yet... yet)

greg removed a project: Release-Engineering-Team.Sep 9 2015, 11:42 PM
zeljkofilipin added a comment.Sep 10 2015, 9:41 AM
In T90177#1623091, @greg wrote:

For lack of a better home project (other than team) I'm putting this in Browser-Tests,which are also end-to-end automated tests, just, yeah, different (not sure it's worth it to make an native apps specific E2E phab project yet... yet)

Maybe we should make Browser-Tests more general and rename it to something like #end-to-end tests.

Željko

• BGerstle-WMF added a comment.Sep 10 2015, 1:07 PM

This will become clearer once iOS (and Android) start writing e2e tests. My initial thoughts were to explore Appium as a way to share acceptance tests across platforms, but it's unclear if that's the best solution for iOS, given recent developments in UI testing (in Xcode 7). Will follow up with you guys once we learn more.

• BGerstle-WMF updated the task description. (Show Details)Sep 10 2015, 1:08 PM
zeljkofilipin moved this task from Inbox to Ruby on the Browser-Tests-Infrastructure board.Sep 30 2015, 3:04 PM
greg added a project: Release-Engineering-Team (Watching / External).May 20 2017, 4:46 PM
zeljkofilipin added a project: Ruby.May 26 2017, 3:07 PM
zeljkofilipin lowered the priority of this task from Medium to Low.May 26 2017, 3:30 PM
Aklapper removed • BGerstle-WMF as the assignee of this task.Jul 10 2017, 8:06 AM

[ Resetting assignee as assignee account is not active anymore ]

Qgil unsubscribed.Jul 11 2017, 10:16 AM
zeljkofilipin removed projects: Ruby, Browser-Tests-Infrastructure.Nov 7 2017, 3:23 PM
LGoto closed this task as Declined.Apr 3 2018, 10:12 PM
LGoto subscribed.

Closed as part of board grooming process.

Restricted Application removed a subscriber: Liuxinyu970226. · View Herald TranscriptApr 3 2018, 10:12 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits