Page MenuHomePhabricator
Create Task
Maniphest T173498

Travis jobs with OAuth wait for password input and get terminated
Closed, ResolvedPublic
Actions

Description

https://travis-ci.org/wikimedia/pywikibot-core/jobs/265424635#L4408
https://travis-ci.org/wikimedia/pywikibot-core/jobs/265424634#L1599

tests/site_tests.py::TestUsernameInUsers::test_username_in_users Password for user Pywikibot-oauth on wpbeta:en (no characters will be shown): 

The job exceeded the maximum time limit for jobs, and has been terminated.

Job #20 (with OAuth on test.wikpedia.org) has more than 1000 of the following warning:

WARNING: /home/travis/build/wikimedia/pywikibot-core/pywikibot/comms/http.py:345: UserWarning: Invalid authentication tokens for test.wikipedia.org set in `config.authenticate`

The failure has appeared after 4bb76aa, but I can't find any relation between that commit and the failure.
Also it only has affected jobs #15, #16, and #20. These jobs have OAUTH_DOMAIN set in their enviroment variable.

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
Revert "travis.yml: Print the length and type of config.authenticate values"Dvorapapywikibot/coremaster+0 -1
travis.yml: Print the length and type of config.authenticate valuesDalbapywikibot/coremaster+1 -0
.travis.yml: Escape single quotes when printing oauth_token_varDalbapywikibot/coremaster+1 -1
Re-enable OAuth testsDalbapywikibot/coremaster+6 -8
travis.yml: Disable OAuth jobsDalbapywikibot/coremaster+8 -6
http.py: Show a more descriptive warning about invalid authentication tokensDalbapywikibot/coremaster+5 -3
Customize query in gerrit

Related Objects
Search...

Event Timeline

Dalba created this task.Aug 17 2017, 11:36 AM
Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. · View Herald TranscriptAug 17 2017, 11:36 AM
Dalba updated the task description. (Show Details)Aug 17 2017, 1:49 PM
Dalba updated the task description. (Show Details)
Dalba renamed this task from test_username_in_users is breaking travis jobs on wpbeta:zh and wpbeta:en by waiting for password to test_username_in_users is breaking travis jobs by waiting for password when OAuth is activated.Aug 17 2017, 2:02 PM
Framawiki subscribed.Aug 17 2017, 2:02 PM
Dalba renamed this task from test_username_in_users is breaking travis jobs by waiting for password when OAuth is activated to Travis jobs with OAuth wait for password input and get terminated.Aug 18 2017, 1:21 AM
Dalba updated the task description. (Show Details)
Dalba added a comment.Aug 18 2017, 2:42 AM

That warning is shown [[ https://phabricator.wikimedia.org/diffusion/PWBC/browse/master/pywikibot/comms/http.py;d2af1bab80d49f99fe6a12fefb1e816ad1bea1b7$341 | only if len(config.authenticate[path]) not in [2, 4] ]].

It would be helpful if someone with access to travis enviroment could check that environment variable OAUTH_TOKENS_WIKIPEDIA_TEST has correct format and values.

gerritbot subscribed.Aug 18 2017, 4:04 AM

Change 372499 had a related patch set uploaded (by Dalba; owner: Dalba):
[pywikibot/core@master] http.py: Show a more descriptive warning about invalid authentication tokens

https://gerrit.wikimedia.org/r/372499

gerritbot added a project: Patch-For-Review.Aug 18 2017, 4:04 AM
Xqt triaged this task as High priority.Aug 18 2017, 6:29 AM
Dalba updated the task description. (Show Details)Aug 18 2017, 12:40 PM
gerritbot added a comment.Aug 19 2017, 11:59 AM

Change 372499 merged by jenkins-bot:
[pywikibot/core@master] http.py: Show a more descriptive warning about invalid authentication tokens

https://gerrit.wikimedia.org/r/372499

Xqt closed this task as Resolved.Aug 19 2017, 12:00 PM
Xqt claimed this task.
Dalba reopened this task as Open.Aug 19 2017, 3:38 PM

The last patch wasn't really supposed to resolve this issue, it'll just show a clearer warning:

https://travis-ci.org/wikimedia/pywikibot-core/jobs/266262014#L6341

WARNING: /home/travis/build/wikimedia/pywikibot-core/pywikibot/comms/http.py:347: UserWarning: config.authenticate["zh.wikipedia.beta.wmflabs.org"] has invalid value.

It should contain 2 or 4 items, not 150.

See https://www.mediawiki.org/wiki/Manual:Pywikibot/OAuth for more info.

  .format(path=path, length=len(config.authenticate[path])))

Now we need to find out where do these 150 items are coming from.

Only two possibilities come to my mind, either someone has changed the travis enviroment variable, or we are mutating config.authenticate somewhere during the tests.

Dalba removed Xqt as the assignee of this task.Aug 19 2017, 3:40 PM
Dalba added a subscriber: Xqt.
gerritbot added a comment.Aug 20 2017, 8:06 AM

Change 372778 had a related patch set uploaded (by Dalba; owner: Dalba):
[pywikibot/core@master] travis.yml: Print the length and type of config.authenticate values

https://gerrit.wikimedia.org/r/372778

gerritbot added a comment.Aug 20 2017, 9:17 AM

Change 372778 merged by jenkins-bot:
[pywikibot/core@master] travis.yml: Print the length and type of config.authenticate values

https://gerrit.wikimedia.org/r/372778

Dalba added a project: Diffusion-Repository-Administrators.EditedAug 20 2017, 12:13 PM

The results of the above patch:

https://travis-ci.org/wikimedia/pywikibot-core/jobs/266461986#L1059

$ python -c "from __future__ import print_function;from pywikibot import config as c; a=c.authenticate; [(print('authenticate_key:', i), print('authenticate_value_type:', type(a[i])), print('authenticate_value_length:', len(a[i]))) for i in a]"

authenticate_key: en.wikipedia.beta.wmflabs.org

authenticate_value_type: <type 'unicode'>

authenticate_value_length: 150

authenticate_key: wiki.musicbrainz.org

authenticate_value_type: <type 'tuple'>

authenticate_value_length: 2

https://travis-ci.org/wikimedia/pywikibot-core/jobs/266461987

$ python -c "from __future__ import print_function;from pywikibot import config as c; a=c.authenticate; [(print('authenticate_key:', i), print('authenticate_value_type:', type(a[i])), print('authenticate_value_length:', len(a[i]))) for i in a]"

authenticate_key: wiki.musicbrainz.org

authenticate_value_type: <class 'tuple'>

authenticate_value_length: 2

authenticate_key: zh.wikipedia.beta.wmflabs.org

authenticate_value_type: <class 'str'>

authenticate_value_length: 150

This is immediately after creation of the config file.

Therefore I think the value of OAUTH_TOKENS_WIKIPEDIA_TEST has been changed and has the wrong format.

I don't know who has access to travis enviroment. I'm going to add Diffusion-Repository-Administrators, I hope they can help us by checking pywikibot's enviroment variables on travis-ci.

Specifically the value of the following variables needs to be checked:

  • OAUTH_TOKENS_WIKIPEDIA_TEST
  • OAUTH_TOKENS_WPBETA_EN
  • OAUTH_TOKENS_WPBETA_ZH

AFAIU the code, the expected format for them is:

consumer_token:consumer_secret:access_token:access_secret
Dvorapa added a subscriber: Magul.Aug 20 2017, 12:16 PM
Dalba added a subscriber: Legoktm.Aug 23 2017, 3:30 PM
valhallasw added subscribers: jayvdb, valhallasw.Sep 3 2017, 3:17 PM

I don't know how exactly travis is configured -- I vaguely remember @jayvdb set this up (T104306 is vaguely related).

Given that the Travis account is 'https://travis-ci.org/wikimedia/pywikibot-core', I suspect anyone with access to the wikimedia github account can also access the travis account (probably uses github oauth?).

The password for the user account is stored on toolforge (as mentioned in T100797#1321387). Anyone with access to the pywikibot toolforge account can read the contents of that file.

Xqt added a comment.Sep 5 2017, 2:22 PM

I propose to deactivate all tests which fail for that reason until we can reconfigure it and we can get them work again. Would be great to get the remaining tests passing.

Dalba added a comment.EditedSep 8 2017, 9:54 AM
In T173498#3580136, @Xqt wrote:

I propose to deactivate all tests which fail for that reason until we can reconfigure it and we can get them work again. Would be great to get the remaining tests passing.

There may be lots of them. Looking at the log many of the other tests have ERRORed as well up the point where a password input is prompted, including most/all of the script_tests, some of the pagegenerators_tests, some of the site_tests, page_tests... We might as well completely deactivate OAuth jobs.

gerritbot added a comment.Sep 8 2017, 11:02 AM

Change 376701 had a related patch set uploaded (by Dalba; owner: Dalba):
[pywikibot/core@master] travis.yml: Disable OAuth jobs

https://gerrit.wikimedia.org/r/376701

gerritbot added a comment.Sep 8 2017, 1:16 PM

Change 376701 merged by jenkins-bot:
[pywikibot/core@master] travis.yml: Disable OAuth jobs

https://gerrit.wikimedia.org/r/376701

Dalba removed a project: Patch-For-Review.Sep 12 2017, 4:25 AM
Dvorapa subscribed.Jun 6 2018, 4:28 AM

What is the status of this?

Dvorapa added a project: Wikimedia-GitHub.Jun 6 2018, 4:33 AM
Dvorapa added a comment.Jun 10 2018, 12:05 AM

What is needed to do here?

Dalba added a comment.EditedJun 10 2018, 1:21 AM
In T173498#4269629, @Dvorapa wrote:

What is needed to do here?

Someone with access to Pywikibot-test account and Travis-CI environment should reset Travis environment variables for OAuth, then run the tests on a test branch to see if it fixes the issue.

If fixed, re-enable the test on the master branch, it not, more debugging will be needed. But I'm very hopeful that resetting OAuth tokens will fix it.

Dvorapa added a comment.Jun 10 2018, 12:38 PM

Access to Pywikibot-test account is written in the Pywikibot Toolforge project and access to Travis-CI was given to me and Xqt in T196810.

Dvorapa added a subtask: T196810: Grant access to GitHub's wikimedia/pywikibot repository to current Pywikibot developer base.Jun 10 2018, 12:38 PM
Dvorapa mentioned this in T196843: Grant access to Toolforge's pywikibot tool to current Pywikibot developer base.Jun 10 2018, 12:49 PM
Dvorapa added a subtask: T196843: Grant access to Toolforge's pywikibot tool to current Pywikibot developer base.Jun 10 2018, 12:54 PM
Dvorapa added a comment.Jun 10 2018, 3:24 PM
This comment was removed by Dvorapa.
Dvorapa added a comment.Jun 10 2018, 3:46 PM
This comment was removed by Dvorapa.
Framawiki added a comment.Jun 10 2018, 3:56 PM

I confirm that I can log me in successfully using oauths creds of OAUTH_TOKENS_WIKIPEDIA_TEST found in passwd file.

Dvorapa added a comment.Jun 10 2018, 3:57 PM

Could you also try both OAUTH_TOKENS_WPBETA_**?

Dvorapa added a comment.Jun 10 2018, 3:59 PM

I fixed the keys on Travis (from passwd file). They should be in the form of key:key:key:key. Now we should test them using test branch as Dalba suggested (how?).

Framawiki added a comment.Jun 10 2018, 4:06 PM
In T173498#4270318, @Dvorapa wrote:

Could you also try both OAUTH_TOKENS_WPBETA_**?

I can also successfully log me in on beta:en and beta:zh with the other tokens.

Framawiki closed subtask T196843: Grant access to Toolforge's pywikibot tool to current Pywikibot developer base as Resolved.Jun 10 2018, 4:14 PM
• Vvjjkkii reopened subtask T196810: Grant access to GitHub's wikimedia/pywikibot repository to current Pywikibot developer base as Open.Jul 1 2018, 1:04 AM
• Vvjjkkii reopened subtask T196843: Grant access to Toolforge's pywikibot tool to current Pywikibot developer base as Open.
CommunityTechBot closed subtask T196843: Grant access to Toolforge's pywikibot tool to current Pywikibot developer base as Resolved.Jul 2 2018, 2:58 PM
CommunityTechBot closed subtask T196810: Grant access to GitHub's wikimedia/pywikibot repository to current Pywikibot developer base as Resolved.Jul 2 2018, 3:01 PM
Dalba added a comment.EditedJul 3 2018, 5:19 AM
In T173498#4270319, @Dvorapa wrote:

I fixed the keys on Travis (from passwd file). They should be in the form of key:key:key:key. Now we should test them using test branch as Dalba suggested (how?).

By test branch, I meant pushing to a test repository branch on Github, integrated with Travis, to see if the newly configured credentials work as expected. We can skip that and directly re-enable the disabled jobs on master branch (and revert if the problem still exists).

gerritbot added a comment.Jul 3 2018, 5:34 AM

Change 443545 had a related patch set uploaded (by Dalba; owner: dalba):
[pywikibot/core@master] Re-enable OAuth tests

https://gerrit.wikimedia.org/r/443545

gerritbot added a project: Patch-For-Review.Jul 3 2018, 5:34 AM
gerritbot added a comment.Jul 3 2018, 7:36 AM

Change 443545 merged by jenkins-bot:
[pywikibot/core@master] Re-enable OAuth tests

https://gerrit.wikimedia.org/r/443545

Dalba claimed this task.EditedJul 3 2018, 9:41 AM

The error is still there, but I think I've figured out the wrong part.

gerritbot added a comment.Jul 3 2018, 9:50 AM

Change 443581 had a related patch set uploaded (by Dalba; owner: dalba):
[pywikibot/core@master] .travis.yml: Escape single quotes when printing oauth_token_var

https://gerrit.wikimedia.org/r/443581

gerritbot added a comment.Jul 3 2018, 11:52 AM

Change 443581 merged by jenkins-bot:
[pywikibot/core@master] .travis.yml: Escape single quotes when printing oauth_token_var

https://gerrit.wikimedia.org/r/443581

Dvorapa added a comment.EditedJul 3 2018, 1:09 PM

Multiple wbbeta specific errors occured (no new pages, no af language, main talk page is redirected), but no OAuth failure and the type is finally a tuple, so hopefully this is close to be solved.

Dvorapa added a comment.Jul 3 2018, 1:17 PM

Also we should fix the line https://phabricator.wikimedia.org/diffusion/PWBC/browse/master/.travis.yml$92 finally when this task will be solved

Xqt added a comment.Jul 3 2018, 1:38 PM

travis still fails after the last patch

Dalba added a comment.Jul 3 2018, 1:48 PM
In T173498#4394134, @Xqt wrote:

travis still fails after the last patch

As @Dvorapa mentioned earlier, the failures are not OAuth errors, we should fix them in separate tasks.

The only thing remaining here is to revert 60c301360f44d185a28a69094c7714b1fa14e01a.

gerritbot added a comment.Jul 3 2018, 2:08 PM

Change 443635 had a related patch set uploaded (by Dvorapa; owner: Dvorapa):
[pywikibot/core@master] Revert "travis.yml: Print the length and type of config.authenticate values"

https://gerrit.wikimedia.org/r/443635

gerritbot added a comment.Jul 3 2018, 3:03 PM

Change 443635 merged by jenkins-bot:
[pywikibot/core@master] Revert "travis.yml: Print the length and type of config.authenticate values"

https://gerrit.wikimedia.org/r/443635

Dalba closed this task as Resolved.Jul 3 2018, 3:54 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits