Make pywikibot work with SQL on all platforms and all Python versions supported
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Dvorapa
	Feb 12 2018, 10:12 PM

Description

Steps to reproduce

run any script with -mysqlquery or replace.py with -sql parameter

Expected behavior
If the database is live (on Toolforge automatically, at home using replicas from dump), the pagegenerator should retrieve pages according to the query and process them

Current behavior
It throws an error, if you fix it, it throws another one and another one and ... on Windows. On Linux it works, but has some not really good features as listed in subtasks. Also a documentation how to use it should exist. On Python 3.6 it can not install dependencies for sql at all

Related Objects
Search...

Status	Assigned	Task
Resolved	Mpaa	T187122 Make pywikibot work with SQL on all platforms and all Python versions supported
Resolved	Dvorapa	T142021 Error mysqlquery
Resolved	Dvorapa	T187124 Create a manual on MW how to make pywikibot work with SQL
Resolved	Mpaa	T89976 mysql support should fall back to dependency on pure python package PyMySQL
Resolved	Andrew	T189052 install pymysql on tools-bastion-03

Event Timeline

Dvorapa created this task.Feb 12 2018, 10:12 PM

Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. · View Herald TranscriptFeb 12 2018, 10:12 PM

Dvorapa added a subtask: T142021: Error mysqlquery.Feb 12 2018, 10:12 PM

Dvorapa added a subtask: T187124: Create a manual on MW how to make pywikibot work with SQL.Feb 12 2018, 10:17 PM

Dvorapa added a subtask: T89976: mysql support should fall back to dependency on pure python package PyMySQL.Feb 12 2018, 10:31 PM

What is the error exactly?
I get this:

mpaa@tools-bastion-03:~/core {master}$ python scripts/listpages.py -mysqlquery:"SELECT page_namespace, page_title FROM page WHERE page_namespace = 0 LIMIT 15"
   1 "?"
   2 "A Bruised Reed Shall He Not Break"
   3 "A Family Sketch"
   4 "A Little While"
   5 "A Morris for May-Day"
   6 "Abstinence sows sand all over"
   7 "Amarillis I Did Woo"
   8 "And the sins of the fathers shall be"
   9 "And with what body do they come?" --
  10 "And with what body do they come?" —
  11 "Arcturus" is his other name --
  12 "Arcturus" is his other name —
  13 "As the Coming of Dawn"
  14 "Ave Caesar"
  15 "Back to the Army Again"
15 page(s) found

Well, at least on my Windows it doesn't work at all, stuck on libraries installation. On my Linux (and Toolforge) it works with ton of deps and additional compiler installed and only on some versions of Python in addition. See subtasks for more

Dvorapa renamed this task from Make pywikibot work with SQL again to Make pywikibot work with SQL on all platforms.Feb 12 2018, 11:18 PM

Dvorapa updated the task description. (Show Details)

Yeah, and on Python 3.6 it fails to install dependencies on any platform I've tried

zhuyifei1999 subscribed.Feb 13 2018, 4:56 AM

Dvorapa closed subtask T89976: mysql support should fall back to dependency on pure python package PyMySQL as Resolved.Jun 11 2018, 9:38 AM

Dvorapa added a project: TestMe.Jun 11 2018, 10:21 AM

Dvorapa closed subtask T142021: Error mysqlquery as Resolved.Jun 16 2018, 7:53 PM

I've tested it after @Mpaa's patch on Toollabs (Debian/Ubuntu) and also on my local machine (Arch Linux) using sql dump and it works for me as expected on both Python 2 and 3. I'm closing this for now, but still waiting for someone who could test it on Windows (and Mac?). Please anyone test it by yourself too and reopen/open new task if any problem occurs.

Dvorapa triaged this task as Medium priority.Jun 16 2018, 8:08 PM

Dvorapa removed a project: TestMe.

Dvorapa closed subtask T187124: Create a manual on MW how to make pywikibot work with SQL as Resolved.Jun 17 2018, 12:31 AM

Make pywikibot work with SQL on all platforms and all Python versions supportedClosed, ResolvedPublicActions

Description

Related ObjectsSearch...

Event Timeline

Make pywikibot work with SQL on all platforms and all Python versions supported
Closed, ResolvedPublic
Actions

Related Objects
Search...