Disable/Remove pYsearch
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	jayvdb
	Jul 16 2015, 8:16 PM

Description

pYsearch is used by Pywikibot for Yahoo! searches, and it was supported by Yahoo!.

However it contains a baked in hostname of http://search.yahooapis.com/ , which is the old service that was shut down in 2011.

In addition, it is an unmaintained package on pypi which requires fetching the tarball from sourceforge.net, which can cause build breakages whenever sourceforge.net has problems, such as T106062: Travis builds failing due to 403 downloading pYsearch from sourceforge.net.

Yahoo now offers Boss Search API, hosted at https://yboss.yahooapis.com/ , and there appear to be a few packages which provide that.

https://pypi.python.org/pypi/justsearch
https://pypi.python.org/pypi/yboss
https://pypi.python.org/pypi/YahooBoss-Python

However, using Boss Search incurs fees, so it is probably unsuitable for bot usage. Their pricing page goes to a Terms of Use page which doesnt appear to include pricing details. Boss Overview includes a link for Pricing, however that doesnt load anything at all.

Details

Subject	Repo	Branch	Lines +/-
[cleanup] Remove unused code in 4 files	pywikibot/core	master	+16 -77
Remove dependency on pYsearch	pywikibot/core	2.0	+6 -6
Remove dependency on pYsearch	pywikibot/core	master	+6 -8

Customize query in gerrit

Related Objects

Mentioned In: T205750: Find an alternative for missing dependencies
T75704: Python 3 library support
rPWBC2ad0dd765900: Remove dependency on pYsearch
Mentioned Here: T106062: Travis builds failing due to 403 downloading pYsearch from sourceforge.net

Event Timeline

jayvdb created this task.Jul 16 2015, 8:16 PM

jayvdb claimed this task.

jayvdb raised the priority of this task from to High.

jayvdb updated the task description. (Show Details)

jayvdb added a project: Pywikibot.

jayvdb subscribed.

Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. · View Herald TranscriptJul 16 2015, 8:16 PM

jayvdb updated the task description. (Show Details)Jul 16 2015, 8:19 PM

jayvdb set Security to None.

Change 225219 had a related patch set uploaded (by John Vandenberg):
Remove dependency on pYsearch

https://gerrit.wikimedia.org/r/225219

gerritbot added a project: Patch-For-Review.Jul 16 2015, 8:29 PM

Ricordisamoa subscribed.Jul 16 2015, 10:11 PM

Change 225219 merged by jenkins-bot:
Remove dependency on pYsearch

https://gerrit.wikimedia.org/r/225219

jayvdb mentioned this in rPWBC2ad0dd765900: Remove dependency on pYsearch.Jul 17 2015, 3:36 AM

jayvdb lowered the priority of this task from High to Medium.Jul 17 2015, 11:01 AM

jayvdb removed a project: Patch-For-Review.

Change 258728 had a related patch set uploaded (by John Vandenberg):
Remove dependency on pYsearch

https://gerrit.wikimedia.org/r/258728

Restricted Application added a project: Internet-Archive. · View Herald TranscriptDec 13 2015, 4:08 AM

gerritbot added a project: Patch-For-Review.Dec 13 2015, 4:08 AM

Change 258728 merged by jenkins-bot:
Remove dependency on pYsearch

https://gerrit.wikimedia.org/r/258728

Yahoo BOSS is also being discontinued, on March 31, 2016
https://developer.yahoo.com/boss/
Apparently the replacement is Yahoo Partner Ads (YPA)
https://developer.yahoo.com/ypa/

Sounds like an even less attractive option.

jayvdb removed a project: Patch-For-Review.Jan 14 2016, 2:09 AM

jayvdb edited projects, added Pywikibot-pagegenerators.py; removed Internet-Archive.

jayvdb mentioned this in T75704: Python 3 library support.May 22 2016, 1:07 AM

There is also the Search SDK, which looks better https://developer.yahoo.com/search-sdk/

And two page scrappers:

Dvorapa mentioned this in T205750: Find an alternative for missing dependencies.Sep 28 2018, 9:24 PM

Change 474727 had a related patch set uploaded (by Nils ANDRE; owner: Nils ANDRE):
[pywikibot/core@master] [cleanup] Remove unused code in 4 files

https://gerrit.wikimedia.org/r/474727

gerritbot added a project: Patch-For-Review.Nov 25 2018, 10:19 AM

Change 474727 merged by jenkins-bot:
[pywikibot/core@master] [cleanup] Remove unused code in 4 files