Page MenuHomePhabricator
Create Task
Maniphest T91874

Reduce amount of Tools-local packages
Closed, ResolvedPublic
Actions

Description

A full list of aptly/tools-local packages is available here: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Admin/local_packages

Packages not packaged elsewhere:

PackageDebian Request for PackageTools User Request
libmediawiki-bot-perlRequest7072152db73a31110077605a554d9b01f246647f (maybe related to this IRC conversation with UA31_)
python-flask-oauthRequest78ed78069f1c156a82c54541afff0990bde41d77 (AFAICS, Analytics-Wikimetrics moved off-project)
python-mwparserfromhellRequestT65539: Install package mwparserfromhell -- T86015: Install all pywikibot python optional dependencies on tool labs
python-oursqlRequestT51063: Install oursql
python-wikitoolsRequestT51064: Install wikitools
sbtRequestT50859: system wide software request: sbt

Packages already packaged for other releases:

PackageUbuntu Precise BackportsUbuntu TrustyUbuntu Trusty BackportsUbuntu UtopicUbuntu VividDebian Jessie
python-socketio-clientRequestXXXX
python-websocketXXXXXX

The process to request backports in Ubuntu is described here.

Details

SubjectRepoBranchLines +/-
Tools: Source python-socketio-client for Trusty from backportsoperations/puppetproduction+18 -0
Tools: Do not require package python-shoperations/puppetproduction+0 -1
Tools: Do not require redundant package python-celery-with-redisoperations/puppetproduction+0 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

yuvipanda created this task.Mar 7 2015, 11:52 AM
yuvipanda raised the priority of this task from to Needs Triage.
yuvipanda updated the task description. (Show Details)
yuvipanda added a project: Toolforge.
yuvipanda added subscribers: scfc, Aklapper, coren, yuvipanda.
yuvipanda removed a subtask: T91879: Rename 'misctools' toollabs package to something more appropriate.Mar 7 2015, 12:43 PM
yuvipanda closed subtask T91878: Get rid of custom nginx packages as Resolved.Mar 8 2015, 11:00 AM
scfc triaged this task as Low priority.Apr 6 2015, 7:30 AM
scfc moved this task from Backlog to Ready to be worked on on the Toolforge board.
scfc closed subtask T91877: Investigate system-level packages as Resolved.Apr 22 2015, 4:00 PM
scfc updated the task description. (Show Details)Apr 22 2015, 5:11 PM
scfc set Security to None.
scfc updated the task description. (Show Details)Apr 22 2015, 5:16 PM
scfc updated the task description. (Show Details)May 24 2015, 11:32 PM
scfc renamed this task from Reduce amount of tools-local packages to Reduce amount of Tools-local packages .May 24 2015, 11:58 PM
scfc updated the task description. (Show Details)
scfc added a comment.May 25 2015, 12:01 AM

@yuvipanda, you added sbt to toollabs::dev_environ with d90368777c67f40c35e59cd7f5a5b898dbff89cb:

Toollabs: Add sbt to dev environments

Scala Build Tool, for anyone who wants to build scala things

Was there actual user demand for that, or could we just drop it?

scfc added a comment.May 25 2015, 1:19 AM

I have moved /data/project/.system/deb-trusty/python3-statsd_3.0.1-1_all.deb and /data/project/.system/deb-{precise,trusty}/python-websocket-client_0.23.0-1_all.deb to ~tools.admin/archived-packages/ as they were not referenced by Puppet manifests.

scfc updated the task description. (Show Details)May 25 2015, 1:19 AM
scfc added a comment.May 25 2015, 2:20 AM

I have also moved /data/project/.system/deb-{precise,trusty}/python-backports.ssl-match-hostname_3.4.0.2-1_all.deb to ~tools.admin/archived-packages/ as it was not referenced by Puppet manifests.

@yuvipanda, you have also added python-sh with 5a715f8069bcf649410801143c97c89cf29fb0ac:

tools: Add python-sh package to exec_environ

Package built and deployed to local repo

Was that due to user demand?

scfc updated the task description. (Show Details)May 25 2015, 2:20 AM
scfc updated the task description. (Show Details)May 25 2015, 2:35 AM
yuvipanda added a comment.May 25 2015, 8:33 AM

Yes, python-sh was used for one of my own tools (Such A Bot) but it uses a virtenv now so can be killed.

yuvipanda added a comment.May 25 2015, 2:51 PM

python-sh is gone

scfc updated the task description. (Show Details)May 25 2015, 3:17 PM
scfc added a subscriber: Legoktm.

@yuvipanda, what about sbt?

scfc updated the task description. (Show Details)May 25 2015, 3:19 PM
valhallasw updated the task description. (Show Details)May 25 2015, 3:40 PM
scfc updated the task description. (Show Details)May 25 2015, 3:57 PM
scfc updated the task description. (Show Details)May 25 2015, 4:26 PM
scfc updated the task description. (Show Details)May 25 2015, 6:37 PM
scfc added a comment.May 26 2015, 3:45 AM

python-celery-with-redis is a "bundle" that "installs the following packages: ['celery>=3.0,<4.0', 'redis>=2.4.4']". However, if those specific versions were indeed wanted, they wouldn't be fulfilled by the current package as it just requires python-celery and python-redis unconditionally.

As Debian is very careful to stay backwards-compatible and we already require the packages python-celery and python-redis (via ::redis::client::python) in exec_environ.pp, I think that package should just be removed from Puppet and subsequently archived.

gerritbot subscribed.May 26 2015, 3:55 AM

Change 213777 had a related patch set uploaded (by Tim Landscheidt):
Tools: Do not require redundant package python-celery-with-redis

https://gerrit.wikimedia.org/r/213777

gerritbot added a project: Patch-For-Review.May 26 2015, 3:55 AM
gerritbot added a comment.May 26 2015, 10:36 AM

Change 213777 merged by Yuvipanda:
Tools: Do not require redundant package python-celery-with-redis

https://gerrit.wikimedia.org/r/213777

scfc mentioned this in rOPUP9ab279d69ee0: Tools: Do not require redundant package python-celery-with-redis.May 26 2015, 10:37 AM
gerritbot added a comment.May 26 2015, 5:02 PM

Change 213849 had a related patch set uploaded (by Tim Landscheidt):
Tools: Do not require package python-sh

https://gerrit.wikimedia.org/r/213849

scfc updated the task description. (Show Details)May 26 2015, 5:20 PM
scfc updated the task description. (Show Details)May 26 2015, 7:36 PM
scfc added a comment.May 26 2015, 11:50 PM

Ha! I got confused by my own clean-up: python-socketio-client depends on python-websocket-client which depends on python-backports.ssl-match-hostname. So one more package for backporting.

scfc updated the task description. (Show Details)May 27 2015, 12:31 AM
scfc updated the task description. (Show Details)May 28 2015, 4:21 PM
scfc updated the task description. (Show Details)May 31 2015, 10:44 PM
yuvipanda mentioned this in T100977: Install "internetarchive" python module.Jun 1 2015, 12:13 PM
gerritbot added a comment.Jun 7 2015, 10:26 AM

Change 213849 merged by Yuvipanda:
Tools: Do not require package python-sh

https://gerrit.wikimedia.org/r/213849

yuvipanda mentioned this in rOPUPba3fa2a86f66: Tools: Do not require package python-sh.Jun 7 2015, 10:26 AM
scfc mentioned this in T110836: nginx puppet manifest requires nfs so error page cannot be updated over puppet.Aug 30 2015, 4:20 PM
gerritbot added a comment.Sep 16 2015, 1:08 AM

Change 238662 had a related patch set uploaded (by Tim Landscheidt):
Tools: Source python-socketio-client for Trusty from backports

https://gerrit.wikimedia.org/r/238662

Restricted Application added a project: Cloud-Services. · View Herald TranscriptSep 16 2015, 1:08 AM
scfc added a subtask: T123890: Backports are enabled in new Trusty instances.Jan 17 2016, 10:57 PM
Andrew closed subtask T123890: Backports are enabled in new Trusty instances as Resolved.Apr 1 2016, 9:54 PM
gerritbot added a comment.Apr 3 2016, 7:57 PM

Change 238662 abandoned by Tim Landscheidt:
Tools: Source python-socketio-client for Trusty from backports

Reason:
Backports are now enabled on all Labs instances.

https://gerrit.wikimedia.org/r/238662

valhallasw closed subtask T114645: Define policy for tools-local packages as Resolved.May 27 2016, 12:17 PM
valhallasw updated the task description. (Show Details)
zhuyifei1999 subscribed.Jul 19 2016, 10:06 AM
scfc removed a project: Patch-For-Review.Nov 27 2016, 12:56 AM
scfc mentioned this in T159024: Reinstall python-socketio-client (python-websocket).Feb 25 2017, 2:17 AM
scfc mentioned this in T159025: Pull python-socketio-client and python-websocket from backports.Feb 25 2017, 2:42 AM
scfc created subtask T159025: Pull python-socketio-client and python-websocket from backports.
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:53 PM
hashar subscribed.Mar 11 2019, 8:27 PM

pywikibot no more support oursql, it has been replaced by PyMySQL which is available on toolforge. Probably the local oursql package can be removed.

• GTirloni edited projects, added cloud-services-team (Kanban); removed Cloud-Services.Mar 21 2019, 9:18 PM
hashar unsubscribed.Mar 22 2019, 11:44 PM
bd808 closed subtask T159025: Pull python-socketio-client and python-websocket from backports as Resolved.Mar 26 2019, 1:35 AM
bd808 closed this task as Resolved.Mar 26 2019, 2:05 AM
bd808 claimed this task.
bd808 subscribed.

Fixed by time! https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/local_packages

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL