oar is using 207G on Tools
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• chasemp
	May 25 2016, 2:56 PM

Description

The majority of this seems to be in older archives and folders in project/oar:

11G	parsed
14G	dump
14G	repository_metadata_2014-06-13.tar.gz
73G	fullextracted
75G	repository_text_2014-06-13.tar.gz

These seem to be from 2014:

project/oar# ls -dl fullextracted
drwxr-sr-x 23 52074 52074 4096 Nov  7  2014 fullextracted
project/oar# ls -al repository_text_2014-06-13.tar.gz
-rw-r--r-- 1 52074 52074 80310302720 Jun 13  2014 repository_text_2014-06-13.tar.gz
project/oar# ls -al repository_metadata_2014-06-13.tar.gz
-rw-r--r-- 1 52074 52074 14867783680 Jun 13  2014 repository_metadata_2014-06-13.tar.gz
project/oar# ls -dl dump
drwxr-sr-x 2 52074 52074 49152 Sep  1  2014 dump
project/oar# ls -dl parsed
drwxr-sr-x 2 52074 52074 294912 Nov  4  2014 parsed

Can we remove these old files? What is the data retention policy for this tool?

I do not see this tool running, and there appears to be no activity in 2016. Can this tool be removed?

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		bd808	T136212 Contact tool maintainters using large amounts of disk space
		Resolved		bd808	T136201 oar is using 207G on Tools

Event Timeline

• chasemp created this task.May 25 2016, 2:56 PM

Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptMay 25 2016, 2:56 PM

bd808 added a parent task: T136212: Contact tool maintainters using large amounts of disk space.May 25 2016, 4:07 PM

bd808 moved this task from Backlog to Waiting for information on the Toolforge board.

EdSaperia: "I'm trying to raise more funds for it
So keep would be nice"

In T136201#2327081, @A930913 wrote:

EdSaperia: "I'm trying to raise more funds for it
So keep would be nice"

Can you elaborate on what this means and who this person is in relation to the tool?

This tool comes from the grant at https://meta.wikimedia.org/wiki/Grants:IEG/Open_Access_Reader applied for by Ed Saperia.
He is saying that he is seeking more funds for further research and so keeping it would be useful.

In T136201#2328244, @A930913 wrote:

This tool comes from the grant at https://meta.wikimedia.org/wiki/Grants:IEG/Open_Access_Reader applied for by Ed Saperia.
He is saying that he is seeking more funds for further research and so keeping it would be useful.

OK thanks @A930913, I'm going to stall this for now.

These two files are particularly problematic:

73G fullextracted
75G repository_text_2014-06-13.tar.gz

but giving a bit of time to sort things out isn't a big deal.

Somewhat amusingly, just a week shy of 4 years later, the amount of disk space being used is exactly the same...

tools.oar@tools-sgebastion-07:~$ du -sh .
207G	.

Four yeas later I am boldly reopening this as that has been "a bit of time" and as this is still an issue.

@A930913: Any news? (If you are still around.)

lastmod time on $HOME/service.manifest of 2019-01-15
No webservice running
@A930913 is the owner of the tool
- their last activity on Phabricator was the comment on this bug (T136201#2328244) on 2016-05-25
- their last edit on any wiki (according to GUC) was 2016-04-03
files that would be served by the tool if its webservice was running are timestamped from mid to late 2014.

We could archive the tool's $HOME to /data/scratch and let it rot there until the next time scratch crashes or we could just delete it outright.

bd808 edited projects, added cloud-services-team (Kanban); removed Cloud-Services.May 20 2020, 12:17 AM

bd808 mentioned this in T253811: Determine if oar is abandoned.May 27 2020, 9:11 PM