[jobs-api] Allow querying logs for non-existent jobs
Closed, ResolvedPublicFeature
Actions

Assigned To

Authored By

	taavi
	Jul 31 2025, 3:43 PM

Description

Update jobs-api to allow querying for logs for non-existent jobs, since Loki now allows that and it's helpful for one-off jobs.

It should still check that the job name is a valid job name before forwarding the query to Loki.

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	jobs-api: bump to 0.0.393-20250805083756-7ab43158	repos/cloud/toolforge/toolforge-deploy!905	group_203_bot_f4d95069bb2675e4ce1fff090c1c1620	bump_jobs-api	main
	api: Allow querying logs for non-existent jobs	repos/cloud/toolforge/jobs-api!189	taavi	taavi/loki	main

Status	Subtype	Assigned	Task
Resolved		• Bstorm	T126083 overhaul labstore setup [tracking]
Resolved		• GTirloni	T216988 labstore1004 - DISK CRITICAL - free space: /srv/tools 115904 MB (1% inode=79%):
Resolved		• Bstorm	T217993 2019-03-10: tools and NFS share cleanup (high usage)
Resolved		• Bstorm	T122508 Prevent overly-large log files
Declined		None	T286847 Add webservice flag to mount project directory read-only
Open		taavi	T127367 [toolforge,jobs-api,webservice,storage] Provide modern, non-NFS log solution for Toolforge tools
Resolved	Feature	taavi	T400913 [jobs-api] Allow querying logs for non-existent jobs
Resolved		taavi	T398645 [jobs-api] Jobs API should query logs from Loki
Resolved		taavi	T386480 [o11y,logging,infra] Deploy Loki to store Toolforge tool log data
Resolved		taavi	T396574 Provision object storage volumes for Loki
Resolved		Andrew	T396594 Create OpenStack role that allows object storage access only
Resolved		dcaro	T397339 Request creation of toolsbeta-logging VPS project
Resolved		None	T397446 Request creation of tools-logging VPS project
Resolved		Andrew	T398447 Increase tools-logging object storage quotas
Resolved		taavi	T398647 Move Kubernetes log source multi-pod handling from jobs-api to toolforge-weld
Resolved		taavi	T400795 [jobs-api] 400 bad request when trying to load a large number of logs from Loki