T367452 revised how Citoid emits requests by shifting:
- From two GET requests
- To a HEAD (metadata) request plus a GET (full) request.
In doing the above we did NOT make any changes to the user agents generating these requests.
We've come to learn the user agents generating these requests are causing some proportion of web application firewalls to block Citoid requests. [i]
This task involves the work of revising this user agent behavior to avoid web application firewalls and as a result, reducing the rate at which Citoid requests fail.
i. Thank you to @akosiaris for making us aware of this issue