Page MenuHomePhabricator

Modify `/api/crawler/runs/` to output urls count information in `results` array
Closed, ResolvedPublic

Description

On the frontend, in fetchCrawlerHistory method in crawler.js, we are making additional API calls to fetch urls information for each crawl. This is to get the number of crawled URLs data and display it in each crawler run row on the Crawler history page.

It might be ideal to integrate the URL count information with the crawler runs results directly to save these additional calls that are not needed.

Event Timeline

srishakatux renamed this task from Modify '/api/crawler/runs/' to output urls count information in `results` array to Modify `/api/crawler/runs/` to output urls count information in `results` array.Apr 13 2021, 8:07 PM

Change 679418 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[wikimedia/toolhub@main] api: Return crawled_urls count for each crawler run

https://gerrit.wikimedia.org/r/679418

Change 679418 merged by jenkins-bot:

[wikimedia/toolhub@main] api: Return crawled_urls count for each crawler run

https://gerrit.wikimedia.org/r/679418