zola/components/site
Stanislas 47b920777a
link_checking: prevent rate-limiting (#1421)
* link_checking: prevent rate-limiting

Fix for https://github.com/getzola/zola/issues/1056.

- assign all links for a domain to the same thread
- reduce number of threads from 32 to 8
- add sleep between HTTP calls

* Add get_link_domain(), use for loops

* Do not sleep after last link for domain

* Avoid quadratic complexity

* remove prints
2021-04-21 21:13:38 +02:00
..
benches Fixed site benches compilation 2020-12-14 20:42:55 +01:00
src link_checking: prevent rate-limiting (#1421) 2021-04-21 21:13:38 +02:00
tests cargo fmt 2021-04-07 22:13:15 +02:00
Cargo.toml link_checking: prevent rate-limiting (#1421) 2021-04-21 21:13:38 +02:00