zola/components
Stanislas 47b920777a
link_checking: prevent rate-limiting (#1421)
* link_checking: prevent rate-limiting

Fix for https://github.com/getzola/zola/issues/1056.

- assign all links for a domain to the same thread
- reduce number of threads from 32 to 8
- add sleep between HTTP calls

* Add get_link_domain(), use for loops

* Do not sleep after last link for domain

* Avoid quadratic complexity

* remove prints
2021-04-21 21:13:38 +02:00
..
config Some clippy fixes 2021-04-07 22:13:15 +02:00
errors move translation population and path collision checking to insert stage (#1272) 2021-01-05 21:39:25 +01:00
front_matter Some clippy fixes 2021-04-07 22:13:15 +02:00
imageproc Hash collision using the same quality level and incorrect quality for WebP (#1431) 2021-04-18 11:07:10 +02:00
library rendering: keep track of all internal links (#1424) 2021-04-21 21:13:11 +02:00
link_checker Update changelog + deps 2021-02-02 20:25:27 +01:00
rendering rendering: keep track of all internal links (#1424) 2021-04-21 21:13:11 +02:00
search Lang aware search indices settings 2021-04-07 22:13:15 +02:00
site link_checking: prevent rate-limiting (#1421) 2021-04-21 21:13:38 +02:00
templates Nest translations in languages options 2021-04-07 22:13:15 +02:00
utils rendering: keep track of all internal links (#1424) 2021-04-21 21:13:11 +02:00