2017-10-01 03:51:43 +00:00
|
|
|
+++
|
|
|
|
|
title = "Robots.txt"
|
|
|
|
|
weight = 70
|
|
|
|
|
+++
|
|
|
|
|
|
2018-10-18 21:09:32 +00:00
|
|
|
Zola will look for a `robots.txt` file in the `templates` directory or
|
2017-10-01 03:51:43 +00:00
|
|
|
use the built-in one.
|
|
|
|
|
|
2019-11-26 19:30:30 +00:00
|
|
|
Robots.txt is the simplest of all templates: it only gets `config`
|
|
|
|
|
and the default is what most sites want:
|
2017-10-01 03:51:43 +00:00
|
|
|
|
|
|
|
|
```jinja2
|
|
|
|
|
User-agent: *
|
2020-12-10 13:57:43 +00:00
|
|
|
Allow: /
|
|
|
|
|
Sitemap: {{ get_url(path="sitemap.xml") }}
|
2017-10-01 03:51:43 +00:00
|
|
|
```
|
