2017-10-01 03:51:43 +00:00
|
|
|
+++
|
|
|
|
|
title = "Robots.txt"
|
|
|
|
|
weight = 70
|
|
|
|
|
+++
|
|
|
|
|
|
|
|
|
|
Gutenberg will look for a `robots.txt` file in the `templates` directory or
|
|
|
|
|
use the built-in one.
|
|
|
|
|
|
2018-10-02 06:15:26 +00:00
|
|
|
Robots.txt is the simplest of all templates: it only gets the config
|
|
|
|
|
and the default is what most site want:
|
2017-10-01 03:51:43 +00:00
|
|
|
|
|
|
|
|
```jinja2
|
|
|
|
|
User-agent: *
|
|
|
|
|
```
|
