diff options
| author |  Gareth Coles <[email protected]> | 2018-08-07 15:09:08 +0100 |
|---|---|---|
| committer | Gareth Coles <[email protected]> | 2018-08-07 15:09:16 +0100 |
| commit | af54db6c136138c66cf5ca72419989525a0baa5c (patch) | |
| tree | 8519aeab8d45277c51797c7dc23aacf3b56ed1bb /templates/robots.txt | |
| parent | A wizard is never late, nor is he early. (diff) | |
Initial project layout for django
Diffstat (limited to 'templates/robots.txt')
| -rw-r--r-- | templates/robots.txt | 14 |
1 files changed, 0 insertions, 14 deletions
diff --git a/templates/robots.txt b/templates/robots.txt deleted file mode 100644 index fa61be5e..00000000 --- a/templates/robots.txt +++ /dev/null @@ -1,14 +0,0 @@ -{# robots.txt is a little picky about whitespace and newlines - that's why the below looks kind of bad.#} -{% if rules is defined and rules %} -{% for user_agent, disallowed in rules.items() %} -User-agent: {{ user_agent }} -{% for rule in rules %} -Disallow: {{ rule }} -{% endfor %} -{% endfor %} -{% else %} -User-agent: * -Disallow: -{% endif %} - -Sitemap: {{ sitemap_url }} |