spaCy/website/robots.txt.jade

8 lines
164 B
Plaintext
Raw Normal View History

2016-10-03 18:19:13 +00:00
//- ----------------------------------
//- 💥 ROBOTS.TXT
//- ----------------------------------
if environment != "deploy"
| User-agent: *
| Disallow: /