Add robots.txt to a Django website
Sept. 8, 2023
|
Tutorials
Adding a
robots.txt file is a helpful piece of Search Engine Optimization as well as a way to request which bots, like ChatGPT and others, you do not wish to crawl your site.
Filed in:
Tutorials
Sponsor Number One
Subscribe to Django News
Weekly Django news, articles, projects, and more. Curated by Jeff Triplett & William Vincent.
No spam, ever. We'll never share your email address and you can opt out at any time.