]> git.infradead.org Git - mtd-www.git/commitdiff
robots.txt: block the archive subdir
authorRalph Siemsen <ralphs@netwinder.org>
Sat, 27 Nov 2021 02:27:49 +0000 (21:27 -0500)
committerDavid Oberhollenzer <david.oberhollenzer@sigma-star.at>
Mon, 29 Nov 2021 07:19:55 +0000 (08:19 +0100)
Add a robots.txt file (http://www.robotstxt.org/robotstxt.html) to block
web crawlers from indexing the old website archive.

Signed-off-by: Ralph Siemsen <ralphs@netwinder.org>
Signed-off-by: David Oberhollenzer <david.oberhollenzer@sigma-star.at>
robots.txt [new file with mode: 0644]

diff --git a/robots.txt b/robots.txt
new file mode 100644 (file)
index 0000000..1cd4556
--- /dev/null
@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /archive