X-Robots-Tag

An HTTP response header that delivers crawling and indexing instructions to search engine bots. The X-Robots-Tag works like a meta robots tag but can be applied to any file type — including PDFs, images, and other non-HTML resources.