Down the rabbit hole with meta robots

Helen Dawson
BBT | Digital Agency
1 min readApr 6, 2021
Down the rabbit hole with meta robots

Oh, Google. You do like to keep us on our toes. Especially when it comes to SEO, or more specifically meta robots.

Meta-what-now?

A fair point. Meta robots are tags used on your pages that you can use to instruct search engines (like Google) how you would like them to crawl or index parts of your website.

Do they actually crawl? Like spiders? Is this the Matrix?

Outdated early noughties references aside, sort of. They crawl pages and pick up tags. It’s basically like giving search engines rules.

Rules? I laugh in the face of rules! The rules were made to be broken!

Not in this case. Search engines will simply ignore instructions which they don’t understand, so you need to get this stuff right. And that means knowing which search engines support which specific parameters.

Read more: https://bbtdigital.com/blog/down-the-rabbit-hole-with-meta-robots/

--

--