All tools in this category Full tool catalog

In-browser tool

Meta robots tag generator

Assemble `<meta name="robots" content="...">` directives for landing pages, filters, and testing environments. Toggle common directives and copy a production-ready tag string.

  • Updated: 2026-05-05
  • Directive generation runs in your browser and does not send input to a server.

Select directives

Generated meta robots tag will appear here.

Чеклист для SEO и LLM

  • Считайте noindex и nofollow директивами высокого риска и ставьте их только на действительно неранжируемые страницы.
  • Используйте max-snippet и max-image-preview для тонкой настройки видимости без запрета индексации.
  • Согласовывайте meta robots со стратегией robots.txt, чтобы избежать смешанных crawl-сигналов.

Шаблон промпта для LLM: "Проверь политику meta robots для product, blog и utility страниц и отметь директивы, которые могут ухудшить discoverability."

Related SEO tools

Privacy And Limitations

Directive generation runs in your browser and does not send input to a server.

  • Page-level meta robots cannot override blocking at the robots.txt level when crawlers cannot access the page.
  • Conflicting directives across HTTP headers and HTML tags can produce unpredictable crawler behavior.
  • Noindex changes can take time to reflect after recrawl and index processing.

FAQ

What is the difference between robots.txt and meta robots?

robots.txt controls crawl access by path, while meta robots controls indexing and snippet behavior on a specific page.

Can I use index and noindex together?

No. They conflict and should not be combined for a single page state.

Where should the meta robots tag be placed?

Inside the HTML head so crawlers can parse it early.

Do social crawlers always follow robots directives?

Behavior varies by platform; major search crawlers generally respect standard directives.

Does this publish changes to my site?

No. It generates the tag string for manual implementation.