A small piece of HTML can change what a visitor sees or how the browser understands a page. In this lesson, you will explore meta descriptions: duplicates, length, and snippet limitations using a short example that you can inspect and change.
The Idea in Plain English
Robots directives ask cooperating search crawlers how to handle indexing, following links, or previews. noindex concerns search results; nofollow concerns following page links; neither secures private information.
HTML supplies the structure; JavaScript supplies the behavior described here. If you remove the script, check what remains usable for visitors.
A Working Example
Read the sample once before copying it. Notice the element names and attribute values, then compare them with the explanation below.
<head>
<title>Member Preview</title>
<meta name="robots" content="noindex, nofollow">
</head>What Each Part Does
- The meta element supplies machine-readable settings; its name or charset decides which setting.
- The title gives the document a name in tabs and other browser surfaces.
- The head holds page metadata, not the visible lesson content.
- name identifies a field in submitted form data or a named metadata entry.
- content supplies the value of a meta declaration.
A crawler that retrieves the page can read the directives. The website remains publicly accessible to visitors.
Try It Yourself
Try changing noindex to index on a local demonstration; it is still only a search-engine directive.
Common Beginner Mistakes
- Confusing noindex with password protection, or blocking crawling while expecting the crawler to discover noindex.
- Changing several parts of the example at once, making it difficult to see which part caused a different result.
- Choosing a tag only because its default appearance looks right, without checking whether it describes the content correctly.
Key Takeaways
- Robots directives ask cooperating search crawlers how to handle indexing, following links, or previews. noindex concerns search results; nofollow concerns following page links; neither secures private information.
- A crawler that retrieves the page can read the directives. The website remains publicly accessible to visitors.
- Test the markup in a browser, and check accessibility and real-world behavior where relevant.