Noindex
A meta directive that instructs search engines not to include a page in their search index. Noindex prevents a page from appearing in search results while still allowing it to be crawled and its links to be followed.
Noindex is the definitive way to keep a page out of search results. Unlike robots.txt (which blocks crawling but not indexing), a noindex tag ensures the page will not appear in search results even if other sites link to it. Implement noindex via a meta robots tag in the HTML head or an X-Robots-Tag HTTP header.
For engineering teams, noindex should be applied strategically to pages that provide user value but should not appear in search results: internal search results pages, paginated archive pages beyond the first page, user account pages, staging environments, and duplicate content variations. Common mistakes include accidentally noindexing important pages during development and forgetting to remove noindex tags after launching from staging. Build noindex auditing into your CI/CD pipeline to catch unintended noindex tags before they reach production. Monitor the Coverage report in Google Search Console for pages excluded due to noindex and verify they are intentionally excluded. A sudden increase in noindexed pages usually indicates a configuration error.
Related Terms
Core Web Vitals
A set of three Google-defined metrics that measure real-world user experience for loading performance, interactivity, and visual stability. Core Web Vitals are a confirmed ranking factor in Google Search.
Largest Contentful Paint (LCP)
A Core Web Vital that measures the time from page load start until the largest visible content element (image, video, or text block) is rendered on screen. Good LCP is 2.5 seconds or less.
Interaction to Next Paint (INP)
A Core Web Vital that measures the latency of all user interactions (clicks, taps, keyboard input) throughout the page lifecycle, reporting the worst interaction. Good INP is 200 milliseconds or less.
Cumulative Layout Shift (CLS)
A Core Web Vital that measures the total amount of unexpected layout shifts that occur during a page's entire lifespan. Good CLS is 0.1 or less, where layout shifts are calculated from the impact and distance of moving elements.
Time to First Byte (TTFB)
The duration from the user's request to the first byte of the server response reaching the browser. TTFB measures server-side processing speed and network latency, directly impacting all subsequent loading metrics.
Crawl Budget
The number of pages a search engine bot will crawl on your site within a given timeframe, determined by crawl rate limit and crawl demand. Crawl budget optimization ensures important pages are discovered and indexed efficiently.