Crawling
Search bots following links across the web and fetching your pages. If nothing crawls a page, nothing else in SEO can happen to it.
See it
What it is
Crawling is the fetch step. A bot (Googlebot, Bingbot, and now a pile of AI crawlers) requests a URL, gets HTML back, pulls out the links, and queues those for later. It finds new URLs three ways: links from pages it already knows, your XML sitemap, and pushes from protocols like IndexNow.
Crawling is not ranking, and it is not even indexing. A crawled page can be dropped before it ever enters the index. Bots also budget their time: a big site with thousands of near-identical filter URLs burns its crawl budget on junk and leaves real pages unfetched for weeks. Under a few thousand URLs you will basically never hit that ceiling, so stop worrying about it.
The usual blockers, in the order they actually bite: a robots.txt Disallow left over from staging, a login wall or geo-block returning 403, pages reachable only through a click handler with no real <a href> link, and orphan pages nothing points at. One counterintuitive bit: robots.txt blocks the fetch, not the listing, so a blocked page can still show up URL-only from other sites' links. To get a page out of results, let it be crawled and use noindex.
Ask AI for it
Audit this site for crawlability and fix what you find. Check that robots.txt does not Disallow anything shippable, that every important page is reachable from the homepage in three clicks or fewer through real <a href> links rather than onclick handlers or buttons, that an XML sitemap exists and is referenced in robots.txt, and that live URLs return 200 instead of 403s, redirect chains, or soft 404s. List every orphan page you find and propose the internal links that would reconnect it.