The Honest Answer: There's No Fixed Crawl Schedule

The unsatisfying but true answer is that Google crawls algorithmically, with no published schedule. As one practitioner put it, "It truly does depend" — frequency is determined by signals ranging from site size and server performance to user demand and content quality.

For most small business sites, new pages are typically crawled within a day to a couple of weeks. Major publications can see updates within hours or even minutes. But a full-site crawl is a different story. Practitioner rules of thumb suggest 3–4 weeks for sites under 500 pages, 2–3 months for 500–25,000 pages, and 4–12 months for anything larger — figures to take with a grain of salt, not official Google data.

The range is real. A sports forum saw breaking-news threads indexed sometimes within minutes, while off-season threads took weeks to be re-indexed. A recipe blog's new posts initially took a week or more to appear; after fixing duplicate URL issues, they were indexed within 2–3 days. And a news site that once indexed every article within 5 minutes saw zero new articles indexed after a core update — even with manual submission.

These examples illustrate what Worqd sees when helping clients find the bottleneck: crawl speed isn't a single number. It's a signal of how Google values your site right now.

• Small business blogs: a day to a couple of weeks for new pages
• Sites under 500 pages: 3–4 weeks for a full crawl
• Sites 500–25,000 pages: 2–3 months for a full crawl
• Sites over 25,000 pages: 4–12 months for a full crawl

Manual submission via Search Console can compress discovery to hours or days by placing URLs in a priority queue, but it only requests crawling — it doesn't force indexing. And crawling is not indexing. Google may crawl a page and still decline to index it based on site-level quality assessments, a distinction that shows up in Search Console as "Crawled — currently not indexed." Recovery from quality-driven stalls can take weeks to months, because Google's systems need sustained evidence that a site produces helpful, reliable content before trust signals rebuild.

What Actually Controls Your Crawl Speed

Google doesn't crawl your site on a fixed schedule — it decides how much attention you deserve based on a handful of signals you can actually influence. That attention has a name: crawl budget, and understanding it turns "why isn't Google indexing my pages?" from a mystery into a diagnosis.

According to Conductor's indexing research, three factors dominate indexing speed: content quality, website size, and reliance on client-rendered JavaScript. Practitioner estimates suggest a full crawl takes roughly 3–4 weeks for sites under 500 pages, but stretches to 4–12 months for sites over 25,000 pages.

Beyond those big three, several supporting signals shape how often Googlebot returns:

• Server performance — frequent timeouts cause Google to deliberately slow down its crawl attempts to avoid overloading your site.
• Internal links — pages buried deep in your architecture get crawled less often than pages a click or two from your homepage.
• Backlinks — they help search engines discover new content and act as a vote for its value.
• Search demand — a sports forum in one practitioner case study saw breaking-news threads indexed within minutes, while off-season threads waited weeks for re-indexing.

JavaScript deserves special mention. If your content only appears after client-side rendering, Google has to do extra work before it can even see the page — and that extra work slows everything down.

Here's where crawl budget stops being abstract. Every duplicate URL, tag page, archive page, and parameter variation spends some of Google's limited attention on content that doesn't matter. That leaves less attention for the pages that actually generate leads.

The clearest proof comes from a recipe blog case study: new posts initially took a week or more to appear in search results. After fixing duplicate URL and canonical issues, indexing dropped to just 2–3 days. Nothing about the content changed — the site simply stopped wasting Google's time.

This is why "find the bottleneck before touching anything" applies as much to technical SEO as it does to your lead funnel. At Worqd, the first step in any engagement is identifying where growth is stuck — and for many sites, the crawl bottleneck is dilution, not quality or authority.

One important caveat: faster crawling doesn't mean higher rankings. As SEO practitioners note, more frequent crawling only means your updates appear in search results faster — ranking still depends on content quality, user activity, and competition.

It also doesn't guarantee indexing. Google may crawl a page and still decline to index it based on site-level quality assessments, a distinction visible in Search Console's "Crawled — currently not indexed" status. Recovery from quality-driven stalls can take weeks to months, per Google Product Experts.

The takeaway: crawl speed is mostly a technical and structural problem, which means it's fixable. Clean up your duplicates, strengthen your internal links, keep your server fast, and render content server-side where possible — then let quality do the ranking work.

Crawled but Not Indexed: The Quality Gate Nobody Tells You About

Getting Google to look at your page is only half the battle — the other half is convincing it the page deserves a spot in the index at all. These are two separate decisions, and confusing them is one of the most common diagnostic mistakes site owners make.

Google Search Console spells out the difference through two distinct statuses, and each points to a completely different fix. According to Google Product Experts, the distinction works like this:

• Discovered — currently not indexed means Google knows your URL exists but hasn't prioritized crawling it. This is a prioritization problem, usually fixable with sitemaps, stronger internal linking, and backlinks.
• Crawled — currently not indexed means Google actually visited the page and decided it wasn't worth indexing. This is a quality problem — and no amount of manual submission will override it.

That second status is the quality gate nobody warns you about. You can submit a URL through the URL Inspection Tool and get it crawled within hours to days, but as the research makes clear, manual requests only request crawling — they don't force indexing. If Google's algorithm sees no reason to include the page, it simply won't.

The most dramatic illustration of this comes from the December 2025 core update. One news site documented in a Google support thread had every article indexed through Google News and Search within five minutes of publishing. After the update? Zero new articles indexed — even with manual submission. Nothing about the site's crawling broke. What changed was Google's site-level quality assessment, which stalled indexing across the entire domain.

Ayush Mauryavanshi, a Diamond Product Expert, explains this is "a site-level re-evaluation, not a technical indexing bug." His key point: recovery happens only after Google sees sustained improvement over time, and there is no manual way to signal that your site has improved.

The recovery timeline is sobering. Google's own documentation states that while some changes can take effect in a few days, "it could take several months for our systems to learn and confirm that the site as a whole is now producing helpful, reliable, people-first content." Product Experts echo this: expect weeks to months of re-crawling, reprocessing, and trust rebuilding before indexing resumes.

This is exactly why diagnosing which status you're facing matters so much. If your pages sit in "Discovered," the fix is structural — better internal links, a clean sitemap, and crawl-budget hygiene. One practitioner case study showed a recipe blog cutting indexing time from over a week to two or three days just by resolving duplicate URL and canonical issues. But if you're seeing "Crawled — currently not indexed," the bottleneck is content quality and differentiation, and the work is slower and deeper.

At Worqd, this distinction anchors how we approach the "find the bottleneck" step with clients: before touching anything, we identify whether growth is stuck on discovery or on quality, because the fixes — and the timelines — are entirely different. Treating a quality problem like a crawl problem wastes months; treating a crawl problem like a quality problem wastes content budget. Check your Search Console coverage report first, and let the status tell you which battle you're actually fighting.

Your Fastest Levers: How to Get Crawled Sooner

You can't control Google's schedule, but you can control how hard your site is to ignore. A handful of levers reliably move pages from the "we'll get to it" pile into the priority crawl queue — and the fastest ones take minutes, not months.

The single fastest lever is manual submission. According to practitioners who track indexing behavior, submitting a URL through Google Search Console's URL Inspection Tool places it in a priority crawl queue and can yield indexing within hours to a few days — versus days, weeks, or even months when you rely on organic discovery alone. For a new landing page or campaign page, that's the difference between launching this week and waiting until next month.

Pair that with an XML sitemap submitted through Search Console, and you've covered discovery. Then work the structural levers:

• Fix crawl-budget waste. Duplicate URLs, canonical errors, tag-page bloat, and parameter URLs eat the attention Google gives your site. One recipe blog cut indexing time from over a week to 2–3 days purely by resolving duplicate URL issues, per documented case data.
• Strengthen internal links. Pages buried with no internal paths get crawled last. Link new pages from your homepage and high-traffic content.
• Earn backlinks. Links help search engines find new content and act as a vote for it, as Conductor's indexing research notes.
• Keep your server healthy. Frequent timeouts cause Google to reduce crawl attempts, slowing everything.

Know the limits before you over-request. Manual submission only requests crawling — it doesn't force indexing. If Google crawls your page and decides it isn't worth indexing, no amount of resubmitting overrides that call, a distinction Google Product Experts emphasize when diagnosing site-wide indexing stalls. And if Search Console stops accepting your requests, wait 3–7 days before trying again.

Also watch which status you're seeing. "Discovered — currently not indexed" is a prioritization problem the tactics above can fix. "Crawled — currently not indexed" is a quality problem, and quality recalibration takes weeks to months — Google's own guidance says some improvements take effect in days, but confirming site-wide quality can take several months.

This is where the bottleneck framing matters. At Worqd, the diagnostic always comes before the fix: SEO compounds over months while paid campaigns and outreach can produce inquiries within days of launch. If your pages aren't getting crawled, that's a technical bottleneck worth solving first — before you conclude your content strategy isn't working. A page Google hasn't seen can't rank, can't convert, and can't tell you anything about whether your message lands.

Run the checklist in order: submit the sitemap, request indexing on priority pages, clean up duplicates, build links. Most small business sites see new content crawled within a day to a couple of weeks once the basics are right — and if you're still stuck after that, the problem is almost certainly quality, not crawl access.