Community at Work

  • Using Log File Analysis to Improve Search Engine Indexation

    Search Console tells you what Google decided. Your server logs tell you what crawlers actually did: which URLs they requested, how often, and what your server answered. When a page won’t get indexed, that difference is often where the explanation is. What a log file records Every request to your web server can be written…

  • Solve the “Crawled – currently not indexed” status in Google Search Console

    “Crawled – currently not indexed” means Google fetched the page and chose not to add it to the index, at least for now. Google could reach it, so this usually isn’t a crawling problem. It’s often a judgement about the page itself. Work through the checks below in order. Rule out technical causes first A…

  • JavaScript Websites: The End of Dynamic Rendering

    Dynamic rendering was a way to make JavaScript-heavy sites readable to search engines: serve people the normal client-side app, and serve crawlers a separately prerendered HTML version. Google now describes it as a workaround rather than a long-term solution, and recommends other approaches. Why it existed Client-side apps send a nearly empty HTML document and…

  • A Comprehensive Guide to the Google Search Console URL Inspection Tool

    The URL Inspection tool shows how Google sees one specific URL: whether it’s indexed, when it was last crawled, which canonical Google chose, and what the page looked like when rendered. It’s the first place to go when a page isn’t appearing in search. Before you start You need a verified property in Google Search…

  • Indexation & On-Page SEO

    Search engines can only index what they can fetch and understand. These on-page basics make that easier, and most of them help your readers just as much. Title tags and meta descriptions Give every page a unique title that says what it covers. Meta descriptions don’t directly affect indexing, but a clear one can earn…

  • The Sitemaps “Ping” Endpoint Is Gone: What to Do Instead

    For years, sitemap tools could tell search engines about an update with a simple unauthenticated request to a “ping” URL. That’s over. In June 2023 Google announced the end of its ping endpoint and retired it about six months later, saying most of the submissions it received were spam. Bing had already dropped anonymous pings.…

  • Mastering Crawl Budget: Get Your Important Pages Crawled

    Crawl budget is the number of URLs a search engine can and wants to crawl on your site. Most small and medium sites never need to worry about it. It matters when you have a very large site, content that changes quickly, or many pages sitting in “Discovered – currently not indexed”. Here’s the short…

  • Is your content “Crawled – Currently Not Indexed” in Google Search Console?

    Finding pages marked “Crawled – currently not indexed” can be frustrating, but the status is specific. Google fetched the page and chose not to include it in the index, at least for now. What the status means Crawling is fetching a page, and indexing is storing it so it can appear in results. Not everything…

  • How to Create a Sitemap for Your Website Automatically

    A sitemap is a file listing the URLs you want search engines to find. Maintaining one by hand doesn’t last past a few pages, so let your software do it. Why it’s worth having A sitemap helps search engines discover your pages and tells them when those pages changed. It doesn’t guarantee indexing or improve…

  • Does every website need a sitemap?

    Not strictly, but almost every site is better off with one. It costs next to nothing, and it removes one reason a page might go unfound. What a sitemap is A sitemap is a file listing the URLs you want search engines to know about, usually with the date each one last changed. When you…