Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

Category Archives: Search Engines

Google Now Defaults to Not Indexing Your Content

Vincent Schmalbach: “…The New Reality – Selective Indexing: This brings us to the current state of affairs: Google is no longer trying to index the entire web. In fact, it’s become extremely selective, refusing to index most content. This isn’t about content creators failing to meet some arbitrary standard of quality. Rather, it’s a fundamental change in how Google approaches its role as a search engine. From my experience, Google now seems to operate on a “default to not index” basis. It only includes content in its index when it perceives a genuine need. This decision appears to be based on various factors:

  • Extreme content uniqueness: It’s not enough to write about something that isn’t extensively covered. Google seems to require content to be genuinely novel or fill a significant gap in its index.
  • Perceived authority: Sites that Google considers highly authoritative in their niche may have more content indexed, but even then, it’s not guaranteed.
  • Brand recognition: Well-known brands often see most of their content indexed, while small or unknown bloggers face much stricter selectivity.
  • Temporary indexing and de-indexing: In practice, Google often indexes new content quite quickly, likely to avoid missing out on breaking news or important updates. Soon after, Google may de-index the content, and it remains de-indexed thereafter. So getting initially indexed isn’t necessarily a sign that Google considers your content valuable.

I’ve observed this shift firsthand. In the past, when I set up a new domain, it would be indexed within an hour or faster, sometimes in seconds. This was true even for brand new domains with no mentions anywhere and no backlinks. When I searched for the title of one of those brand new blog posts or some unique sentence from the article, it would be right there on the first Google page. Now, for each piece of content, Google decides if it’s worth indexing, and more often than not, the answer seems to be “no.” They might index content they perceive as truly unique or on topics that aren’t covered at all. But if you write about a topic that Google considers even remotely addressed elsewhere, they likely won’t index it. This can happen even if you’re a well-respected writer with a substantial readership…

Google has transformed from a comprehensive search engine into something more akin to an exclusive catalog. For users, it means that the information they’re looking for might exist but remain undiscoverable through Google.”

Pete Recommends – Weekly highlights on cyber security issues, July 13, 2024

Pete Recommends – Weekly highlights on cyber security issues, July 13, 2024 – Privacy and cybersecurity issues impact every aspect of our lives – home, work, travel, education, finance, health and medical records – to name but a few. On a weekly basis Pete Weiss highlights articles and information that focus on the increasingly complex… Continue Reading

GoogleDark Web Monitoring

Gizmodo: “The Mountain View company will integrate Dark Web monitoring with Google’s Results About You page sometime toward the end of the month. That feature notifies users if their personal information, their name, address, or phone number, appears in search results. Google has previously stated its goal to scrub personal information from results, though it… Continue Reading

How to Search All of Craigslist

HowToGeek: “You can’t search the entire Craigslist site all at once by default—you’re limited to picking one region or another. However, if you’re deal hunting, that is a serious restriction. Here are a few ways to search the entirety of Craigslist all at once…SearchTempest is a website that lets you search Craigslist entries from around… Continue Reading

The Free Library by Farlex

34,746,903 articles and books – “Since 2003, The Free Library has offered free, full-text versions of classic literary works from hundreds of celebrated authors, whose biographies, images, and famous quotations can also be found on the site. Recently, The Free Library has been expanded to include a massive collection of periodicals from hundreds of leading… Continue Reading

The Internet Archive Rescues MTV News’ Web Site, Making 460,000+ of Its Pages Searchable Again

Open Culture: “Last month, MTV News’ web site went missing. Or at least almost all of it did, including an archive of stories going back to 1997. To some of us, and especially to those of us old enough to have grown up watching MTV on actual television, that won’t sound like an especially long… Continue Reading

Nearly 60% of Google searches end without a click in 2024

One more time…but likely not the last time…please stop using Google. Via Search engineLand. Nearly 60% of Google searches end without a click in 2024 – “A majority of Google searches – 58.5% in the U.S. and 59.7% in the EU – result in zero clicks. A zero-click search happens when users end their session… Continue Reading