Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

Category Archives: Internet

Google Now Defaults to Not Indexing Your Content

Vincent Schmalbach: “…The New Reality – Selective Indexing: This brings us to the current state of affairs: Google is no longer trying to index the entire web. In fact, it’s become extremely selective, refusing to index most content. This isn’t about content creators failing to meet some arbitrary standard of quality. Rather, it’s a fundamental change in how Google approaches its role as a search engine. From my experience, Google now seems to operate on a “default to not index” basis. It only includes content in its index when it perceives a genuine need. This decision appears to be based on various factors:

  • Extreme content uniqueness: It’s not enough to write about something that isn’t extensively covered. Google seems to require content to be genuinely novel or fill a significant gap in its index.
  • Perceived authority: Sites that Google considers highly authoritative in their niche may have more content indexed, but even then, it’s not guaranteed.
  • Brand recognition: Well-known brands often see most of their content indexed, while small or unknown bloggers face much stricter selectivity.
  • Temporary indexing and de-indexing: In practice, Google often indexes new content quite quickly, likely to avoid missing out on breaking news or important updates. Soon after, Google may de-index the content, and it remains de-indexed thereafter. So getting initially indexed isn’t necessarily a sign that Google considers your content valuable.

I’ve observed this shift firsthand. In the past, when I set up a new domain, it would be indexed within an hour or faster, sometimes in seconds. This was true even for brand new domains with no mentions anywhere and no backlinks. When I searched for the title of one of those brand new blog posts or some unique sentence from the article, it would be right there on the first Google page. Now, for each piece of content, Google decides if it’s worth indexing, and more often than not, the answer seems to be “no.” They might index content they perceive as truly unique or on topics that aren’t covered at all. But if you write about a topic that Google considers even remotely addressed elsewhere, they likely won’t index it. This can happen even if you’re a well-respected writer with a substantial readership…

Google has transformed from a comprehensive search engine into something more akin to an exclusive catalog. For users, it means that the information they’re looking for might exist but remain undiscoverable through Google.”

Goldman Sachs: AI Is Overhyped, Wildly Expensive, and Unreliable

404 Media, July 14, 2024. Goldman Sachs: AI Is Overhyped, Wildly Expensive, and Unreliable. “Investment giant Goldman Sachs published a research paper about the economic viability of generative AI which notes that there is “little to show for” the huge amount of spending on generative AI infrastructure and questions “whether this large spend will ever… Continue Reading

Quick Claude Artifacts Use Case

Brainyacts – “Today, I want to show you a cool and simple use case for Anthropic’s Claude 3.5 model and its incredible ability to generate dynamic graphics and other elements. In the short video below, I demonstrate how a simple prompt can create a sophisticated simulation illustrating the interaction between worked hours, billing realization, and… Continue Reading

AI tools help journalists assess authenticity of images in immediate aftermath of Trump shooting

GeekWire: “Journalists used artificial intelligence to check the authenticity of images from the attempted assassination of former President Donald Trump in Pennsylvania on Saturday night — demonstrating both the potential and the limitations of AI technology in minimizing the spread of misinformation online. AI tools offered by Seattle-based non-partisan nonprofit organization TrueMedia.org were used by reporters… Continue Reading

How to avoid falling for misinformation and conspiracy theories

Washington Post [unpaywalled] – There’s a flood of real, misleading and fake breaking news and information online. Proceed with caution: “Anyone with an internet connection can watch breaking news unfold in real time, or at least some version of it. Across social media, posts can fly up faster than most fact-checkers and moderators can handle,… Continue Reading

(Almost) 200 Years of News-Based Economic Sentiment

(Almost) 200 Years of News-Based Economic Sentiment Jules H. van Binsbergen, Svetlana Bryzgalova, Mayukh Mukhopadhyay & Varun Sharma – Working Paper 32026. DOI 10.3386/w32026  Issue Date January 2024. “Using text from 200 million pages of 13,000 US local newspapers and machine learning methods, we construct a 170-year-long measure of economic sentiment at the country and state… Continue Reading

Fake Local News Sites Tracker: 1,268 Sites and Counting

“In June 2024, NewsGuard reported that so-called pink slime websites — sites posing as independent news outlets but secretly funded by partisan groups — now outnumber daily newspapers in the U.S. Below, we track the spread of pink slime websites, as compared to Northwestern Local News Initiative’s count of daily newspapers. (Northwestern’s tracker was last… Continue Reading

Pete Recommends – Weekly highlights on cyber security issues, July 13, 2024

Pete Recommends – Weekly highlights on cyber security issues, July 13, 2024 – Privacy and cybersecurity issues impact every aspect of our lives – home, work, travel, education, finance, health and medical records – to name but a few. On a weekly basis Pete Weiss highlights articles and information that focus on the increasingly complex… Continue Reading