Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

Category Archives: Privacy

The Ethics of Advanced AI Assistants

Google DeepMind – “First, because LLMs display immense modeling power, there is a risk that the model weights encode private information present in the training corpus. In particular, it is possible for LLMs to ‘memorise’ personally identifiable information (PII) such as names, addresses and telephone numbers, and subsequently leak such information through generated text outputs (Carlini et al., 2024) This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants. We define advanced AI assistants as artificial agents with natural language interfaces, whose function is to plan and execute sequences of actions on behalf of a user – across one or more domains – in line with the user’s expectations. The paper starts by considering the technology itself, providing an overview of AI assistants, their technical foundations and potential range of applications. It then explores questions around AI value alignment, well-being, safety and malicious uses. Extending the circle of inquiry further, we next consider the relationship between advanced AI assistants and individual users in more detail, exploring topics such as manipulation and persuasion, anthropomorphism, appropriate relationships, trust and privacy. With this analysis in place, we consider the deployment of advanced assistants at a societal scale, focusing on cooperation, equity and access, misinformation, economic impact, the environment and how best to evaluate advanced AI assistants. Finally, we conclude by providing a range of recommendations for researchers, developers, policymakers and public stakeholders. Our analysis suggests that advanced AI assistants are likely to have a profound impact on our individual and collective lives. To be beneficial and value-aligned, we argue that assistants must be appropriately responsive to the competing claims and needs of users, developers and society. Features such as increased agency, the capacity to interact in natural language and high degrees of personalisation could make AI assistants especially helpful to users. However, these features also make people vulnerable to inappropriate influence by the technology, so robust safeguards are needed. Moreover, when AI assistants are deployed at scale, knock-on effects that arise from interaction between them and questions about their overall impact on wider institutions and social processes rise to the fore. These dynamics likely require technical and policy interventions in order to foster beneficial cooperation and to achieve broad, inclusive and equitable outcomes. Finally, given that the current landscape of AI evaluation focuses primarily on the technical components of AI systems, it is important to invest in the holistic sociotechnical evaluations of AI assistants, including human–AI interaction, multi-agent and societal level research, to support responsible decision-making and deployment in this domain.”

FTC Finalizes Order Prohibiting Gravy Analytics, Venntel from Selling Sensitive Location Data

“The Federal Trade Commission finalized an order prohibiting Gravy Analytics and its subsidiary Venntel from unlawfully tracking and selling sensitive location data from users, including data about consumers’ visits to health-related locations and places of worship. In a complaint first announced last month, the FTC alleged that Gravy and Venntel violated the FTC Act by unfairly… Continue Reading

NSA Warns iPhone And Android Users – Disable Location Tracking

Forbes: “…NSA warns that “mobile devices store and share device geolocation data by design…Location data can be extremely valuable and must be protected. It can reveal details about the number of users in a location, user and supply movements, daily routines (user and organizational), and can expose otherwise unknown associations between users and locations.” EFF:… Continue Reading

How to Avoid the Top Internet Scams

Wrong Numbers, Fake Invoices, and Catfishing: If you’re online, you’re at risk. “We spoke to three security experts about what you can do to protect yourself…In a video call, Bogdan Botezatu, Bitdefender’s director of threat research, warned that despite the numerous ways scammers go after their targets, spam email remains the most prevalent. Using telemetry… Continue Reading

Allstate used GasBuddy and other apps to quietly track driving behavior

Ars Technica: “Texas has sued insurance provider Allstate, alleging that the firm and its data broker subsidiary used data from apps like GasBuddy, Routely, and Life360 to quietly track drivers and adjust or cancel their policies. Allstate and Arity, a “mobility data and analytics” firm founded by Allstate in 2016, collected “trillions of miles worth… Continue Reading

Apple auto-opts everyone into having their photos analyzed by AI for landmarks

The Register: “Apple last year deployed a mechanism for identifying landmarks and places of interest in images stored in the Photos application on its customers iOS and macOS devices and enabled it by default, seemingly without explicit consent. Apple customers have only just begun to notice. The feature, known as Enhanced Visual Search, was called… Continue Reading

Open Port Chronicle: What Port 80 Revealed About The Internet

“At RedHunt Labs, we conduct extensive internet-wide studies as part of Project Resonance to stay ahead of the evolving cyberspace and enhance our Attack Surface Management (ASM) platform. This blog highlights our recent research, where we analyzed billions of IP addresses to check for port 80 open, uncovering fascinating insights.  The internet is massive –… Continue Reading

Inside the Black Box of Predictive Travel Surveillance

Wired – “Behind the scenes, companies and governments are feeding a trove of data about international travelers into opaque AI tools that aim to predict who’s safe—and who’s a threat… In Europe, at least four technology companies—Idemia, SITA, Travizory, and WCC—offer governments around the world software that uses algorithms on traveler data to profile passengers.… Continue Reading

Here is a list of every app on your phone selling your location data

Via Austin Corbett‬ ‪@austincorbett.bsky.social– Here is a list of every app on your phone selling your location data to advertisers, interested unknown 3rd parties, and the US government. Thanks to 404 Media and @josephcox.bsky.social There are 12, 373 apps on this Google doc as of today – the apps are used by children and adults… Continue Reading

Study Finds Consumers Are Actively Turned Off by Products That Use AI

The Byte: “Researchers have found that including the words “artificial intelligence” in product marketing is a major turn-off for consumers, suggesting a growing backlash and disillusionment with the tech — and that startups trying to cram “AI” into their product are actually making a grave error. As detailed in a new study published in the… Continue Reading

Pete Recommends – Weekly highlights on cyber security issues, January 4, 2025

Via LLRX – Privacy and cybersecurity issues impact every aspect of our lives – home, work, travel, education, finance, health and medical records – to name but a few. On a weekly basis Pete Weiss highlights articles and information that focus on the increasingly complex and wide ranging ways technology is used to compromise and… Continue Reading