Agents

Websites Block Meta's Muse and Other Consumer AI Agents

As consumer AI agents like Meta's Muse face widespread blocking from major websites, tech companies are scrambling to establish open communication standards to keep the agent economy alive.

TechCrunch AI11 hrs agoAgents
Image: TechCrunch AI

Consumer AI agents designed to perform online tasks on behalf of users are hitting a major wall as websites block their access. Amazon recently blocked Meta's Muse agent from browsing or purchasing from its catalog, while other users report that Google kicked the Instinct agent out of their Gmail inboxes. Similar access issues have cropped up across platforms like eBay, Yelp, Zillow, Pizza Hut, Adidas, and major airlines including Delta and United. While some blocks are intentional, others stem from traditional anti-bot security measures, such as human-verification prompts that freeze out automated systems.

Even cooperative relationships are struggling with these technical barriers. Walmart, which officially partnered with Muse at the Meta Connect developer conference in September, has seen its automated checkout processes interrupted when Muse fails to bypass anti-bot verification buttons. To resolve these conflicts, an industry coalition including Meta, Walmart, Stripe, Sierra, Genesys, Rocket, NiCE, and Decagon is developing an open standard protocol. This standard aims to establish secure agent-to-agent communication for digital commerce, helping websites distinguish legitimate user-delegated bots from malicious scrapers.

The landscape is further complicated by security providers and platform terms. Cloudflare, which recently updated its crawler defaults on September 15 to let site owners block AI training while permitting other bots, has inadvertently disrupted Muse traffic on ad-supported pages. Cloudflare is also testing a dedicated web browser for AI agents and running a marketplace where bots must pay for data access. Meanwhile, Yelp mandates that agents pay for data licensing to perform tasks like booking tables, and United Airlines explicitly prohibits unauthorized automated tools in its terms of service.

For AI developers and enterprise practitioners, this friction highlights a critical shift from model capability to integration infrastructure. Building an effective agent is no longer just about natural language processing; it requires navigating complex web security, CAPTCHAs, and API paywalls. Until open standards are widely adopted, developers must focus on formal brand partnerships and dedicated connectors to ensure their agents can reliably execute transactions without getting banned.

This is our own summary of reporting by TechCrunch AI

More in Agents