For years, website owners and publishers have lived by a relatively straightforward contract with Google: provide high-quality content, and in return, receive traffic. However, the rise of generative AI has fundamentally altered this arrangement. As Google integrates AI Overviews, AI Mode, and generative features into its search engine results pages (SERPs), the line between organic search traffic and AI-driven synthesis has blurred.
In a landmark shift, Google has begun rolling out a new setting within Search Console that finally grants publishers the ability to pull their content out of these generative features. While this offers the autonomy many have demanded, the decision to opt out is far from simple. With regulatory pressure mounting and data suggesting that "traditional" search features are increasingly being subsumed by AI surfaces, the choice to toggle off these features could carry significant, unintended consequences for traffic and visibility.
The Mechanics of the New Control
The new "Search generative AI control" is currently being deployed to a subset of website owners via the Settings menu in Google Search Console. It represents a granular, site-wide toggle that dictates whether a domain’s content should be used to "ground" AI responses in AI Overviews, AI Mode, and Discover’s generative features.
By default, websites are opted in. When a site is included, Google uses the content to help construct AI-generated summaries and responses, potentially driving impressions and traffic. If a site owner chooses to opt out, that content is removed from these generative surfaces entirely.
Crucially, Google has stated that this setting acts independently of other search signals. It is not a ranking penalty, nor does it impact a site’s performance in traditional, non-AI-powered search results. Furthermore, it does not override settings in Google Merchant Center or Google Ads, nor does it affect how a site is crawled for training future AI models—a function that remains governed by the "Google-Extended" robots.txt token.
A Chronology of Control
The road to this setting has been marked by a tug-of-war between publisher demands and Google’s rapid AI integration. Historically, the tools available to webmasters—such as robots.txt, noindex tags, and snippet directives—were designed for a world of static links. They were never intended to differentiate between a traditional search result and a generative summary.
For a long time, the only way to prevent content from appearing in AI-generated answers was to use the nosnippet directive, which simultaneously stripped the site of its traditional search snippets. This "all-or-nothing" approach proved unacceptable for publishers who wanted to remain visible in organic search while opting out of AI experiments.
The shift toward a more nuanced control began in early 2024. In January, Google publicly acknowledged the need for better opt-out mechanisms. Coincidentally, this announcement arrived on the same day the UK’s Competition and Markets Authority (CMA) launched a consultation regarding the impact of AI on publisher business models. By June, the CMA had formalized its stance, imposing a conduct requirement that mandates Google provide webmasters with clear, granular control over how their content is used in generative AI. Google began testing the toggle with UK-based properties almost immediately, with a global rollout to select accounts following in July.
The "Top Stories" Dilemma
Perhaps the most pressing concern for publishers is the realization that AI and traditional search are no longer neatly segregated. Data released by NewzDash, a prominent news-visibility tracking firm, highlights a trend that should concern any digital publisher: Top Stories carousels are increasingly appearing inside AI Overviews.
According to John Shehata, founder of NewzDash, nearly 16% of tracked U.S. trending news queries now display Top Stories within an AI Overview, with the figure climbing even higher in the UK. This creates a dangerous paradox. If a publisher opts out of AI features to avoid having their content synthesized, they may inadvertently opt out of the Top Stories carousel as well, effectively gutting their visibility on high-traffic, trending news topics.
While Google has not officially confirmed that the Search Console opt-out will result in the loss of these embedded carousels, the logic follows that if the carousel is part of the "AI surface," it may be subject to the same exclusionary trigger. For news outlets that rely on the ephemeral, high-volume traffic of breaking news, the potential cost of opting out is likely far higher than any perceived benefit of keeping their content out of AI summaries.
Data Gaps and the Quest for Transparency
One of the most significant criticisms of the current rollout is the lack of actionable data. While the "generative AI performance report" in Search Console provides insights into impressions generated by AI features, it remains a blunt instrument. It lacks granular data on clicks, queries, and, most importantly, the conversion value of that traffic.
Without a baseline to compare "AI-driven traffic" against "traditional organic traffic," site owners are essentially flying blind. Many in the SEO community, including industry leaders like Vahe Arabian of State of Digital Publishing, have emphasized that the challenge is not just viewing data in a silo, but integrating it into a comprehensive business scorecard.
The CMA has recognized this deficiency. Its current requirements for Google include a mandate to provide more detailed metrics—specifically click-through rates and actual traffic volume—which are expected to be available through accessible platforms by the end of the year. Until that data is available, making an informed decision about the opt-out toggle is nearly impossible.
Implications for Digital Business Models
For many businesses, the decision to toggle off AI features is being framed as a move to protect intellectual property and brand integrity. However, as Rahul Jain, CEO of Noble, has noted, opting out may actually hinder a brand’s long-term digital presence.
If the primary goal of an SEO strategy is to capture user attention, excluding one’s site from the very interfaces where that attention is consolidating could be a strategic error. Rather than viewing AI as a "content thief," some forward-thinking brands are shifting their focus toward "AI discovery"—optimizing their content to ensure they remain the primary sources cited in those generative answers.
Furthermore, there is a legitimate question about whether this opt-out is truly a solution or merely a symbolic gesture. Academic researchers, including those from the University of Oxford, have argued that current remedies do not address the core issue: the fundamental disruption of the publisher-reader relationship. An opt-out does not necessarily restore the traffic lost to AI; it simply removes the site from the equation entirely.
Future Outlook: The Path to 2027
The current state of AI controls is best described as "in flux." The next eighteen months will be critical for both Google and the publishing industry.
By December, the CMA’s requirements for enhanced click reporting should provide the transparency that webmasters have been crying out for. This data will be the "litmus test" for the value of AI-driven traffic. If the data shows high-quality, high-intent traffic, the opt-out toggle will likely be ignored by most major brands. If it shows high impressions with zero click-throughs, we can expect a mass exodus from these features.
Looking further ahead, March 2027 marks the deadline for more advanced, page-level controls. This will allow publishers to be surgical about what content they expose to AI—perhaps allowing product pages to be included while shielding high-value editorial content or deep-dive investigations.
For now, the advice for most webmasters is one of caution. Do not rush to toggle the setting based on fear. Monitor your analytics, watch for the promised reporting enhancements from Google, and keep a close eye on how your site’s "Top Stories" presence behaves within the evolving landscape of the SERP. The goal is not just to control the AI, but to understand how it can—or cannot—serve the bottom line of your business.
In the digital age, visibility remains the ultimate currency. Until the true cost of participating in the AI economy is measured in revenue rather than just impressions, the best course of action is to stay informed, stay visible, and prepare for a future where search is as much about synthesis as it is about discovery.
