A Correlation Between Google Rankings and ChatGPT Mentions

Recent studies by Seer Interactive have highlighted an intriguing connection between Google search rankings and brand mentions in AI-generated ChatGPT responses. The digital marketing agency Seer Interactive published findings that illustrate this correlation. This discovery reinforces the ever-evolving landscape of search engine optimization (SEO) and generative engine optimization (GEO), pointing to the need for brands to adapt to new digital paradigms.

The research reveals how optimization for large language models (LLMs) differs from traditional SEO practices, even though both aim to improve content discoverability. As marketers seek to position their brands prominently in digital spaces, understanding these correlations becomes essential. The analysis conducted by Seer Interactive serves as a strategic guide to advances in digital marketing.

Key findings from the study

Seer Interactive analyzed more than 10,000 questions across the finance and SaaS sectors, using OpenAI's GPT-4 API. The goal was to determine which queries resulted in brand mentions. Key findings included:

• A strong correlation of 0.65 was found between brands ranking on Google's first page and mentions in language models such as ChatGPT.
• Bing search rankings also had an impact, although a weaker one, with correlations ranging from 0.5 to 0.6.
• The role of backlinks was less significant than expected, with a weak or neutral impact on LLM mentions.
• Multimodal content also had no significant influence on mentions in generative models.

Although significant, this correlation does not necessarily imply causation. The study suggests that strong Google rankings contribute to visibility in LLMs, but they are part of a broader range of factors, including public relations strategies, digital partnerships, and on-page improvements.

Broader implications

The implications of this study go beyond one-off SEO adjustments. It points to the need for a holistic approach to digital marketing, integrating GEO strategies with traditional SEO practices. This includes:

• Optimizing diverse content formats, such as long-form articles, videos, and interactive images.
• Leveraging digital partnerships to increase brand visibility across multiple platforms.

These practices expand brands' reach, making them more visible in both conventional search engines and generative AI platforms.

Insights

For marketing and technology professionals, the study offers practical insights, including:

1. Adapting SEO strategies: Incorporate emerging trends in LLM optimization to ensure a strong presence in traditional and generative search engines.
2. Focusing on high-quality content: Create materials aligned with current SEO standards and LLM algorithms to increase relevance and reach.
3. Understanding visibility dynamics in LLMs: This perspective enables brands to maintain a competitive advantage by refining their digital presence with precision and foresight.

The Seer Interactive study highlights a dynamic intersection between traditional search engines and modern AI-based platforms, inviting professionals to explore and adapt their practices.

06 key facts about the correlation between Google rankings and ChatGPT

1. Proprietary Monitoring Tool:
   • Seer Interactive developed an exclusive tool to monitor LLM mentions (large language models), enabling large-scale testing and the combination of data from multiple sources to identify patterns between mentions and external factors.
2. Using 'People Also Ask' Questions as Proxies:
   • Questions from the Google and Bing "People Also Ask" (PAA) feature were used as proxies for real user queries. This included more than 600,000 questions, of which 10,000 were filtered as relevant to the analysis.
3. The Join Key Challenge:
   • A join key had to be created to correlate domains with brand mentions in LLM responses. This revealed a specific challenge: LLMs mention products directly, but do not always associate them with the primary brand.
4. Filtering Out "Noise":
   • Forum websites, aggregators, and social networks were excluded because, although they may appear in organic search results, they rarely provide solution-oriented answers in LLMs. Removing these sites resulted in stronger correlations between rankings and brand mentions in LLMs.
5. Lower Impact of Multimodal Content and Backlinks:
   • Backlinks and multimodal content (such as videos and images) had a minor or neutral impact on LLM mentions, contrary to common SEO expectations.
6. Solution-Oriented Website Categories:
   • Solution-oriented websites, such as SaaS providers, showed significantly stronger correlations with LLM mentions than more general or discussion-focused categories.

Reflections

Advances in AI and search engine technologies mark the beginning of a new era of innovation and transformation in digital ecosystems. Understanding the correlations between traditional SEO and generative AI goes far beyond one-off adjustments, requiring a strategic approach that connects PR efforts, on-page optimization, and technology partnerships.

This initial study is just the starting point. There is still much to explore, including:

• The impact of strategic partnerships with organizations such as OpenAI, and PR efforts, on increasing mentions in AI responses.
• The role of citation policies and specific content strategies in the context of brand visibility.
• The influence of real-time updates, assessing how these changes affect AI-generated responses.

As these correlations are refined, it will be possible to implement targeted changes and measure their impact on brand mentions generated by language models. This continuous learning process will enable professionals to actively shape the future of digital visibility, maximizing brands' reach across multiple platforms.

The challenge now is to identify which factors to test next and how they can help maximize digital presence. We want to keep exploring, learning, and expanding the boundaries of AI visibility.

This content was produced based on the article by Search Engine Land.