Cloudflare and OpenAI are collaborating on a project to enhance the freshness of AI search results.
Cloudflare has spent the past year equipping websites to defend against AI crawlers. Now, the company aims to assist one in improving its crawling capabilities. On Wednesday, it announced a research pilot in collaboration with OpenAI to explore whether its network data can enhance the accuracy of AI search results.
Cloudflare covers more than 20% of the internet, providing it with insights into real-time changes to web pages and user traffic patterns. This pilot will relay signals, such as content freshness and traffic quality, to OpenAI's search and response system.
The significance of freshness
The quality of AI responses depends on the underlying pages. When an index is outdated, a chatbot can disseminate outdated or inaccurate information. OpenAI seeks to utilize Cloudflare's live web insights to help ChatGPT uncover new content more promptly.
In addition, OpenAI has established content partnerships to enrich ChatGPT. However, this pilot addresses a different challenge—it focuses on discovery rather than licensing.
"Current information is vital for providing accurate answers to ChatGPT users," stated Nick Ryder, OpenAI’s Vice President of Research. He characterized the trial as a means to streamline content discovery.
A noteworthy shift
This initiative seems unusual considering Cloudflare’s recent actions. Last year, it allowed websites to block AI crawlers unless the AI companies compensated publishers, and it developed a browser protocol to distinguish between humans and bots. Its message was clear: your content, your rules.
This pilot represents a different approach. Instead of restricting access to content, Cloudflare is now facilitating AI systems to access it. CEO Matthew Prince described it as a method to enhance efficiency, aiming to “make AI search more efficient and assist people in obtaining quality answers more quickly.”
The implications
The landscape of search is evolving from traditional links to direct answers. Publishers are already concerned about losing traffic as chatbots summarize their content, a concern that has led regulators to mandate opt-outs. Cloudflare now occupies a dual role, providing tools to block crawlers and testing systems to support them. The outcome of this pilot could influence who interacts with the open web and the conditions under which they do so.
Other articles
Cloudflare and OpenAI are collaborating on a pilot project to enhance the freshness of AI search results.
Cloudflare is collaborating with OpenAI to integrate real-time network signals into ChatGPT's search, marking a shift for a company that was established to prevent AI crawlers.
Perplexity is discreetly developing a coding tool powered by AI.
Perplexity has developed an internal coding tool referred to as "Teammate," which may compete with Cursor and Claude Code, according to Business Insider. The launch has not yet been confirmed.
NATO engages Accenture and Leonardo for a secure cloud project valued at €200 million.
NATO has finalized a seven-year agreement worth approximately €200 million with Accenture and Leonardo to create a secure cloud infrastructure, known as the Protected Business Network, for the Alliance.
ZML's complimentary AI server operates on all major chipsets.
France's ZML has launched ZML/LLMD, a free inference server that operates open-source AI at high speed on Nvidia, AMD, Google, Intel, and Apple processors.
OpenAI's GPT-Live: A ChatGPT voice that both listens and speaks.
OpenAI has introduced GPT-Live, a voice feature for ChatGPT that allows for simultaneous listening and speaking, complete with live translation. This feature is being made available to all users, including those using the free version.
The GhostApproval flaw disrupts six leading AI coding agents.
Wiz's 'GhostApproval' employs an old symlink method to enable six AI coding agents, including Amazon Q and Cursor, to write beyond the sandbox and transfer control of the box.
Cloudflare and OpenAI are collaborating on a project to enhance the freshness of AI search results.
Cloudflare is collaborating with OpenAI to integrate real-time network signals into ChatGPT's search, marking a shift for a company that was founded on preventing AI crawlers.