Opens in a new tab

Breaking news

Cloudflare Sets New Default To Separate Search Crawlers From AI Bots

Cloudflare has drawn a sharper line between traditional search and artificial intelligence.

Beginning September 15, 2026, the company will change its default settings to block so-called mixed-use crawlers from pages that run ads, unless a site owner chooses otherwise. The policy applies to new Cloudflare customers, new sites created by existing customers, and all current free customers.

A Clearer Divide In Web Access

The shift could materially reshape how AI companies collect web data for model training and agentic products. Cloudflare’s central argument is straightforward: most publishers want their content to remain visible in search and accessible through certain AI services, but they do not want that same material repurposed without compensation.

In Cloudflare’s view, the problem is not crawling itself. It is the blending of three different functions: search, agentic use, and training into a single bot that makes it difficult for website owners to set meaningful boundaries.

The Google Question

Cloudflare pointedly referenced the “world’s largest search engine,” an unmistakable nod to Google, arguing that it has access to roughly twice as much information as rival AI companies because it makes it harder for customers to stay discoverable without also being used for AI.

Google has disputed that framing. The company offers Google Extended, a crawler setting that lets publishers opt out of having content used for training and AI products such as Gemini apps and Vertex AI, without affecting visibility in Google Search. At the same time, Googlebot still crawls for Search and for AI-powered features such as AI Overviews and AI Mode.

Publishers Want Reach, Not Exploitation

Matthew Prince, Cloudflare’s co-founder and chief executive, said the company is moving quickly because the internet is now dominated by machine traffic.

“Now that the majority of traffic on the Internet is non-human, we must go further and act faster so that a sustainable ecosystem can emerge,” Prince said, referring to the recent milestone in which bots surpassed human traffic online sooner than expected.

Prince added that Cloudflare’s tools and partnerships are designed to give publishers more visibility and commercial leverage, while also rewarding AI companies that are transparent about how they use content.

From Pay Per Crawl To Pay Per Use

Cloudflare has increasingly positioned itself as a gatekeeper for publishers looking to assert control in the AI era. The company already offers tools to block AI bots, along with a marketplace called Pay Per Crawl, which lets websites charge AI systems for scraping.

That framework is now expanding into Pay Per Use, which Cloudflare says will allow publishers to charge AI companies when content creates value, not merely when it is fetched. In practical terms, that shifts the economics from extraction to monetization.

Cloudflare says the move may also reduce waste. Its data suggests more than half of crawl traffic from AI bots is spent revisiting pages that have not changed, consuming bandwidth and compute without adding fresh value for either side.

Early Partners Signal The Commercial Model

To launch the new system, Cloudflare is working with Ceramic.ai and You.com. Under the opt-in model, publishers can be paid when their content appears in Ceramic’s AI search results or when You.com accesses premium material.

Cloudflare says other AI companies can adapt the model to fit their own products. The broader message is clear: the era of unrestricted crawling is giving way to one in which access, attribution, and compensation are increasingly negotiated rather than assumed.

Building A Gaming Startup In Cyprus? Plug And Play Opens Applications For Its Second Accelerator

Gaming studios and technology startups in Cyprus can now apply for the second cohort of the Plug and Play Cyprus Accelerator Programme, a three-month initiative offering international mentorship, business development support and access to a global network of investors and corporate partners.

The new cohort will focus on gaming, social and leisure technologies, targeting companies developing games, digital entertainment platforms and technologies supporting the wider gaming industry.

Applications will close on 10 January 2027, with the programme scheduled to begin in Limassol on 8 March.

Implemented by Plug and Play Cyprus, the accelerator is co-funded by the Republic of Cyprus through the Deputy Ministry of Research, Innovation and Digital Policy and the Research and Innovation Foundation (RIF).

Which Startups Can Apply?

The second cohort focuses on gaming and related technologies, with seven areas of interest:

  • Game development: Studios creating PC, console and extended reality (XR) games, from independent productions to larger titles.
  • Mobile and hybrid-casual gaming: Developers using rapid prototyping and data-driven game operations to reach international audiences.
  • Gaming technology: Startups building tools and infrastructure, including game engines, AI, anti-cheat systems, payment technologies and esports platforms.
  • Business intelligence: AI-powered analytics and social listening tools for gaming companies and brands.
  • Immersive technologies: Augmented reality, virtual reality and spatial experiences.
  • Creator economy: Tools supporting streaming, video production and content monetisation.
  • Publishing and distribution: Platforms and services helping developers bring games to market.

The accelerator is seeking startups already established and actively operating in Cyprus, with innovative products or business models capable of expanding internationally.

Applicants should demonstrate significant growth potential, a scalable business model and readiness to attract venture capital investment.

What Does The Programme Offer?

Selected startups will participate in a three-month acceleration programme in Limassol, receiving support from Plug and Play’s international network.

The programme includes:

  • Expert mentorship: Access to experienced entrepreneurs, industry specialists and international mentors.
  • Business development: Personalised feedback on commercial strategy, business models and growth opportunities.
  • Investment opportunities: The chance to explore potential funding with Plug and Play’s investment team.
  • International connections: Access to Plug and Play’s global network of corporate partners, investors and other startups.
  • Workshops and lectures: Sessions covering entrepreneurship, pitching and business development with international experts and experienced founders.

The programme’s timetable includes a Cyprus Expo scheduled for 20 May 2027.

No equity is required to join the accelerator. Selected startups may receive funding to cover programme services through a dedicated RIF scheme that will be announced soon.

The programme does not guarantee investment from Plug and Play.

Building On The First Cohort

The new call follows the completion of Plug and Play Cyprus’s inaugural acceleration programme, which supported ten startups.

According to the organisers, the first cohort received more than 250 hours of mentoring, including 167 in-person, one-to-one sessions, with contributions from more than 25 international mentors.

The programme concluded with the first Plug and Play Cyprus Innovation Expo in Limassol on 11 November, where participating startups presented their progress to investors, corporate representatives and members of the local innovation community.

How To Apply

Applications are open to eligible startups established and actively operating in Cyprus.

Key dates for the second cohort:

  • Application deadline: 10 January 2027
  • Selected cohort announced: 8 February 2027
  • Programme begins: 8 March 2027
  • Cyprus Expo: 20 May 2027
  • Location: Limassol, Cyprus
  • Duration: Three months
  • Equity requirement: None

Following the application deadline, the Plug and Play team will review the applications and present shortlisted companies to its Investment Committee, which will make the final selection. All applicants will be informed of the outcome.

Interested founders can submit their application through the official Plug and Play form.

Further information about the selection criteria, programme benefits and participation conditions is available on the Plug and Play Cyprus Accelerator website.

The Future Forbes Realty Global Properties
Uol
eCredo
Aretilaw firm

Become a Speaker

Become a Speaker

Become a Partner

Subscribe for our weekly newsletter