Cloudflare announced the launch of the Markdown for Agents feature, which can convert HTML-formatted web page content into Markdown format, which is more suitable for AI crawlers or intelligent agents, improving the readability of content for AI.
Cloudflare states that HTML-formatted web page content is traditionally geared towards human users rather than AI, and its structure is often very low.
This results in a much higher number of tokens required to extract the same content from HTML web pages compared to Markdown text: for example, the HTML version of the original blog requires 16,180 tokens, while the Markdown version only requires 3,150 tokens, saving more than 80% of the tokens.
With the Markdown for Agents feature, Cloudflare can automatically and efficiently convert users’ HTML web pages into Markdown, eliminating the need for AI to reflow them during crawling and helping businesses gain an advantage in the GEO wave.
