There are several reasons why some people might support Cloudflare’s pay-per-crawl feature:
Cost Efficiency for Smaller Websites: Smaller websites may benefit from a pay-per-crawl model, as they might not need extensive crawling that larger sites require. This can reduce costs by paying only for what is necessary rather than a blanket fee.
Resource Allocation: By charging per crawl, Cloudflare can better allocate resources towards sites that require frequent crawling, ensuring sites get the performance they need without unnecessary overuse of resources. It discourages excessive crawling, freeing up network capacity for legitimate traffic.
Improved Web Security: Pay-per-crawl could reduce spam and unwanted bots, as malicious actors may be deterred by the additional costs involved in conducting vast, indiscriminate crawling campaigns.
Control and Customization: Website owners might gain more control over how often their site is crawled and can customize their services to match their specific needs and budget. This flexibility can be particularly beneficial for e-commerce sites during peak sales periods.
Encouraging Efficient Crawling Practices: By associating a cost with crawling, Cloudflare potentially encourages more efficient and ethical crawling practices that consider the network load and minimize unnecessary data scraping.
Potential for Innovation: The pay-per-crawl model may drive innovation in website management and crawling efficiency, as both users and developers seek methods to optimize their data usage under the pay-per-crawl scheme.

This feature attracts those who see value in balancing their service usage with their financial and operational goals, benefiting from cost control, security, and performance optimization.