Double check the user agents whitelisted for every deployment, since you may not need all of them, or you might want to add some
Every deployment can also be used as a Edge Cache API. You can simply forward requests to us when you detect a bot in a user agent.
This is the recommended way to deploy.
WRCacheHit header with a value of
1 indicates the cache was hit - but you can safely forward any requests since we will simply fetch origin if it's not in the cache. If it's from a crawler that doesn't support JS we'll pre-render it, if the the client does support JS it'll be rendered on the fly.
We recommend using WebRender in combination with Cloudflare Workers for the best results. For optimal speed, consider taking advantage of their KV Storage solution so you can minimize requests to the WebRender API even further and save costs.
Step 1: Create a Cloudflare Worker
Step 2: Go to Workers -> Add route and use the worker on your domain
Step 3: Paste the code below into your worker